Sep 10 02:47:09.224412 ip-10-0-143-198 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 02:47:09.224423 ip-10-0-143-198 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 02:47:09.224430 ip-10-0-143-198 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 02:47:09.224580 ip-10-0-143-198 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 02:47:19.396678 ip-10-0-143-198 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 02:47:19.396698 ip-10-0-143-198 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ce75dbc1ad194e7c94c8b3ec48750b14 --
Sep 10 02:49:17.750227 ip-10-0-143-198 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 02:49:18.109456 ip-10-0-143-198 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 02:49:18.109456 ip-10-0-143-198 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 02:49:18.109456 ip-10-0-143-198 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 02:49:18.109456 ip-10-0-143-198 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 02:49:18.109456 ip-10-0-143-198 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 02:49:18.110391 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.110301    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 02:49:18.116710 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116684    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 02:49:18.116710 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116706    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 02:49:18.116710 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116709    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 02:49:18.116710 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116712    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 02:49:18.116710 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116716    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116721    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116726    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116729    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116732    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116736    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116739    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116741    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116744    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116747    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116750    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116753    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116756    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116758    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116762    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116766    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116769    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116772    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116775    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 02:49:18.116933 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116777    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116780    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116782    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116785    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116788    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116790    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116793    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116796    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116798    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116801    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116811    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116813    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116816    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116818    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116821    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116824    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116827    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116830    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116832    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116835    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 02:49:18.117390 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116838    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116840    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116843    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116846    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116849    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116852    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116854    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116857    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116860    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116879    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116882    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116885    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116888    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116891    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116894    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116896    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116899    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116901    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116904    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116907    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 02:49:18.117999 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116910    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116913    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116917    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116920    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116923    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116926    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116929    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116933    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116936    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116941    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116944    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116947    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116956    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116959    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116962    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116964    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116967    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116970    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116972    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 02:49:18.118477 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116975    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116979    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116981    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116984    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116986    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116989    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116991    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116994    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.116997    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117000    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117002    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117005    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117008    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117010    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117013    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117015    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117018    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117738    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117745    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117749    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 02:49:18.118986 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117752    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117756    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117759    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117762    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117765    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117768    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117770    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117773    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117776    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117778    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117781    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117784    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117786    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117789    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117792    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117794    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117798    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117801    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117804    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117806    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 02:49:18.119481 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117809    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117811    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117814    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117817    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117819    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117822    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117824    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117828    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117831    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117833    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117838    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117842    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117846    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117849    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117852    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117855    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117858    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117861    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117879    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 02:49:18.120000 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117903    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117906    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117909    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117912    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117915    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117918    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117921    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117924    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117927    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117930    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117932    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117935    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117938    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117940    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117943    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117945    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117948    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117950    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117953    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 02:49:18.120462 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117956    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117960    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117964    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117967    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117969    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117972    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117975    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117977    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117980    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117983    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117986    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117988    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117990    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117993    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117995    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.117998    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118001    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118003    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118006    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 02:49:18.120939 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118008    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118011    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118014    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118017    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118020    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118022    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118025    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118027    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118030    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118032    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118036    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118038    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118041    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118044    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118046    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118049    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118051    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118054    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118057    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118450    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 02:49:18.121402 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118454    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118457    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118460    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118463    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118466    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118468    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118471    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118473    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118475    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118478    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118481    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118484    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118487    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118489    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118492    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118495    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118498    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118500    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118503    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 02:49:18.121929 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118505    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118508    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118510    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118513    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118515    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118518    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118520    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118523    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118525    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118528    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118530    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118533    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118536    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118538    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118541    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118544    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118547    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118549    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118551    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118554    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 02:49:18.122381 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118556    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118558    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118561    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118563    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118565    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118568    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118570    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118573    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118575    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118578    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118581    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118585    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118587    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118589    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118592    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118594    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118597    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118599    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118602    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118604    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 02:49:18.122881 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118606    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118609    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118611    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118614    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118616    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118619    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118621    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118624    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118626    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118628    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118631    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118633    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118636    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118638    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118640    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118642    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118645    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118649    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118653    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 02:49:18.123367 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118656    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118659    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118661    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118664    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118667    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118669    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118672    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118674    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118679    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118682    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118685    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118687    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118690    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118692    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118695    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118697    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118700    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118702    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118705    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.118708    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 02:49:18.123854 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118785    2564 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118817    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118824    2564 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118828    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118832    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118835    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118839    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118844    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118847    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118850    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118853    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118857    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118859    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118862    2564 flags.go:64] FLAG: --cgroup-root=""
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118879    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118883    2564 flags.go:64] FLAG: --client-ca-file=""
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118887    2564 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118890    2564 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118895    2564 flags.go:64] FLAG: --cluster-domain=""
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118897    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118903    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118906    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118909    2564 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118914    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 02:49:18.124358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118916    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118920    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118923    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118926    2564 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118929    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118932    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118935    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118937    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118941    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118944    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118947    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118950    2564 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118953    2564 flags.go:64] FLAG: --enable-server="true"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118955    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118959    2564 flags.go:64] FLAG: --event-burst="100"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118962    2564 flags.go:64] FLAG: --event-qps="50"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118965    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118968    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118971    2564 flags.go:64] FLAG: --eviction-hard=""
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118975    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118978    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118981    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118983    2564 flags.go:64] FLAG: --eviction-soft=""
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118986    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118989    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 02:49:18.124946 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118993    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118995    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.118999    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119003    2564 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119006    2564 flags.go:64] FLAG: --feature-gates=""
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119010    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119012    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119015    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119018    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119021    2564 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119027    2564 flags.go:64] FLAG: --help="false"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119030    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119033    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119036    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119039    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119042    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119046    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119048    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119051    2564 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119054    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119057    2564 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119060    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119063    2564 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119065    2564 flags.go:64] FLAG: --kube-reserved=""
Sep 10 02:49:18.125571 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119068    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119071    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119074    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119076    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119079    2564 flags.go:64] FLAG: --lock-file=""
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119082    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119085    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119087    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119093    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119096    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119099    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119102    2564 flags.go:64] FLAG: --logging-format="text"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119105    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119108    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119111    2564 flags.go:64] FLAG: --manifest-url=""
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119114    2564 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119118    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119121    2564 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119126    2564 flags.go:64] FLAG: --max-pods="110"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119129    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119132    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119135    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119137    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119140    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119143    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 02:49:18.126209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119145    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119154    2564 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119157    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119160    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119163    2564 flags.go:64] FLAG: --pod-cidr=""
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119165    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119171    2564 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119173    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119177    2564 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119179    2564 flags.go:64] FLAG: --port="10250"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119182    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119185    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06e2436b42719df28"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119188    2564 flags.go:64] FLAG: --qos-reserved=""
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119191    2564 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119198    2564 flags.go:64] FLAG: --register-node="true"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119201    2564 flags.go:64] FLAG: --register-with-taints=""
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119204    2564 flags.go:64] FLAG: --registry-burst="10"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119207    2564 flags.go:64] FLAG: --registry-qps="5"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119211    2564 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119214    2564 flags.go:64] FLAG: --reserved-memory=""
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119217    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119220    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119223    2564 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119226    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119229    2564 flags.go:64] FLAG: --runonce="false"
Sep 10 02:49:18.126816 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119231    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119236    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119239    2564 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119242    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119244    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119247    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119250    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119253    2564 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119256    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119258    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119261    2564 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119265    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119267    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119270    2564 flags.go:64] FLAG: --system-cgroups=""
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119273    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119278    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119280    2564 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119283    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119288    2564 flags.go:64] FLAG: --tls-min-version=""
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119290    2564 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119293    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119296    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119299    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119301    2564 flags.go:64] FLAG: --v="2"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119305    2564 flags.go:64] FLAG: --version="false"
Sep 10 02:49:18.127473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119311    2564 flags.go:64] FLAG: --vmodule=""
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119315    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.119318    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119432    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119436    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119439    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119442    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119445    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119449    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119451    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119453    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119456    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119460    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119464    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119467    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119470    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119473    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119476    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119478    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 02:49:18.128195 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119481    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119483    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119486    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119489    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119491    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119494    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119496    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119507    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119511    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119515    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119518    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119520    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119523    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119527    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119530    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119532    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119535    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119538    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119540    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 02:49:18.128663 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119543    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119545    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119548    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119551    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119554    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119556    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119559    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119561    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119564    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119568    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119571    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119574    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119577    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119579    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119582    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119584    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119587    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119589    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119592    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119594    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 02:49:18.129139 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119596    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119599    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119601    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119604    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119606    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119608    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119612    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119615    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119618    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119620    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119623    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119625    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119628    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119630    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119634    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119637    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119640    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119642    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119645    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119647    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 02:49:18.129619 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119650    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119652    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119654    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119657    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119659    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119662    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119664    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119667    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119670    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119672    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119675    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119677    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119680    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119682    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119685    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119687    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119689    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119692    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119695    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119698    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 02:49:18.130155 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119701    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119704    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119706    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.119709    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.120209    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.127468    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.127487    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.128156    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.128165    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128224    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128230    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128235    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128238    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128241    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128245    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 02:49:18.130644 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128247    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128250    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128253    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128256    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128259    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128262    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128264    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128267    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128270    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128272    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128275    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128277    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128280    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128282    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128285    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128287    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128290    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128292    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128296    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128300    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 02:49:18.131071 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128302    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128305    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128307    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128311    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128314    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128317    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128319    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128322    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128324    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128328    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128332    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128335    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128338    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128341    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128343    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128346    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128349    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128352    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128354    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 02:49:18.131613 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128356    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128360    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128364    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128366    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128369    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128372    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128375    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128377    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128380    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128383    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128385    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128388    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128390    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128393    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128396    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128398    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128402    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128405    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128408    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 02:49:18.132087 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128410    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128413    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128415    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128418    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128421    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128423    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128425    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128428    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128431    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128433    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128436    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128438    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128441    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128443    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128446    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128448    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128451    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128453    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128455    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128458    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 02:49:18.132656 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128460    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128462    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128465    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128467    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128470    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128472    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128475    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128477    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128480    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128483    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128485    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128489    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128491    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128493    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128496    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 02:49:18.135998 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.128501    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128616    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128620    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128623    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128625    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128628    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128630    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128633    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128635    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128638    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128640    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128643    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128647    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128649    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128652    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128654    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128657    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128659    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128661    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128664    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 02:49:18.142301 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128667    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128669    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128672    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128675    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128678    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128680    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128682    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128685    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128688    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128691    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128694    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128697    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128699    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128703    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128706    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128709    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128712    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128715    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128717    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128720    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 02:49:18.142822 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128722    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128725    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128727    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128730    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128732    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128734    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128737    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128739    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128742    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128744    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128746    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128749    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128752    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128755    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128757    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128761    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128764    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128767    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128770    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128773    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 02:49:18.143337 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128776    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128779    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128782    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128784    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128787    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128789    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128791    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128794    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128797    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128799    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128801    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128804    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128806    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128809    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128811    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128813    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128816    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128818    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128821    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 02:49:18.144042 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128823    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128826    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128828    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128831    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128833    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128836    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128838    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128841    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128843    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128845    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128848    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128850    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128853    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128856    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128858    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128860    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128879    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128883    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128886    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128889    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 02:49:18.144612 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:18.128891    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 02:49:18.145346 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.128897    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 02:49:18.145346 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.129019    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 02:49:18.145346 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.131256    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 02:49:18.145346 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.132109    2564 server.go:1019] "Starting client certificate rotation"
Sep 10 02:49:18.145346 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.132223    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 02:49:18.145346 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.132267    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 02:49:18.145346 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.134546    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 02:49:18.145346 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.135795    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 02:49:18.155110 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.155085    2564 log.go:25] "Validated CRI v1 runtime API"
Sep 10 02:49:18.159801 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.159781    2564 log.go:25] "Validated CRI v1 image API"
Sep 10 02:49:18.161420 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.161403    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 02:49:18.164221 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.164202    2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 83560a27-ddfe-4962-a512-5b014641cf0b:/dev/nvme0n1p4 8f718317-7ffa-405f-9fd7-0dda2fdb6e9e:/dev/nvme0n1p3]
Sep 10 02:49:18.164273 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.164223    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 02:49:18.169388 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.169262    2564 manager.go:216] Machine: {Timestamp:2026-09-10 02:49:18.168756525 +0000 UTC m=+0.306164718 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102927 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2845b4c14a0483876917feecb83a93 SystemUUID:ec2845b4-c14a-0483-8769-17feecb83a93 BootID:ce75dbc1-ad19-4e7c-94c8-b3ec48750b14 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:d3:48:17:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:d3:48:17:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:38:9b:88:7d:11 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 02:49:18.169388 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.169365    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 02:49:18.169531 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.169451    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 02:49:18.172454 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.172431    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 02:49:18.172624 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.172596    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 02:49:18.172775 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.172630    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-198.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 02:49:18.173342 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.173332    2564 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 02:49:18.173382 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.173345    2564 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 02:49:18.173382 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.173354    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 02:49:18.173997 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.173986    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 02:49:18.175417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.175406    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 02:49:18.178609 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.178597    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 02:49:18.178741 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.178731    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 02:49:18.178775 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.178763    2564 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 02:49:18.178807 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.178777    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 02:49:18.178807 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.178792    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 02:49:18.178807 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.178803    2564 kubelet.go:398] "Adding apiserver pod source"
Sep 10 02:49:18.178918 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.178812    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 02:49:18.179255 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.179244    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 02:49:18.179299 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.179265    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 02:49:18.181368 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.181353    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 02:49:18.184140 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.184126    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 02:49:18.184204 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.184156    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 02:49:18.185112 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185093    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 02:49:18.185153 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185124    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 02:49:18.185153 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185131    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 02:49:18.185153 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185136    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 02:49:18.185153 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185145    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 02:49:18.185265 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185160    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 02:49:18.185265 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185174    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 02:49:18.185265 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185179    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 02:49:18.185265 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185197    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 02:49:18.185265 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185203    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 02:49:18.185265 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185217    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 02:49:18.185265 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185223    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 02:49:18.185265 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185247    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 02:49:18.185265 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.185252    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 02:49:18.187720 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.187700    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-198.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 02:49:18.188429 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.188405    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-198.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 02:49:18.188487 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.188405    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 02:49:18.189175 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.189163    2564 server.go:1268] "Started kubelet"
Sep 10 02:49:18.189234 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.189208    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 02:49:18.189334 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.189295    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 02:49:18.189381 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.189354    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 02:49:18.194020 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.193993    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 02:49:18.194318 ip-10-0-143-198 systemd[1]: Started Kubernetes Kubelet.
Sep 10 02:49:18.196217 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.195413    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4hzfs"
Sep 10 02:49:18.196217 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.196055    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 02:49:18.196549 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.196457    2564 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 02:49:18.200749 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.200732    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 02:49:18.200824 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.200755    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 02:49:18.200901 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.200854    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:18.201306 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.201264    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 02:49:18.201306 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.201266    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 02:49:18.201306 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.201289    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 02:49:18.201492 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.201438    2564 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 02:49:18.201492 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.201449    2564 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 02:49:18.201621 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.200724    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-198.ec2.internal.18d3d5ce1aff429d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-198.ec2.internal,UID:ip-10-0-143-198.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-198.ec2.internal,},FirstTimestamp:2026-09-10 02:49:18.189134493 +0000 UTC m=+0.326542718,LastTimestamp:2026-09-10 02:49:18.189134493 +0000 UTC m=+0.326542718,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-198.ec2.internal,}"
Sep 10 02:49:18.201695 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.201620    2564 factory.go:55] Registering systemd factory
Sep 10 02:49:18.201695 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.201635    2564 factory.go:223] Registration of the systemd container factory successfully
Sep 10 02:49:18.201936 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.201919    2564 factory.go:153] Registering CRI-O factory
Sep 10 02:49:18.201936 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.201938    2564 factory.go:223] Registration of the crio container factory successfully
Sep 10 02:49:18.202061 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.202011    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 02:49:18.202061 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.202031    2564 factory.go:103] Registering Raw factory
Sep 10 02:49:18.202061 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.202045    2564 manager.go:1196] Started watching for new ooms in manager
Sep 10 02:49:18.202452 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.202438    2564 manager.go:349] Starting recovery of all containers
Sep 10 02:49:18.208003 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.207978    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4hzfs"
Sep 10 02:49:18.210055 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.210028    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 02:49:18.210170 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.210103    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-198.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 02:49:18.211688 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.211663    2564 manager.go:354] Recovery completed
Sep 10 02:49:18.216191 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.216177    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 02:49:18.217770 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.217756    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 02:49:18.217842 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.217786    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 02:49:18.217842 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.217799    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientPID"
Sep 10 02:49:18.218443 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.218419    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 02:49:18.218443 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.218435    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 02:49:18.218568 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.218435    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 02:49:18.218568 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.218480    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 02:49:18.219147 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.219132    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 02:49:18.219214 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.219159    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 02:49:18.219214 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.219169    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientPID"
Sep 10 02:49:18.219637 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.219618    2564 policy_none.go:49] "None policy: Start"
Sep 10 02:49:18.219637 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.219635    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 02:49:18.219698 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.219648    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 02:49:18.220619 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.220609    2564 policy_none.go:47] "Start"
Sep 10 02:49:18.265560 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.265538    2564 manager.go:337] "Starting Device Plugin manager"
Sep 10 02:49:18.271534 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.265588    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 02:49:18.271534 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.265601    2564 server.go:87] "Starting device plugin registration server"
Sep 10 02:49:18.271534 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.265944    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 02:49:18.271534 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.265956    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 02:49:18.271534 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.266059    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 02:49:18.271534 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.266137    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 02:49:18.271534 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.266147    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 02:49:18.271534 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.266675    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 02:49:18.271534 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.266732    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:18.366544 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.366460    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 02:49:18.367598 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.367569    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 02:49:18.367732 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.367607    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 02:49:18.367732 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.367622    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientPID"
Sep 10 02:49:18.367732 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.367654    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.369275 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.369250    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 02:49:18.370636 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.370613    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 02:49:18.370719 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.370670    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 02:49:18.370719 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.370697    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 02:49:18.370851 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.370734    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 02:49:18.373212 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.373196    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 02:49:18.374358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.374343    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.374429 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.374364    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-198.ec2.internal\": node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:18.400733 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.400710    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:18.471819 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.471785    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-198.ec2.internal"]
Sep 10 02:49:18.471981 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.471893    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 02:49:18.473380 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.473364    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 02:49:18.473455 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.473393    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 02:49:18.473455 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.473405    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientPID"
Sep 10 02:49:18.474743 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.474730    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 02:49:18.474852 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.474837    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.474928 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.474884    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 02:49:18.475509 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.475494    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 02:49:18.475599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.475524    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 02:49:18.475599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.475540    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientPID"
Sep 10 02:49:18.476208 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.476192    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 02:49:18.476264 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.476222    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 02:49:18.476264 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.476233    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientPID"
Sep 10 02:49:18.477385 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.477372    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.477441 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.477394    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 02:49:18.478054 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.478041    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 02:49:18.478116 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.478066    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 02:49:18.478116 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.478075    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeHasSufficientPID"
Sep 10 02:49:18.499468 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.499449    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-198.ec2.internal\" not found" node="ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.501353 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.501336    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:18.503617 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.503597    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59db3c7f4073b3c025f3d43bbb653f6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal\" (UID: \"59db3c7f4073b3c025f3d43bbb653f6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.503711 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.503629    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59db3c7f4073b3c025f3d43bbb653f6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal\" (UID: \"59db3c7f4073b3c025f3d43bbb653f6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.503711 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.503646    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-198.ec2.internal\" not found" node="ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.503711 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.503657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4f320e49a706ec4bdf8b6ebf3e895a6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-198.ec2.internal\" (UID: \"a4f320e49a706ec4bdf8b6ebf3e895a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.602149 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.602120    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:18.604331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.604312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59db3c7f4073b3c025f3d43bbb653f6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal\" (UID: \"59db3c7f4073b3c025f3d43bbb653f6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.604397 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.604340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59db3c7f4073b3c025f3d43bbb653f6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal\" (UID: \"59db3c7f4073b3c025f3d43bbb653f6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.604397 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.604356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4f320e49a706ec4bdf8b6ebf3e895a6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-198.ec2.internal\" (UID: \"a4f320e49a706ec4bdf8b6ebf3e895a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.604458 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.604417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59db3c7f4073b3c025f3d43bbb653f6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal\" (UID: \"59db3c7f4073b3c025f3d43bbb653f6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.604458 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.604434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4f320e49a706ec4bdf8b6ebf3e895a6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-198.ec2.internal\" (UID: \"a4f320e49a706ec4bdf8b6ebf3e895a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.604458 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.604440    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59db3c7f4073b3c025f3d43bbb653f6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal\" (UID: \"59db3c7f4073b3c025f3d43bbb653f6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.702563 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.702490    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:18.801885 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.801828    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.802953 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.802936    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:18.808067 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:18.807941    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:18.903370 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:18.903321    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:19.003847 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:19.003776    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:19.104390 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:19.104340    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:19.131616 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:19.131584    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 02:49:19.132076 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:19.131735    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 02:49:19.204173 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:19.204141    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 02:49:19.204509 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:19.204493    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:19.213221 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:19.213181    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 02:44:19 +0000 UTC" deadline="2028-03-21 18:42:24.331702767 +0000 UTC"
Sep 10 02:49:19.213221 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:19.213216    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13407h53m5.11848995s"
Sep 10 02:49:19.305612 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:19.305574    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:19.370043 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:19.370009    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 02:49:19.386332 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:19.386305    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f320e49a706ec4bdf8b6ebf3e895a6.slice/crio-106b0ded5f92a989d9aad2c7af724ff0596896156a628886382d818616269162 WatchSource:0}: Error finding container 106b0ded5f92a989d9aad2c7af724ff0596896156a628886382d818616269162: Status 404 returned error can't find the container with id 106b0ded5f92a989d9aad2c7af724ff0596896156a628886382d818616269162
Sep 10 02:49:19.386537 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:19.386521    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59db3c7f4073b3c025f3d43bbb653f6b.slice/crio-ce975c9e3d9cc1fcfd3b1a9096ec4c997242ec5711a2912a06d349fce33a312f WatchSource:0}: Error finding container ce975c9e3d9cc1fcfd3b1a9096ec4c997242ec5711a2912a06d349fce33a312f: Status 404 returned error can't find the container with id ce975c9e3d9cc1fcfd3b1a9096ec4c997242ec5711a2912a06d349fce33a312f
Sep 10 02:49:19.391947 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:19.391929    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 02:49:19.406598 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:19.406576    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-198.ec2.internal\" not found"
Sep 10 02:49:20.853072 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:20.853047    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 02:49:20.951473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:20.951444    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:20.965075 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:20.965054    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 02:49:20.966171 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:20.966159    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-198.ec2.internal"
Sep 10 02:49:20.977889 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:20.977876    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 02:49:21.530323 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.530284    2564 apiserver.go:52] "Watching apiserver"
Sep 10 02:49:21.539387 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.539358    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 02:49:21.541208 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.541173    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-rrfth","openshift-image-registry/node-ca-gzsdt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal","openshift-multus/network-metrics-daemon-d4br4","openshift-network-operator/iptables-alerter-5gbdg","openshift-ovn-kubernetes/ovnkube-node-n4kmx","kube-system/global-pull-secret-syncer-r6sxm","kube-system/konnectivity-agent-6wpfq","openshift-dns/node-resolver-9cbc9","openshift-multus/multus-additional-cni-plugins-fkf8z","openshift-multus/multus-dxf6b","openshift-network-diagnostics/network-check-target-9q5w2","kube-system/kube-apiserver-proxy-ip-10-0-143-198.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"]
Sep 10 02:49:21.542581 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.542553    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:21.542703 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:21.542652    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:21.543817 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.543793    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.544857 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.544835    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.545897 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.545875    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:21.546022 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:21.545941    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:21.546642 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.546624    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 02:49:21.546747 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.546728    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 02:49:21.546854 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.546605    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 02:49:21.546975 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.546960    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gch8l\""
Sep 10 02:49:21.547061 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.547045    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 02:49:21.547280 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.547259    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5gbdg"
Sep 10 02:49:21.547368 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.547335    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 02:49:21.547439 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.547416    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 02:49:21.548540 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.548521    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.548933 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.548914    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8gfj6\""
Sep 10 02:49:21.549212 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.549193    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 02:49:21.549710 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.549691    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 02:49:21.549778 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.549725    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 02:49:21.549968 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.549950    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7f9h2\""
Sep 10 02:49:21.550260 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.550240    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 02:49:21.551509 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.550838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9cbc9"
Sep 10 02:49:21.551509 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.550865    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pj658\""
Sep 10 02:49:21.551509 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.551031    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 02:49:21.552199 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.552183    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6wpfq"
Sep 10 02:49:21.553065 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.552865    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 02:49:21.553400 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.553382    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 02:49:21.553477 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.553413    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 02:49:21.553638 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.553597    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 02:49:21.553743 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.553578    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 02:49:21.553809 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.553752    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gzsdt"
Sep 10 02:49:21.555520 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.555502    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.558086 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.558066    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.559846 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.558843    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:21.559846 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:21.559574    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:21.559846 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.558980    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 02:49:21.559846 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.558933    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 02:49:21.559846 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.559066    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 02:49:21.559846 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.559150    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 02:49:21.559846 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.559195    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 02:49:21.559846 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.559196    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 02:49:21.559846 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.559131    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 02:49:21.559846 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.559242    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kk2pb\""
Sep 10 02:49:21.560313 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.560098    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-plbfk\""
Sep 10 02:49:21.560313 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.560167    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wn9v4\""
Sep 10 02:49:21.560313 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.560183    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 02:49:21.560313 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.560268    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4hhk9\""
Sep 10 02:49:21.560499 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.560411    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 02:49:21.560715 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.560545    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 02:49:21.562836 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.562648    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:21.562836 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.562701    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53bff21c-7fde-4bbe-b6d6-4777c8dd60a4-iptables-alerter-script\") pod \"iptables-alerter-5gbdg\" (UID: \"53bff21c-7fde-4bbe-b6d6-4777c8dd60a4\") " pod="openshift-network-operator/iptables-alerter-5gbdg"
Sep 10 02:49:21.562836 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.562727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs\") pod \"network-metrics-daemon-d4br4\" (UID: \"8466af26-10ce-4dc3-a326-d798025b8220\") " pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:21.562836 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.562746    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-cni-netd\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.562836 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.562773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qfmc\" (UniqueName: \"kubernetes.io/projected/77322166-d6bf-43cd-99c6-97e11467f96b-kube-api-access-6qfmc\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.562836 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.562796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-multus-conf-dir\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.562836 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.562815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcd228a3-a91c-4ea7-b631-e2585afd54bc-cni-binary-copy\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.562842    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m54pg\" (UniqueName: \"kubernetes.io/projected/726b6ce9-abfb-4028-8195-2cbc7f36729b-kube-api-access-m54pg\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.562874    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-cnibin\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.562904    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-var-lib-cni-bin\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.562936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-var-lib-openvswitch\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.562964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-run-openvswitch\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.562993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563025    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-run-k8s-cni-cncf-io\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563088    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2c14c85f-51c6-41d3-8edd-a3a27ec01497-kubelet-config\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563120    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9839b155-58d3-4a56-b8ad-e08621e92f06-agent-certs\") pod \"konnectivity-agent-6wpfq\" (UID: \"9839b155-58d3-4a56-b8ad-e08621e92f06\") " pod="kube-system/konnectivity-agent-6wpfq"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-kubelet\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-device-dir\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9839b155-58d3-4a56-b8ad-e08621e92f06-konnectivity-ca\") pod \"konnectivity-agent-6wpfq\" (UID: \"9839b155-58d3-4a56-b8ad-e08621e92f06\") " pod="kube-system/konnectivity-agent-6wpfq"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-node-log\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563304    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77322166-d6bf-43cd-99c6-97e11467f96b-ovnkube-script-lib\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.563330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-socket-dir\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563368    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-var-lib-cni-multus\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-etc-openvswitch\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563451    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77322166-d6bf-43cd-99c6-97e11467f96b-ovnkube-config\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-run-netns\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b45d4297-516d-4031-8116-7a7ca788ad9a-tmp-dir\") pod \"node-resolver-9cbc9\" (UID: \"b45d4297-516d-4031-8116-7a7ca788ad9a\") " pod="openshift-dns/node-resolver-9cbc9"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-hostroot\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-run-multus-certs\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563630    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563663    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-sys-fs\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563701    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53bff21c-7fde-4bbe-b6d6-4777c8dd60a4-host-slash\") pod \"iptables-alerter-5gbdg\" (UID: \"53bff21c-7fde-4bbe-b6d6-4777c8dd60a4\") " pod="openshift-network-operator/iptables-alerter-5gbdg"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-log-socket\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563768    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563802    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-registration-dir\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563833    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-system-cni-dir\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6dtl\" (UniqueName: \"kubernetes.io/projected/fcd228a3-a91c-4ea7-b631-e2585afd54bc-kube-api-access-w6dtl\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.564184 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-slash\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77322166-d6bf-43cd-99c6-97e11467f96b-ovn-node-metrics-cert\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563957    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2c14c85f-51c6-41d3-8edd-a3a27ec01497-dbus\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.563988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-multus-cni-dir\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-etc-kubernetes\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564045    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-run-netns\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-run-systemd\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564107    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-cni-bin\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77322166-d6bf-43cd-99c6-97e11467f96b-env-overrides\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-var-lib-kubelet\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564194    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcd228a3-a91c-4ea7-b631-e2585afd54bc-multus-daemon-config\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-run-ovn\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564257    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b45d4297-516d-4031-8116-7a7ca788ad9a-hosts-file\") pod \"node-resolver-9cbc9\" (UID: \"b45d4297-516d-4031-8116-7a7ca788ad9a\") " pod="openshift-dns/node-resolver-9cbc9"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttwvp\" (UniqueName: \"kubernetes.io/projected/b45d4297-516d-4031-8116-7a7ca788ad9a-kube-api-access-ttwvp\") pod \"node-resolver-9cbc9\" (UID: \"b45d4297-516d-4031-8116-7a7ca788ad9a\") " pod="openshift-dns/node-resolver-9cbc9"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564315    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6zjx\" (UniqueName: \"kubernetes.io/projected/53bff21c-7fde-4bbe-b6d6-4777c8dd60a4-kube-api-access-m6zjx\") pod \"iptables-alerter-5gbdg\" (UID: \"53bff21c-7fde-4bbe-b6d6-4777c8dd60a4\") " pod="openshift-network-operator/iptables-alerter-5gbdg"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-multus-socket-dir-parent\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rfhx\" (UniqueName: \"kubernetes.io/projected/8466af26-10ce-4dc3-a326-d798025b8220-kube-api-access-6rfhx\") pod \"network-metrics-daemon-d4br4\" (UID: \"8466af26-10ce-4dc3-a326-d798025b8220\") " pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:21.565009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.564416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-systemd-units\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.566047 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.566023    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 02:49:21.566124 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.566096    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 02:49:21.566200 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.566174    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hk2hr\""
Sep 10 02:49:21.572626 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.572573    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 02:49:21.597567 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.597540    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5c65h"
Sep 10 02:49:21.606574 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.606554    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5c65h"
Sep 10 02:49:21.652488 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.652453    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 02:49:21.665258 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665226    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.665258 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-sys-fs\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.665494 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53bff21c-7fde-4bbe-b6d6-4777c8dd60a4-host-slash\") pod \"iptables-alerter-5gbdg\" (UID: \"53bff21c-7fde-4bbe-b6d6-4777c8dd60a4\") " pod="openshift-network-operator/iptables-alerter-5gbdg"
Sep 10 02:49:21.665494 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-log-socket\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.665494 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.665494 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-registration-dir\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.665494 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665369    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-system-cni-dir\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.665494 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665391    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6dtl\" (UniqueName: \"kubernetes.io/projected/fcd228a3-a91c-4ea7-b631-e2585afd54bc-kube-api-access-w6dtl\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.665494 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-slash\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.665494 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77322166-d6bf-43cd-99c6-97e11467f96b-ovn-node-metrics-cert\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.665494 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2c14c85f-51c6-41d3-8edd-a3a27ec01497-dbus\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:21.665494 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665474    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-multus-cni-dir\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665497    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-etc-kubernetes\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665520    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-run-netns\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-run-systemd\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665565    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-cni-bin\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfnjw\" (UniqueName: \"kubernetes.io/projected/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-kube-api-access-wfnjw\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77322166-d6bf-43cd-99c6-97e11467f96b-env-overrides\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665667    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-var-lib-kubelet\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665691    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcd228a3-a91c-4ea7-b631-e2585afd54bc-multus-daemon-config\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-run-ovn\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b45d4297-516d-4031-8116-7a7ca788ad9a-hosts-file\") pod \"node-resolver-9cbc9\" (UID: \"b45d4297-516d-4031-8116-7a7ca788ad9a\") " pod="openshift-dns/node-resolver-9cbc9"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665772    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-sysconfig\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-sys\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-lib-modules\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665842    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttwvp\" (UniqueName: \"kubernetes.io/projected/b45d4297-516d-4031-8116-7a7ca788ad9a-kube-api-access-ttwvp\") pod \"node-resolver-9cbc9\" (UID: \"b45d4297-516d-4031-8116-7a7ca788ad9a\") " pod="openshift-dns/node-resolver-9cbc9"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665867    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-kubernetes\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6pf4\" (UniqueName: \"kubernetes.io/projected/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-kube-api-access-m6pf4\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.666023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665941    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6zjx\" (UniqueName: \"kubernetes.io/projected/53bff21c-7fde-4bbe-b6d6-4777c8dd60a4-kube-api-access-m6zjx\") pod \"iptables-alerter-5gbdg\" (UID: \"53bff21c-7fde-4bbe-b6d6-4777c8dd60a4\") " pod="openshift-network-operator/iptables-alerter-5gbdg"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.665976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-multus-socket-dir-parent\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666001    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rfhx\" (UniqueName: \"kubernetes.io/projected/8466af26-10ce-4dc3-a326-d798025b8220-kube-api-access-6rfhx\") pod \"network-metrics-daemon-d4br4\" (UID: \"8466af26-10ce-4dc3-a326-d798025b8220\") " pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-systemd-units\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-cnibin\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-modprobe-d\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53bff21c-7fde-4bbe-b6d6-4777c8dd60a4-iptables-alerter-script\") pod \"iptables-alerter-5gbdg\" (UID: \"53bff21c-7fde-4bbe-b6d6-4777c8dd60a4\") " pod="openshift-network-operator/iptables-alerter-5gbdg"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs\") pod \"network-metrics-daemon-d4br4\" (UID: \"8466af26-10ce-4dc3-a326-d798025b8220\") " pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666203    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-cni-netd\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666227    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qfmc\" (UniqueName: \"kubernetes.io/projected/77322166-d6bf-43cd-99c6-97e11467f96b-kube-api-access-6qfmc\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/310b155e-c685-4b20-92c9-a640ee2a4797-serviceca\") pod \"node-ca-gzsdt\" (UID: \"310b155e-c685-4b20-92c9-a640ee2a4797\") " pod="openshift-image-registry/node-ca-gzsdt"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-run\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-multus-conf-dir\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcd228a3-a91c-4ea7-b631-e2585afd54bc-cni-binary-copy\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.666831 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666388    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-var-lib-kubelet\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m54pg\" (UniqueName: \"kubernetes.io/projected/726b6ce9-abfb-4028-8195-2cbc7f36729b-kube-api-access-m54pg\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666464    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-cnibin\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-var-lib-cni-bin\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-var-lib-openvswitch\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-run-openvswitch\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666593    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-run-k8s-cni-cncf-io\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-system-cni-dir\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666661    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-host\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-tmp\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666743    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2c14c85f-51c6-41d3-8edd-a3a27ec01497-kubelet-config\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9839b155-58d3-4a56-b8ad-e08621e92f06-agent-certs\") pod \"konnectivity-agent-6wpfq\" (UID: \"9839b155-58d3-4a56-b8ad-e08621e92f06\") " pod="kube-system/konnectivity-agent-6wpfq"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-kubelet\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666819    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/310b155e-c685-4b20-92c9-a640ee2a4797-host\") pod \"node-ca-gzsdt\" (UID: \"310b155e-c685-4b20-92c9-a640ee2a4797\") " pod="openshift-image-registry/node-ca-gzsdt"
Sep 10 02:49:21.667599 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666842    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-sysctl-d\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666867    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-sysctl-conf\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666898    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-device-dir\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9839b155-58d3-4a56-b8ad-e08621e92f06-konnectivity-ca\") pod \"konnectivity-agent-6wpfq\" (UID: \"9839b155-58d3-4a56-b8ad-e08621e92f06\") " pod="kube-system/konnectivity-agent-6wpfq"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-node-log\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.666981    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77322166-d6bf-43cd-99c6-97e11467f96b-ovnkube-script-lib\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-systemd\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667038    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-tuned\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667066    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-socket-dir\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-var-lib-cni-multus\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-etc-openvswitch\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667175    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77322166-d6bf-43cd-99c6-97e11467f96b-ovnkube-config\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667203    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-run-netns\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b45d4297-516d-4031-8116-7a7ca788ad9a-tmp-dir\") pod \"node-resolver-9cbc9\" (UID: \"b45d4297-516d-4031-8116-7a7ca788ad9a\") " pod="openshift-dns/node-resolver-9cbc9"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq2bw\" (UniqueName: \"kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw\") pod \"network-check-target-9q5w2\" (UID: \"fb961f15-ef6d-43ec-ae98-ffad727af967\") " pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-hostroot\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.668417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-run-multus-certs\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjjtn\" (UniqueName: \"kubernetes.io/projected/310b155e-c685-4b20-92c9-a640ee2a4797-kube-api-access-hjjtn\") pod \"node-ca-gzsdt\" (UID: \"310b155e-c685-4b20-92c9-a640ee2a4797\") " pod="openshift-image-registry/node-ca-gzsdt"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667635    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-sys-fs\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667677    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53bff21c-7fde-4bbe-b6d6-4777c8dd60a4-host-slash\") pod \"iptables-alerter-5gbdg\" (UID: \"53bff21c-7fde-4bbe-b6d6-4777c8dd60a4\") " pod="openshift-network-operator/iptables-alerter-5gbdg"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667713    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-log-socket\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667749    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667797    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-registration-dir\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.667845    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-system-cni-dir\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.668152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-slash\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.668523    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.668854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2c14c85f-51c6-41d3-8edd-a3a27ec01497-dbus\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.668920    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-multus-cni-dir\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.668951    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-etc-kubernetes\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.668980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-run-netns\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669009    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-run-systemd\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.669123 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-cni-bin\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669208    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcd228a3-a91c-4ea7-b631-e2585afd54bc-cni-binary-copy\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669443    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77322166-d6bf-43cd-99c6-97e11467f96b-env-overrides\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669550    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-var-lib-cni-bin\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:21.669566    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-cni-netd\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-node-log\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669688    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-device-dir\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669701    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669742    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-var-lib-kubelet\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669780    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-cnibin\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669807    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-kubelet\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669901    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-systemd-units\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669904    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2c14c85f-51c6-41d3-8edd-a3a27ec01497-kubelet-config\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669900    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-multus-conf-dir\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.669634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-run-openvswitch\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:21.669993    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670025    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9839b155-58d3-4a56-b8ad-e08621e92f06-konnectivity-ca\") pod \"konnectivity-agent-6wpfq\" (UID: \"9839b155-58d3-4a56-b8ad-e08621e92f06\") " pod="kube-system/konnectivity-agent-6wpfq"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-hostroot\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.671437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670104    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-run-ovn\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670125    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-run-k8s-cni-cncf-io\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670153    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b45d4297-516d-4031-8116-7a7ca788ad9a-hosts-file\") pod \"node-resolver-9cbc9\" (UID: \"b45d4297-516d-4031-8116-7a7ca788ad9a\") " pod="openshift-dns/node-resolver-9cbc9"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670213    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53bff21c-7fde-4bbe-b6d6-4777c8dd60a4-iptables-alerter-script\") pod \"iptables-alerter-5gbdg\" (UID: \"53bff21c-7fde-4bbe-b6d6-4777c8dd60a4\") " pod="openshift-network-operator/iptables-alerter-5gbdg"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670222    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/726b6ce9-abfb-4028-8195-2cbc7f36729b-socket-dir\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670258    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-var-lib-cni-multus\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:21.670303    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs podName:8466af26-10ce-4dc3-a326-d798025b8220 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:22.170283237 +0000 UTC m=+2.957948554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs") pod "network-metrics-daemon-d4br4" (UID: "8466af26-10ce-4dc3-a326-d798025b8220") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670304    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-multus-socket-dir-parent\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670431    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcd228a3-a91c-4ea7-b631-e2585afd54bc-multus-daemon-config\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670446    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-run-netns\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670482    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:21.670533    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret podName:2c14c85f-51c6-41d3-8edd-a3a27ec01497 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:22.170514467 +0000 UTC m=+2.958179820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret") pod "global-pull-secret-syncer-r6sxm" (UID: "2c14c85f-51c6-41d3-8edd-a3a27ec01497") : object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-etc-openvswitch\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670590    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcd228a3-a91c-4ea7-b631-e2585afd54bc-host-run-multus-certs\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670641    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77322166-d6bf-43cd-99c6-97e11467f96b-var-lib-openvswitch\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b45d4297-516d-4031-8116-7a7ca788ad9a-tmp-dir\") pod \"node-resolver-9cbc9\" (UID: \"b45d4297-516d-4031-8116-7a7ca788ad9a\") " pod="openshift-dns/node-resolver-9cbc9"
Sep 10 02:49:21.672331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670821    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77322166-d6bf-43cd-99c6-97e11467f96b-ovnkube-script-lib\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.673109 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.670964    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77322166-d6bf-43cd-99c6-97e11467f96b-ovnkube-config\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.676677 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.676622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77322166-d6bf-43cd-99c6-97e11467f96b-ovn-node-metrics-cert\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.677048 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.677022    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6dtl\" (UniqueName: \"kubernetes.io/projected/fcd228a3-a91c-4ea7-b631-e2585afd54bc-kube-api-access-w6dtl\") pod \"multus-dxf6b\" (UID: \"fcd228a3-a91c-4ea7-b631-e2585afd54bc\") " pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.678451 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.678429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rfhx\" (UniqueName: \"kubernetes.io/projected/8466af26-10ce-4dc3-a326-d798025b8220-kube-api-access-6rfhx\") pod \"network-metrics-daemon-d4br4\" (UID: \"8466af26-10ce-4dc3-a326-d798025b8220\") " pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:21.681469 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.681447    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m54pg\" (UniqueName: \"kubernetes.io/projected/726b6ce9-abfb-4028-8195-2cbc7f36729b-kube-api-access-m54pg\") pod \"aws-ebs-csi-driver-node-mbgpd\" (UID: \"726b6ce9-abfb-4028-8195-2cbc7f36729b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.683669 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.683644    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9839b155-58d3-4a56-b8ad-e08621e92f06-agent-certs\") pod \"konnectivity-agent-6wpfq\" (UID: \"9839b155-58d3-4a56-b8ad-e08621e92f06\") " pod="kube-system/konnectivity-agent-6wpfq"
Sep 10 02:49:21.686725 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.686682    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6zjx\" (UniqueName: \"kubernetes.io/projected/53bff21c-7fde-4bbe-b6d6-4777c8dd60a4-kube-api-access-m6zjx\") pod \"iptables-alerter-5gbdg\" (UID: \"53bff21c-7fde-4bbe-b6d6-4777c8dd60a4\") " pod="openshift-network-operator/iptables-alerter-5gbdg"
Sep 10 02:49:21.688806 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.688782    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttwvp\" (UniqueName: \"kubernetes.io/projected/b45d4297-516d-4031-8116-7a7ca788ad9a-kube-api-access-ttwvp\") pod \"node-resolver-9cbc9\" (UID: \"b45d4297-516d-4031-8116-7a7ca788ad9a\") " pod="openshift-dns/node-resolver-9cbc9"
Sep 10 02:49:21.689394 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.689349    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qfmc\" (UniqueName: \"kubernetes.io/projected/77322166-d6bf-43cd-99c6-97e11467f96b-kube-api-access-6qfmc\") pod \"ovnkube-node-n4kmx\" (UID: \"77322166-d6bf-43cd-99c6-97e11467f96b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.729938 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.729879    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal" event={"ID":"59db3c7f4073b3c025f3d43bbb653f6b","Type":"ContainerStarted","Data":"ce975c9e3d9cc1fcfd3b1a9096ec4c997242ec5711a2912a06d349fce33a312f"}
Sep 10 02:49:21.731132 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.731106    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-198.ec2.internal" event={"ID":"a4f320e49a706ec4bdf8b6ebf3e895a6","Type":"ContainerStarted","Data":"106b0ded5f92a989d9aad2c7af724ff0596896156a628886382d818616269162"}
Sep 10 02:49:21.767707 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.767671    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-system-cni-dir\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.767884 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.767717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-host\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.767884 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.767744    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-tmp\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.767884 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.767770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/310b155e-c685-4b20-92c9-a640ee2a4797-host\") pod \"node-ca-gzsdt\" (UID: \"310b155e-c685-4b20-92c9-a640ee2a4797\") " pod="openshift-image-registry/node-ca-gzsdt"
Sep 10 02:49:21.767884 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.767793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-sysctl-d\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.767884 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.767795    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-system-cni-dir\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.767884 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.767817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-sysctl-conf\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.767884 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.767844    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-systemd\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.767884 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.767867    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-tuned\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.768211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.767896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.768211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.767923    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq2bw\" (UniqueName: \"kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw\") pod \"network-check-target-9q5w2\" (UID: \"fb961f15-ef6d-43ec-ae98-ffad727af967\") " pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:21.768211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.767949    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjjtn\" (UniqueName: \"kubernetes.io/projected/310b155e-c685-4b20-92c9-a640ee2a4797-kube-api-access-hjjtn\") pod \"node-ca-gzsdt\" (UID: \"310b155e-c685-4b20-92c9-a640ee2a4797\") " pod="openshift-image-registry/node-ca-gzsdt"
Sep 10 02:49:21.768211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.767986    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfnjw\" (UniqueName: \"kubernetes.io/projected/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-kube-api-access-wfnjw\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.768211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768014    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-sysconfig\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.768211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-sys\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.768211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768057    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-lib-modules\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.768211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-kubernetes\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.768211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768131    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6pf4\" (UniqueName: \"kubernetes.io/projected/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-kube-api-access-m6pf4\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.768211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-cnibin\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.768211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.768211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768212    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-modprobe-d\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.768705 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/310b155e-c685-4b20-92c9-a640ee2a4797-serviceca\") pod \"node-ca-gzsdt\" (UID: \"310b155e-c685-4b20-92c9-a640ee2a4797\") " pod="openshift-image-registry/node-ca-gzsdt"
Sep 10 02:49:21.768705 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768272    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-run\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.768705 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.768705 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.768705 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768325    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-var-lib-kubelet\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.768705 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-var-lib-kubelet\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.768705 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768447    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-sysconfig\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.768705 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768498    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-sys\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.768705 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/310b155e-c685-4b20-92c9-a640ee2a4797-host\") pod \"node-ca-gzsdt\" (UID: \"310b155e-c685-4b20-92c9-a640ee2a4797\") " pod="openshift-image-registry/node-ca-gzsdt"
Sep 10 02:49:21.768705 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768554    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-kubernetes\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.768705 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768657    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-lib-modules\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.769156 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-sysctl-d\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.769156 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-cnibin\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.769156 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768869    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-sysctl-conf\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.769156 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-systemd\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.769156 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.768252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-host\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.769401 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.769184    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-run\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.769401 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.769293    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-modprobe-d\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.769506 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.769457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.769696 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.769673    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/310b155e-c685-4b20-92c9-a640ee2a4797-serviceca\") pod \"node-ca-gzsdt\" (UID: \"310b155e-c685-4b20-92c9-a640ee2a4797\") " pod="openshift-image-registry/node-ca-gzsdt"
Sep 10 02:49:21.769860 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.769839    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.770171 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.770153    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.770292 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.770250    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.771085 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.771063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-tmp\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.772675 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.772657    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-etc-tuned\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.783126 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:21.783072    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 02:49:21.783126 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:21.783102    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 02:49:21.783126 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:21.783117    2564 projected.go:196] Error preparing data for projected volume kube-api-access-vq2bw for pod openshift-network-diagnostics/network-check-target-9q5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:21.783278 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:21.783191    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw podName:fb961f15-ef6d-43ec-ae98-ffad727af967 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:22.283173727 +0000 UTC m=+3.070839037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vq2bw" (UniqueName: "kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw") pod "network-check-target-9q5w2" (UID: "fb961f15-ef6d-43ec-ae98-ffad727af967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:21.785155 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.785134    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfnjw\" (UniqueName: \"kubernetes.io/projected/a60a33d2-a6e3-49e9-bc7f-1f8df297e823-kube-api-access-wfnjw\") pod \"multus-additional-cni-plugins-fkf8z\" (UID: \"a60a33d2-a6e3-49e9-bc7f-1f8df297e823\") " pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.788293 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.788275    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6pf4\" (UniqueName: \"kubernetes.io/projected/d7fd89ad-474b-4ce9-999f-e1bb548cbfcc-kube-api-access-m6pf4\") pod \"tuned-rrfth\" (UID: \"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc\") " pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:21.788372 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.788293    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjjtn\" (UniqueName: \"kubernetes.io/projected/310b155e-c685-4b20-92c9-a640ee2a4797-kube-api-access-hjjtn\") pod \"node-ca-gzsdt\" (UID: \"310b155e-c685-4b20-92c9-a640ee2a4797\") " pod="openshift-image-registry/node-ca-gzsdt"
Sep 10 02:49:21.856690 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.856652    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxf6b"
Sep 10 02:49:21.867006 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.866978    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd"
Sep 10 02:49:21.879260 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.879232    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5gbdg"
Sep 10 02:49:21.883826 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.883795    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:21.892262 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.892229    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9cbc9"
Sep 10 02:49:21.898742 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.898721    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6wpfq"
Sep 10 02:49:21.905248 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.905228    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gzsdt"
Sep 10 02:49:21.917694 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.917674    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fkf8z"
Sep 10 02:49:21.923266 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:21.923248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rrfth"
Sep 10 02:49:22.023154 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.023119    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 02:49:22.171736 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.171698    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:22.171911 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.171746    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs\") pod \"network-metrics-daemon-d4br4\" (UID: \"8466af26-10ce-4dc3-a326-d798025b8220\") " pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:22.171911 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:22.171870    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:22.172008 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:22.171934    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret podName:2c14c85f-51c6-41d3-8edd-a3a27ec01497 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:23.171913257 +0000 UTC m=+3.959578554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret") pod "global-pull-secret-syncer-r6sxm" (UID: "2c14c85f-51c6-41d3-8edd-a3a27ec01497") : object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:22.172008 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:22.171871    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:22.172008 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:22.171995    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs podName:8466af26-10ce-4dc3-a326-d798025b8220 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:23.171983549 +0000 UTC m=+3.959648844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs") pod "network-metrics-daemon-d4br4" (UID: "8466af26-10ce-4dc3-a326-d798025b8220") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:22.372839 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.372800    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq2bw\" (UniqueName: \"kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw\") pod \"network-check-target-9q5w2\" (UID: \"fb961f15-ef6d-43ec-ae98-ffad727af967\") " pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:22.379864 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:22.379834    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 02:49:22.379989 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:22.379884    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 02:49:22.379989 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:22.379899    2564 projected.go:196] Error preparing data for projected volume kube-api-access-vq2bw for pod openshift-network-diagnostics/network-check-target-9q5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:22.379989 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:22.379968    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw podName:fb961f15-ef6d-43ec-ae98-ffad727af967 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:23.379951221 +0000 UTC m=+4.167616531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq2bw" (UniqueName: "kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw") pod "network-check-target-9q5w2" (UID: "fb961f15-ef6d-43ec-ae98-ffad727af967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:22.609513 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.609417    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 02:44:21 +0000 UTC" deadline="2028-05-11 08:39:13.554180744 +0000 UTC"
Sep 10 02:49:22.609513 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.609466    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14621h49m50.94472015s"
Sep 10 02:49:22.661029 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:22.660991    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45d4297_516d_4031_8116_7a7ca788ad9a.slice/crio-481631f969e706dea00a1c58804d6a779c7acf500e8e45327d2f470ef3affcf8 WatchSource:0}: Error finding container 481631f969e706dea00a1c58804d6a779c7acf500e8e45327d2f470ef3affcf8: Status 404 returned error can't find the container with id 481631f969e706dea00a1c58804d6a779c7acf500e8e45327d2f470ef3affcf8
Sep 10 02:49:22.666285 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:22.666257    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9839b155_58d3_4a56_b8ad_e08621e92f06.slice/crio-6883838f2141cfad21cfe595034a49cfdd46003dbfd43cea5b949df5c9b42fcc WatchSource:0}: Error finding container 6883838f2141cfad21cfe595034a49cfdd46003dbfd43cea5b949df5c9b42fcc: Status 404 returned error can't find the container with id 6883838f2141cfad21cfe595034a49cfdd46003dbfd43cea5b949df5c9b42fcc
Sep 10 02:49:22.666735 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:22.666675    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd228a3_a91c_4ea7_b631_e2585afd54bc.slice/crio-027d2d5dbb17f110d918daf4d2d5ad9b16e4211c4a93c0e3b1e32bd7c6e7adec WatchSource:0}: Error finding container 027d2d5dbb17f110d918daf4d2d5ad9b16e4211c4a93c0e3b1e32bd7c6e7adec: Status 404 returned error can't find the container with id 027d2d5dbb17f110d918daf4d2d5ad9b16e4211c4a93c0e3b1e32bd7c6e7adec
Sep 10 02:49:22.667513 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:22.667492    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77322166_d6bf_43cd_99c6_97e11467f96b.slice/crio-216b3f1502f579397a1bd21dd83617530a6eca5d4e912c135b6dafd2ffe835ca WatchSource:0}: Error finding container 216b3f1502f579397a1bd21dd83617530a6eca5d4e912c135b6dafd2ffe835ca: Status 404 returned error can't find the container with id 216b3f1502f579397a1bd21dd83617530a6eca5d4e912c135b6dafd2ffe835ca
Sep 10 02:49:22.671983 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:22.671878    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53bff21c_7fde_4bbe_b6d6_4777c8dd60a4.slice/crio-20f034f9c61a7b4229967b1a48763a4cd723ce1a7c1bb37e42626a62736d5703 WatchSource:0}: Error finding container 20f034f9c61a7b4229967b1a48763a4cd723ce1a7c1bb37e42626a62736d5703: Status 404 returned error can't find the container with id 20f034f9c61a7b4229967b1a48763a4cd723ce1a7c1bb37e42626a62736d5703
Sep 10 02:49:22.674089 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:22.674072    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7fd89ad_474b_4ce9_999f_e1bb548cbfcc.slice/crio-579366041b6797af4587609bbf1c88c291049f3f54e226ad90c0b1584e36b87f WatchSource:0}: Error finding container 579366041b6797af4587609bbf1c88c291049f3f54e226ad90c0b1584e36b87f: Status 404 returned error can't find the container with id 579366041b6797af4587609bbf1c88c291049f3f54e226ad90c0b1584e36b87f
Sep 10 02:49:22.675485 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:22.675466    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60a33d2_a6e3_49e9_bc7f_1f8df297e823.slice/crio-b98b3d862d735deeee605da453a88d88ead38dbcbda245b5f5ece420ddd599a7 WatchSource:0}: Error finding container b98b3d862d735deeee605da453a88d88ead38dbcbda245b5f5ece420ddd599a7: Status 404 returned error can't find the container with id b98b3d862d735deeee605da453a88d88ead38dbcbda245b5f5ece420ddd599a7
Sep 10 02:49:22.677510 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:22.677489    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310b155e_c685_4b20_92c9_a640ee2a4797.slice/crio-2c7928335fda5598bb778d59aa5554a92faff44f2ef79283c9cbb2eeac54f714 WatchSource:0}: Error finding container 2c7928335fda5598bb778d59aa5554a92faff44f2ef79283c9cbb2eeac54f714: Status 404 returned error can't find the container with id 2c7928335fda5598bb778d59aa5554a92faff44f2ef79283c9cbb2eeac54f714
Sep 10 02:49:22.720681 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.720655    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:22.720681 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.720673    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:22.720856 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:22.720791    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:22.720918 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:22.720884    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:22.733541 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.733513    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9cbc9" event={"ID":"b45d4297-516d-4031-8116-7a7ca788ad9a","Type":"ContainerStarted","Data":"481631f969e706dea00a1c58804d6a779c7acf500e8e45327d2f470ef3affcf8"}
Sep 10 02:49:22.735190 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.735155    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gzsdt" event={"ID":"310b155e-c685-4b20-92c9-a640ee2a4797","Type":"ContainerStarted","Data":"2c7928335fda5598bb778d59aa5554a92faff44f2ef79283c9cbb2eeac54f714"}
Sep 10 02:49:22.736542 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.736523    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkf8z" event={"ID":"a60a33d2-a6e3-49e9-bc7f-1f8df297e823","Type":"ContainerStarted","Data":"b98b3d862d735deeee605da453a88d88ead38dbcbda245b5f5ece420ddd599a7"}
Sep 10 02:49:22.737560 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.737542    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd" event={"ID":"726b6ce9-abfb-4028-8195-2cbc7f36729b","Type":"ContainerStarted","Data":"c15760e80e347015f5470079f6ba8202f9691a8b978fc13c979b2a59ef9dbe3a"}
Sep 10 02:49:22.738754 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.738736    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx" event={"ID":"77322166-d6bf-43cd-99c6-97e11467f96b","Type":"ContainerStarted","Data":"216b3f1502f579397a1bd21dd83617530a6eca5d4e912c135b6dafd2ffe835ca"}
Sep 10 02:49:22.739889 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.739866    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxf6b" event={"ID":"fcd228a3-a91c-4ea7-b631-e2585afd54bc","Type":"ContainerStarted","Data":"027d2d5dbb17f110d918daf4d2d5ad9b16e4211c4a93c0e3b1e32bd7c6e7adec"}
Sep 10 02:49:22.740992 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.740968    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6wpfq" event={"ID":"9839b155-58d3-4a56-b8ad-e08621e92f06","Type":"ContainerStarted","Data":"6883838f2141cfad21cfe595034a49cfdd46003dbfd43cea5b949df5c9b42fcc"}
Sep 10 02:49:22.742124 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.742103    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rrfth" event={"ID":"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc","Type":"ContainerStarted","Data":"579366041b6797af4587609bbf1c88c291049f3f54e226ad90c0b1584e36b87f"}
Sep 10 02:49:22.743180 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:22.743157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5gbdg" event={"ID":"53bff21c-7fde-4bbe-b6d6-4777c8dd60a4","Type":"ContainerStarted","Data":"20f034f9c61a7b4229967b1a48763a4cd723ce1a7c1bb37e42626a62736d5703"}
Sep 10 02:49:23.180230 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:23.179028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:23.180230 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:23.179081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs\") pod \"network-metrics-daemon-d4br4\" (UID: \"8466af26-10ce-4dc3-a326-d798025b8220\") " pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:23.180230 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:23.179206    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:23.180230 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:23.179267    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs podName:8466af26-10ce-4dc3-a326-d798025b8220 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:25.179247809 +0000 UTC m=+5.966913109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs") pod "network-metrics-daemon-d4br4" (UID: "8466af26-10ce-4dc3-a326-d798025b8220") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:23.180230 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:23.179683    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:23.180230 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:23.179733    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret podName:2c14c85f-51c6-41d3-8edd-a3a27ec01497 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:25.179718953 +0000 UTC m=+5.967384253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret") pod "global-pull-secret-syncer-r6sxm" (UID: "2c14c85f-51c6-41d3-8edd-a3a27ec01497") : object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:23.380956 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:23.380916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq2bw\" (UniqueName: \"kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw\") pod \"network-check-target-9q5w2\" (UID: \"fb961f15-ef6d-43ec-ae98-ffad727af967\") " pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:23.381153 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:23.381076    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 02:49:23.381153 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:23.381094    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 02:49:23.381153 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:23.381108    2564 projected.go:196] Error preparing data for projected volume kube-api-access-vq2bw for pod openshift-network-diagnostics/network-check-target-9q5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:23.381312 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:23.381174    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw podName:fb961f15-ef6d-43ec-ae98-ffad727af967 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:25.381156163 +0000 UTC m=+6.168821460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq2bw" (UniqueName: "kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw") pod "network-check-target-9q5w2" (UID: "fb961f15-ef6d-43ec-ae98-ffad727af967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:23.610543 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:23.610243    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 02:44:21 +0000 UTC" deadline="2028-03-14 22:31:54.264704137 +0000 UTC"
Sep 10 02:49:23.610543 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:23.610302    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13243h42m30.654406646s"
Sep 10 02:49:23.720755 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:23.720727    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:23.720931 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:23.720847    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:23.760344 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:23.759561    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-198.ec2.internal" event={"ID":"a4f320e49a706ec4bdf8b6ebf3e895a6","Type":"ContainerStarted","Data":"d439a0a99ea0c5956a9a033a20b1545afcafe70f57de82a3d2499c87adab68e1"}
Sep 10 02:49:23.778643 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:23.776242    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-198.ec2.internal" podStartSLOduration=3.7762213620000002 podStartE2EDuration="3.776221362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:23.775336542 +0000 UTC m=+4.563001887" watchObservedRunningTime="2026-09-10 02:49:23.776221362 +0000 UTC m=+4.563886679"
Sep 10 02:49:23.778643 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:23.776939    2564 generic.go:356] "Generic (PLEG): container finished" podID="59db3c7f4073b3c025f3d43bbb653f6b" containerID="7ba2d981961c80ff275ffdf88860939a75c70acfe1b55e5a464813510bdf3899" exitCode=0
Sep 10 02:49:23.778643 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:23.776976    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal" event={"ID":"59db3c7f4073b3c025f3d43bbb653f6b","Type":"ContainerDied","Data":"7ba2d981961c80ff275ffdf88860939a75c70acfe1b55e5a464813510bdf3899"}
Sep 10 02:49:24.721049 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:24.721013    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:24.721573 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:24.721165    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:24.721666 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:24.721570    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:24.721826 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:24.721782    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:24.794754 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:24.794681    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal" event={"ID":"59db3c7f4073b3c025f3d43bbb653f6b","Type":"ContainerStarted","Data":"be5f8123ae88c6cc05d21f14c2fdf86769044edcad2cb874d75eb1e4eaee487a"}
Sep 10 02:49:25.194568 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:25.194525    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:25.194780 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:25.194596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs\") pod \"network-metrics-daemon-d4br4\" (UID: \"8466af26-10ce-4dc3-a326-d798025b8220\") " pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:25.194780 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:25.194740    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:25.194905 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:25.194800    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs podName:8466af26-10ce-4dc3-a326-d798025b8220 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:29.194783371 +0000 UTC m=+9.982448671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs") pod "network-metrics-daemon-d4br4" (UID: "8466af26-10ce-4dc3-a326-d798025b8220") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:25.194905 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:25.194858    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:25.194905 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:25.194890    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret podName:2c14c85f-51c6-41d3-8edd-a3a27ec01497 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:29.194877891 +0000 UTC m=+9.982543191 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret") pod "global-pull-secret-syncer-r6sxm" (UID: "2c14c85f-51c6-41d3-8edd-a3a27ec01497") : object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:25.396456 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:25.396381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq2bw\" (UniqueName: \"kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw\") pod \"network-check-target-9q5w2\" (UID: \"fb961f15-ef6d-43ec-ae98-ffad727af967\") " pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:25.396761 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:25.396741    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 02:49:25.396847 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:25.396770    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 02:49:25.396847 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:25.396782    2564 projected.go:196] Error preparing data for projected volume kube-api-access-vq2bw for pod openshift-network-diagnostics/network-check-target-9q5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:25.396847 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:25.396841    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw podName:fb961f15-ef6d-43ec-ae98-ffad727af967 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:29.39682289 +0000 UTC m=+10.184488207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq2bw" (UniqueName: "kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw") pod "network-check-target-9q5w2" (UID: "fb961f15-ef6d-43ec-ae98-ffad727af967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:25.723833 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:25.723346    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:25.723833 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:25.723473    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:26.721158 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:26.721102    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:26.721345 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:26.721231    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:26.721695 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:26.721673    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:26.721802 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:26.721781    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:27.723154 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:27.723117    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:27.723588 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:27.723246    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:28.721585 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:28.721548    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:28.721797 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:28.721712    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:28.722234 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:28.722077    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:28.722234 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:28.722177    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:29.228798 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:29.228758    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:29.228798 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:29.228807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs\") pod \"network-metrics-daemon-d4br4\" (UID: \"8466af26-10ce-4dc3-a326-d798025b8220\") " pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:29.229253 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:29.228923    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:29.229253 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:29.228929    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:29.229253 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:29.228981    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs podName:8466af26-10ce-4dc3-a326-d798025b8220 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:37.228964959 +0000 UTC m=+18.016630277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs") pod "network-metrics-daemon-d4br4" (UID: "8466af26-10ce-4dc3-a326-d798025b8220") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:29.229253 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:29.228995    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret podName:2c14c85f-51c6-41d3-8edd-a3a27ec01497 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:37.228989189 +0000 UTC m=+18.016654484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret") pod "global-pull-secret-syncer-r6sxm" (UID: "2c14c85f-51c6-41d3-8edd-a3a27ec01497") : object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:29.431592 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:29.430967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq2bw\" (UniqueName: \"kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw\") pod \"network-check-target-9q5w2\" (UID: \"fb961f15-ef6d-43ec-ae98-ffad727af967\") " pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:29.431592 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:29.431142    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 02:49:29.431592 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:29.431162    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 02:49:29.431592 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:29.431175    2564 projected.go:196] Error preparing data for projected volume kube-api-access-vq2bw for pod openshift-network-diagnostics/network-check-target-9q5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:29.431592 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:29.431242    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw podName:fb961f15-ef6d-43ec-ae98-ffad727af967 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:37.431224871 +0000 UTC m=+18.218890168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq2bw" (UniqueName: "kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw") pod "network-check-target-9q5w2" (UID: "fb961f15-ef6d-43ec-ae98-ffad727af967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:29.721879 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:29.721846    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:29.722137 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:29.721965    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:30.721533 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:30.721503    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:30.721914 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:30.721681    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:30.721914 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:30.721737    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:30.721914 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:30.721796    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:31.722823 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:31.722787    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:31.723187 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:31.722912    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:32.721009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:32.720973    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:32.721201 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:32.720980    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:32.721201 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:32.721079    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:32.721340 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:32.721221    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:33.721546 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:33.721510    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:33.722037 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:33.721666    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:34.720803 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:34.720767    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:34.720982 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:34.720767    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:34.720982 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:34.720901    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:34.721084 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:34.720994    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:35.721724 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:35.721686    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:35.722167 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:35.721802    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:36.721362 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:36.721337    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:36.721569 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:36.721329    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:36.721569 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:36.721443    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:36.721569 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:36.721509    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:37.289674 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:37.289568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:37.289674 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:37.289636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs\") pod \"network-metrics-daemon-d4br4\" (UID: \"8466af26-10ce-4dc3-a326-d798025b8220\") " pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:37.290117 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:37.289732    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:37.290117 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:37.289810    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret podName:2c14c85f-51c6-41d3-8edd-a3a27ec01497 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:53.289789329 +0000 UTC m=+34.077454624 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret") pod "global-pull-secret-syncer-r6sxm" (UID: "2c14c85f-51c6-41d3-8edd-a3a27ec01497") : object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:37.290117 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:37.289737    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:37.290117 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:37.289894    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs podName:8466af26-10ce-4dc3-a326-d798025b8220 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:53.289872074 +0000 UTC m=+34.077537375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs") pod "network-metrics-daemon-d4br4" (UID: "8466af26-10ce-4dc3-a326-d798025b8220") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:37.490358 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:37.490312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq2bw\" (UniqueName: \"kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw\") pod \"network-check-target-9q5w2\" (UID: \"fb961f15-ef6d-43ec-ae98-ffad727af967\") " pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:37.490529 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:37.490508    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 02:49:37.490597 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:37.490539    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 02:49:37.490597 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:37.490555    2564 projected.go:196] Error preparing data for projected volume kube-api-access-vq2bw for pod openshift-network-diagnostics/network-check-target-9q5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:37.490749 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:37.490631    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw podName:fb961f15-ef6d-43ec-ae98-ffad727af967 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:53.490600401 +0000 UTC m=+34.278265695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq2bw" (UniqueName: "kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw") pod "network-check-target-9q5w2" (UID: "fb961f15-ef6d-43ec-ae98-ffad727af967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:37.721234 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:37.721197    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:37.721409 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:37.721324    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:38.721390 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:38.721341    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:38.721390 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:38.721385    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:38.721934 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:38.721482    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:38.721934 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:38.721623    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:39.721979 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:39.721943    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:39.722447 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:39.722056    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:40.722191 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:40.721720    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:40.722191 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:40.721841    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:40.722836 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:40.722679    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:40.722836 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:40.722793    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:40.825773 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:40.825744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gzsdt" event={"ID":"310b155e-c685-4b20-92c9-a640ee2a4797","Type":"ContainerStarted","Data":"9eeb03f05bdb1f96b3ca1d0fefd41c85bbaba2c461cb9d5bb8e0f4d59109f7d8"}
Sep 10 02:49:40.827157 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:40.827133    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6wpfq" event={"ID":"9839b155-58d3-4a56-b8ad-e08621e92f06","Type":"ContainerStarted","Data":"5b8bbab0df82d3c0de3581ddb4b7ea99fe39136b85df462b8fcc2fb3bef16e13"}
Sep 10 02:49:40.844967 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:40.844927    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gzsdt" podStartSLOduration=3.890286268 podStartE2EDuration="21.844912608s" totalImagesPullingTime="17.95462634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:40.844657286 +0000 UTC m=+21.632322602" watchObservedRunningTime="2026-09-10 02:49:40.844912608 +0000 UTC m=+21.632577924"
Sep 10 02:49:40.845048 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:40.844997    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-198.ec2.internal" podStartSLOduration=20.844992713 podStartE2EDuration="20.844992713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:24.815357212 +0000 UTC m=+5.603022542" watchObservedRunningTime="2026-09-10 02:49:40.844992713 +0000 UTC m=+21.632658031"
Sep 10 02:49:40.863502 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:40.863463    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6wpfq" podStartSLOduration=3.9716285559999998 podStartE2EDuration="21.863449273s" totalImagesPullingTime="17.891820717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:40.863176586 +0000 UTC m=+21.650841925" watchObservedRunningTime="2026-09-10 02:49:40.863449273 +0000 UTC m=+21.651114590"
Sep 10 02:49:41.722051 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.721733    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:41.722229 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:41.722158    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:41.830853 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.830820    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9cbc9" event={"ID":"b45d4297-516d-4031-8116-7a7ca788ad9a","Type":"ContainerStarted","Data":"d0e20dbb06a6fc5966892eacc5906cd6bea363eb8f9e805d17ff861272f7b992"}
Sep 10 02:49:41.832386 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.832357    2564 generic.go:356] "Generic (PLEG): container finished" podID="a60a33d2-a6e3-49e9-bc7f-1f8df297e823" containerID="0a226eb4f17696c5ea0906c691634e40f2385a17b759a4ba4ce1fd3f53127592" exitCode=0
Sep 10 02:49:41.832542 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.832448    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkf8z" event={"ID":"a60a33d2-a6e3-49e9-bc7f-1f8df297e823","Type":"ContainerDied","Data":"0a226eb4f17696c5ea0906c691634e40f2385a17b759a4ba4ce1fd3f53127592"}
Sep 10 02:49:41.836368 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.836332    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd" event={"ID":"726b6ce9-abfb-4028-8195-2cbc7f36729b","Type":"ContainerStarted","Data":"67d8701ef9ec616537fc187cd74f5e10b64d63907b12cc2ea1591d54e1977576"}
Sep 10 02:49:41.839214 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.839191    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx" event={"ID":"77322166-d6bf-43cd-99c6-97e11467f96b","Type":"ContainerStarted","Data":"7f25943bbbc96287e5d0d7512143f3807ebcbfdedbc0fa4a31c2409a672493c9"}
Sep 10 02:49:41.839316 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.839272    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx" event={"ID":"77322166-d6bf-43cd-99c6-97e11467f96b","Type":"ContainerStarted","Data":"37472d2ee74ebb86567ceed5c0f505d0cbbeda56e349584f890076f05a116a5c"}
Sep 10 02:49:41.839361 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.839324    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx" event={"ID":"77322166-d6bf-43cd-99c6-97e11467f96b","Type":"ContainerStarted","Data":"54b2e67d24c80b6eed514e7fd0d9f55f9fc28e7b0b41369f3d975e99468e529f"}
Sep 10 02:49:41.839404 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.839372    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx" event={"ID":"77322166-d6bf-43cd-99c6-97e11467f96b","Type":"ContainerStarted","Data":"97cc62609ca73341d3439e1eb16a332bb2aa2896a82c088998451185b8f90424"}
Sep 10 02:49:41.839444 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.839413    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx" event={"ID":"77322166-d6bf-43cd-99c6-97e11467f96b","Type":"ContainerStarted","Data":"18ac465a23ba87255ec02a0aabb2cfe317aa132f7967ad8665ffa1fea3bb5229"}
Sep 10 02:49:41.839490 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.839451    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx" event={"ID":"77322166-d6bf-43cd-99c6-97e11467f96b","Type":"ContainerStarted","Data":"9b614a4e39c8c9dc671ea7389ae1331e1c4af643bef23dc67255506aa8c636c0"}
Sep 10 02:49:41.840562 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.840545    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxf6b" event={"ID":"fcd228a3-a91c-4ea7-b631-e2585afd54bc","Type":"ContainerStarted","Data":"93ae209861fcff61a0522e54f54a640e54de6c62253f6df08f65c174f2213368"}
Sep 10 02:49:41.841890 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.841867    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rrfth" event={"ID":"d7fd89ad-474b-4ce9-999f-e1bb548cbfcc","Type":"ContainerStarted","Data":"c1dec704b5778644194d0ec71c0ae5057513fa3962dbe18cc447e98aa5819d5c"}
Sep 10 02:49:41.886024 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.885976    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9cbc9" podStartSLOduration=4.915689087 podStartE2EDuration="22.885959554s" totalImagesPullingTime="17.970270467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:41.853743243 +0000 UTC m=+22.641408559" watchObservedRunningTime="2026-09-10 02:49:41.885959554 +0000 UTC m=+22.673624871"
Sep 10 02:49:41.939777 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.939686    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rrfth" podStartSLOduration=4.979617218 podStartE2EDuration="22.939670372s" totalImagesPullingTime="17.960053154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:41.939302018 +0000 UTC m=+22.726967335" watchObservedRunningTime="2026-09-10 02:49:41.939670372 +0000 UTC m=+22.727335699"
Sep 10 02:49:41.940222 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:41.940191    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dxf6b" podStartSLOduration=4.950107065 podStartE2EDuration="22.940180894s" totalImagesPullingTime="17.990073829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:41.913688722 +0000 UTC m=+22.701354039" watchObservedRunningTime="2026-09-10 02:49:41.940180894 +0000 UTC m=+22.727846211"
Sep 10 02:49:42.296475 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:42.296452    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 02:49:42.628700 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:42.628551    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T02:49:42.296468593Z","UUID":"63b9ae4f-cf9c-4390-82d0-df0820bad264","Handler":null,"Name":"","Endpoint":""}
Sep 10 02:49:42.630169 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:42.630145    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 02:49:42.630309 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:42.630180    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 02:49:42.721204 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:42.721100    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:42.721377 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:42.721216    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:42.721377 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:42.721272    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:42.721469 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:42.721385    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:42.846462 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:42.846421    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd" event={"ID":"726b6ce9-abfb-4028-8195-2cbc7f36729b","Type":"ContainerStarted","Data":"78dd001af616f21b6dcbd8b15148c922bc6068a2e3386be82583e52fa4b70ab5"}
Sep 10 02:49:42.849482 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:42.849455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5gbdg" event={"ID":"53bff21c-7fde-4bbe-b6d6-4777c8dd60a4","Type":"ContainerStarted","Data":"8d04b5ca3d06fbef2c27913a5df2dfb598d1a9eec2b29f0ca437c0121b95ccfb"}
Sep 10 02:49:42.865652 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:42.865586    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5gbdg" podStartSLOduration=5.90036794 podStartE2EDuration="23.865572276s" totalImagesPullingTime="17.965204336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:42.865105297 +0000 UTC m=+23.652770615" watchObservedRunningTime="2026-09-10 02:49:42.865572276 +0000 UTC m=+23.653237628"
Sep 10 02:49:43.721270 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:43.721233    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:43.721574 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:43.721542    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:43.853149 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:43.853063    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd" event={"ID":"726b6ce9-abfb-4028-8195-2cbc7f36729b","Type":"ContainerStarted","Data":"5b925eff575a587ce2d99fb8b59139eaafca6f0ddd9795b4da24d5615f6ae2ae"}
Sep 10 02:49:43.856673 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:43.856643    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx" event={"ID":"77322166-d6bf-43cd-99c6-97e11467f96b","Type":"ContainerStarted","Data":"6517b9166d47cda07d6edcf017ba1e8d2b13fd9986d2b92b56e46ad1507fe057"}
Sep 10 02:49:43.874067 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:43.873983    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbgpd" podStartSLOduration=4.812555293 podStartE2EDuration="24.873965601s" totalImagesPullingTime="20.061410308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:43.873665948 +0000 UTC m=+24.661331265" watchObservedRunningTime="2026-09-10 02:49:43.873965601 +0000 UTC m=+24.661630924"
Sep 10 02:49:44.706296 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:44.706256    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6wpfq"
Sep 10 02:49:44.706994 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:44.706970    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6wpfq"
Sep 10 02:49:44.721335 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:44.721306    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:44.721492 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:44.721433    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:44.721492 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:44.721484    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:44.721648 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:44.721603    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:44.859659 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:44.859624    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6wpfq"
Sep 10 02:49:44.860496 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:44.860478    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6wpfq"
Sep 10 02:49:45.720989 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:45.720952    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:45.721173 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:45.721082    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:46.721028 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:46.720992    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:46.721028 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:46.721015    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:46.721731 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:46.721098    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:46.721731 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:46.721214    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:46.865772 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:46.865741    2564 generic.go:356] "Generic (PLEG): container finished" podID="a60a33d2-a6e3-49e9-bc7f-1f8df297e823" containerID="098ba893cfc6686b606e0e08f51b96a642af465fb5fb25f83bc7bb81118a1806" exitCode=0
Sep 10 02:49:46.865938 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:46.865825    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkf8z" event={"ID":"a60a33d2-a6e3-49e9-bc7f-1f8df297e823","Type":"ContainerDied","Data":"098ba893cfc6686b606e0e08f51b96a642af465fb5fb25f83bc7bb81118a1806"}
Sep 10 02:49:46.869629 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:46.869585    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx" event={"ID":"77322166-d6bf-43cd-99c6-97e11467f96b","Type":"ContainerStarted","Data":"0ac59e02f0505f76380c5a2bc297225ea6d0b428bb451a63b16db7f582ab1d86"}
Sep 10 02:49:46.916116 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:46.916070    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx" podStartSLOduration=9.655061466 podStartE2EDuration="27.916055606s" totalImagesPullingTime="18.26099414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:46.914575409 +0000 UTC m=+27.702240725" watchObservedRunningTime="2026-09-10 02:49:46.916055606 +0000 UTC m=+27.703720923"
Sep 10 02:49:47.721801 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:47.721629    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:47.722140 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:47.721880    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:47.874146 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:47.874111    2564 generic.go:356] "Generic (PLEG): container finished" podID="a60a33d2-a6e3-49e9-bc7f-1f8df297e823" containerID="cbf525af6a88003018305a4966fc285f85c2bd5f1debe7a7a783e5f0761fcb01" exitCode=0
Sep 10 02:49:47.874340 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:47.874185    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkf8z" event={"ID":"a60a33d2-a6e3-49e9-bc7f-1f8df297e823","Type":"ContainerDied","Data":"cbf525af6a88003018305a4966fc285f85c2bd5f1debe7a7a783e5f0761fcb01"}
Sep 10 02:49:47.874664 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:47.874641    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:47.874809 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:47.874700    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:47.874809 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:47.874743    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:47.892732 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:47.892707    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:47.892882 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:47.892831    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:49:48.046177 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:48.046144    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d4br4"]
Sep 10 02:49:48.046349 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:48.046284    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:48.046423 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:48.046402    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:48.046914 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:48.046895    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9q5w2"]
Sep 10 02:49:48.046991 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:48.046981    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:48.047071 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:48.047051    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:48.047928 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:48.047908    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r6sxm"]
Sep 10 02:49:48.048008 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:48.047982    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:48.048059 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:48.048042    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:48.879182 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:48.879100    2564 generic.go:356] "Generic (PLEG): container finished" podID="a60a33d2-a6e3-49e9-bc7f-1f8df297e823" containerID="d958e87b0208e5e58b63079fa9e6618d8813e7f3d4663a6c883ca1407586fc64" exitCode=0
Sep 10 02:49:48.879561 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:48.879189    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkf8z" event={"ID":"a60a33d2-a6e3-49e9-bc7f-1f8df297e823","Type":"ContainerDied","Data":"d958e87b0208e5e58b63079fa9e6618d8813e7f3d4663a6c883ca1407586fc64"}
Sep 10 02:49:49.722919 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:49.722887    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:49.727635 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:49.727514    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:49.731032 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:49.727929    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:49.731032 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:49.728090    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:49.731032 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:49.728165    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:49.731032 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:49.730900    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:51.724781 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:51.724749    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:51.725222 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:51.724749    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:51.725222 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:51.724875    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4br4" podUID="8466af26-10ce-4dc3-a326-d798025b8220"
Sep 10 02:49:51.725222 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:51.724749    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:51.725222 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:51.724950    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9q5w2" podUID="fb961f15-ef6d-43ec-ae98-ffad727af967"
Sep 10 02:49:51.725222 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:51.724996    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6sxm" podUID="2c14c85f-51c6-41d3-8edd-a3a27ec01497"
Sep 10 02:49:53.311157 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.311006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:53.311157 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:53.311148    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:53.311535 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.311188    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs\") pod \"network-metrics-daemon-d4br4\" (UID: \"8466af26-10ce-4dc3-a326-d798025b8220\") " pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:53.311535 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:53.311219    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret podName:2c14c85f-51c6-41d3-8edd-a3a27ec01497 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:25.311199194 +0000 UTC m=+66.098864509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret") pod "global-pull-secret-syncer-r6sxm" (UID: "2c14c85f-51c6-41d3-8edd-a3a27ec01497") : object "kube-system"/"original-pull-secret" not registered
Sep 10 02:49:53.311535 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:53.311275    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:53.311535 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:53.311318    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs podName:8466af26-10ce-4dc3-a326-d798025b8220 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:25.311305364 +0000 UTC m=+66.098970659 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs") pod "network-metrics-daemon-d4br4" (UID: "8466af26-10ce-4dc3-a326-d798025b8220") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 02:49:53.480873 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.480850    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-198.ec2.internal" event="NodeReady"
Sep 10 02:49:53.481004 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.480968    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 02:49:53.512853 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.512819    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq2bw\" (UniqueName: \"kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw\") pod \"network-check-target-9q5w2\" (UID: \"fb961f15-ef6d-43ec-ae98-ffad727af967\") " pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:53.513001 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:53.512984    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 02:49:53.513001 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:53.513000    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 02:49:53.513083 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:53.513011    2564 projected.go:196] Error preparing data for projected volume kube-api-access-vq2bw for pod openshift-network-diagnostics/network-check-target-9q5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:53.513083 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:53.513062    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw podName:fb961f15-ef6d-43ec-ae98-ffad727af967 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:25.513045934 +0000 UTC m=+66.300711231 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq2bw" (UniqueName: "kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw") pod "network-check-target-9q5w2" (UID: "fb961f15-ef6d-43ec-ae98-ffad727af967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 02:49:53.531942 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.531914    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vd7th"]
Sep 10 02:49:53.547451 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.547417    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gs9lm"]
Sep 10 02:49:53.547585 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.547535    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:53.550696 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.550665    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 02:49:53.551693 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.551674    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 02:49:53.551817 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.551726    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nh6lc\""
Sep 10 02:49:53.561365 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.561343    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vd7th"]
Sep 10 02:49:53.561478 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.561451    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gs9lm"
Sep 10 02:49:53.563204 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.563186    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gs9lm"]
Sep 10 02:49:53.568341 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.568291    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 02:49:53.568434 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.568355    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dfrfr\""
Sep 10 02:49:53.572390 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.572375    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 02:49:53.572505 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.572426    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 02:49:53.613192 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.613159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:53.613192 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.613188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8378614d-48a8-45e3-8e26-54b397b143b6-tmp-dir\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:53.613441 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.613214    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knfzx\" (UniqueName: \"kubernetes.io/projected/8378614d-48a8-45e3-8e26-54b397b143b6-kube-api-access-knfzx\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:53.613441 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.613289    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8378614d-48a8-45e3-8e26-54b397b143b6-config-volume\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:53.714544 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.714460    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djj46\" (UniqueName: \"kubernetes.io/projected/c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a-kube-api-access-djj46\") pod \"ingress-canary-gs9lm\" (UID: \"c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a\") " pod="openshift-ingress-canary/ingress-canary-gs9lm"
Sep 10 02:49:53.714544 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.714513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:53.714544 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.714529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8378614d-48a8-45e3-8e26-54b397b143b6-tmp-dir\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:53.714544 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.714543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knfzx\" (UniqueName: \"kubernetes.io/projected/8378614d-48a8-45e3-8e26-54b397b143b6-kube-api-access-knfzx\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:53.714880 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.714562    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a-cert\") pod \"ingress-canary-gs9lm\" (UID: \"c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a\") " pod="openshift-ingress-canary/ingress-canary-gs9lm"
Sep 10 02:49:53.714880 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.714585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8378614d-48a8-45e3-8e26-54b397b143b6-config-volume\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:53.714880 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:53.714664    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 02:49:53.714880 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:53.714773    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls podName:8378614d-48a8-45e3-8e26-54b397b143b6 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:54.214759143 +0000 UTC m=+35.002424438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls") pod "dns-default-vd7th" (UID: "8378614d-48a8-45e3-8e26-54b397b143b6") : secret "dns-default-metrics-tls" not found
Sep 10 02:49:53.715121 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.714896    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8378614d-48a8-45e3-8e26-54b397b143b6-tmp-dir\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:53.715211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.715192    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8378614d-48a8-45e3-8e26-54b397b143b6-config-volume\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:53.721678 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.721655    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:49:53.721842 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.721655    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:49:53.721842 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.721752    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:49:53.726691 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.726674    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 02:49:53.727087 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.727066    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 02:49:53.727313 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.727269    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 02:49:53.727313 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.727297    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5skv\""
Sep 10 02:49:53.727484 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.727469    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 02:49:53.727585 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.727485    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lc7sq\""
Sep 10 02:49:53.730933 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.730913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knfzx\" (UniqueName: \"kubernetes.io/projected/8378614d-48a8-45e3-8e26-54b397b143b6-kube-api-access-knfzx\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:53.815740 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.815703    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djj46\" (UniqueName: \"kubernetes.io/projected/c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a-kube-api-access-djj46\") pod \"ingress-canary-gs9lm\" (UID: \"c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a\") " pod="openshift-ingress-canary/ingress-canary-gs9lm"
Sep 10 02:49:53.815917 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.815900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a-cert\") pod \"ingress-canary-gs9lm\" (UID: \"c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a\") " pod="openshift-ingress-canary/ingress-canary-gs9lm"
Sep 10 02:49:53.818402 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.818374    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a-cert\") pod \"ingress-canary-gs9lm\" (UID: \"c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a\") " pod="openshift-ingress-canary/ingress-canary-gs9lm"
Sep 10 02:49:53.827117 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.827090    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djj46\" (UniqueName: \"kubernetes.io/projected/c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a-kube-api-access-djj46\") pod \"ingress-canary-gs9lm\" (UID: \"c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a\") " pod="openshift-ingress-canary/ingress-canary-gs9lm"
Sep 10 02:49:53.870071 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.870036    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gs9lm"
Sep 10 02:49:53.895766 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.895738    2564 generic.go:356] "Generic (PLEG): container finished" podID="a60a33d2-a6e3-49e9-bc7f-1f8df297e823" containerID="a3f8268b6d9cea3a70e23a5213fc0da4556de5815811dca36c93c50d87ab7117" exitCode=0
Sep 10 02:49:53.895926 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:53.895793    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkf8z" event={"ID":"a60a33d2-a6e3-49e9-bc7f-1f8df297e823","Type":"ContainerDied","Data":"a3f8268b6d9cea3a70e23a5213fc0da4556de5815811dca36c93c50d87ab7117"}
Sep 10 02:49:54.202815 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:54.202787    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gs9lm"]
Sep 10 02:49:54.205633 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:54.205586    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ec0101_6b1d_4d75_bb6b_921fd23f0c7a.slice/crio-c1dceba2aebddcd29d5b90af2d16b7619e667697ae0bbaab9873ea29a5c0a1cf WatchSource:0}: Error finding container c1dceba2aebddcd29d5b90af2d16b7619e667697ae0bbaab9873ea29a5c0a1cf: Status 404 returned error can't find the container with id c1dceba2aebddcd29d5b90af2d16b7619e667697ae0bbaab9873ea29a5c0a1cf
Sep 10 02:49:54.218854 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:54.218831    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:54.218944 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:54.218923    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 02:49:54.218979 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:54.218966    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls podName:8378614d-48a8-45e3-8e26-54b397b143b6 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:55.218953537 +0000 UTC m=+36.006618832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls") pod "dns-default-vd7th" (UID: "8378614d-48a8-45e3-8e26-54b397b143b6") : secret "dns-default-metrics-tls" not found
Sep 10 02:49:54.901976 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:54.901940    2564 generic.go:356] "Generic (PLEG): container finished" podID="a60a33d2-a6e3-49e9-bc7f-1f8df297e823" containerID="fdd192ced008b461f633b287ce391a3d57d7cf16730088f6a9228e15f83c7a23" exitCode=0
Sep 10 02:49:54.902880 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:54.902037    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkf8z" event={"ID":"a60a33d2-a6e3-49e9-bc7f-1f8df297e823","Type":"ContainerDied","Data":"fdd192ced008b461f633b287ce391a3d57d7cf16730088f6a9228e15f83c7a23"}
Sep 10 02:49:54.903397 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:54.903361    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gs9lm" event={"ID":"c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a","Type":"ContainerStarted","Data":"c1dceba2aebddcd29d5b90af2d16b7619e667697ae0bbaab9873ea29a5c0a1cf"}
Sep 10 02:49:55.227074 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:55.226883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:55.227074 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:55.227063    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 02:49:55.227291 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:55.227134    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls podName:8378614d-48a8-45e3-8e26-54b397b143b6 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:57.22711496 +0000 UTC m=+38.014780271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls") pod "dns-default-vd7th" (UID: "8378614d-48a8-45e3-8e26-54b397b143b6") : secret "dns-default-metrics-tls" not found
Sep 10 02:49:55.910139 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:55.910105    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkf8z" event={"ID":"a60a33d2-a6e3-49e9-bc7f-1f8df297e823","Type":"ContainerStarted","Data":"129f9e020dd2365c25362ff5b1342f56860baf9487a055c1ca79d23afac5d29a"}
Sep 10 02:49:56.914464 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:56.914424    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gs9lm" event={"ID":"c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a","Type":"ContainerStarted","Data":"42722764e84e88b22f0fab958d12720575f6b06c919bdce6fa43551700399767"}
Sep 10 02:49:56.934381 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:56.934326    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gs9lm" podStartSLOduration=1.436549006 podStartE2EDuration="3.934309059s" totalImagesPullingTime="2.497760053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:56.933644115 +0000 UTC m=+37.721309429" watchObservedRunningTime="2026-09-10 02:49:56.934309059 +0000 UTC m=+37.721974367"
Sep 10 02:49:56.934575 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:56.934439    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fkf8z" podStartSLOduration=9.897563407 podStartE2EDuration="37.934433196s" totalImagesPullingTime="28.036869789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:55.942916002 +0000 UTC m=+36.730581319" watchObservedRunningTime="2026-09-10 02:49:56.934433196 +0000 UTC m=+37.722098510"
Sep 10 02:49:57.241705 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:57.241669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:49:57.241856 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:57.241813    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 02:49:57.241897 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:57.241887    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls podName:8378614d-48a8-45e3-8e26-54b397b143b6 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:01.241868649 +0000 UTC m=+42.029533945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls") pod "dns-default-vd7th" (UID: "8378614d-48a8-45e3-8e26-54b397b143b6") : secret "dns-default-metrics-tls" not found
Sep 10 02:49:58.002891 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.002852    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5tpwp"]
Sep 10 02:49:58.029488 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.029459    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.033073 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.033047    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 02:49:58.033671 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.033647    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 02:49:58.033671 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.033661    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k6lnt\""
Sep 10 02:49:58.033841 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.033660    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 02:49:58.037823 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.037803    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5tpwp"]
Sep 10 02:49:58.038288 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.038272    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 02:49:58.146339 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.146295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-crio-socket\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.146339 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.146337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.146562 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.146382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.146562 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.146413    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-data-volume\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.146562 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.146494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg2fh\" (UniqueName: \"kubernetes.io/projected/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-api-access-hg2fh\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.246941 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.246904    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.247144 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.246959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.247144 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.246984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-data-volume\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.247144 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:58.247033    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 02:49:58.247144 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:58.247084    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 02:49:58.247144 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:58.247102    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm podName:83df7f59-7a1c-4fec-91ca-2a48ae8380e6 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:58.747087998 +0000 UTC m=+39.534753293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5tpwp" (UID: "83df7f59-7a1c-4fec-91ca-2a48ae8380e6") : configmap "kube-rbac-proxy" not found
Sep 10 02:49:58.247144 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:58.247145    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls podName:83df7f59-7a1c-4fec-91ca-2a48ae8380e6 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:58.747126614 +0000 UTC m=+39.534791913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5tpwp" (UID: "83df7f59-7a1c-4fec-91ca-2a48ae8380e6") : secret "insights-runtime-extractor-tls" not found
Sep 10 02:49:58.247442 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.247199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg2fh\" (UniqueName: \"kubernetes.io/projected/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-api-access-hg2fh\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.247442 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.247240    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-data-volume\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.247442 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.247244    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-crio-socket\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.247552 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.247457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-crio-socket\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.286338 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.286274    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg2fh\" (UniqueName: \"kubernetes.io/projected/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-api-access-hg2fh\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.751654 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.751605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.751827 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:58.751695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:58.751827 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:58.751732    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 02:49:58.751827 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:58.751793    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm podName:83df7f59-7a1c-4fec-91ca-2a48ae8380e6 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:59.751778581 +0000 UTC m=+40.539443875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5tpwp" (UID: "83df7f59-7a1c-4fec-91ca-2a48ae8380e6") : configmap "kube-rbac-proxy" not found
Sep 10 02:49:58.751969 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:58.751834    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 02:49:58.751969 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:58.751887    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls podName:83df7f59-7a1c-4fec-91ca-2a48ae8380e6 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:59.751875089 +0000 UTC m=+40.539540385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5tpwp" (UID: "83df7f59-7a1c-4fec-91ca-2a48ae8380e6") : secret "insights-runtime-extractor-tls" not found
Sep 10 02:49:59.264006 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.263971    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6zgf"]
Sep 10 02:49:59.299468 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.299442    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6zgf"]
Sep 10 02:49:59.299636 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.299547    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6zgf"
Sep 10 02:49:59.302908 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.302890    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 10 02:49:59.304212 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.304198    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 10 02:49:59.304271 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.304236    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vs8kn\""
Sep 10 02:49:59.458622 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.458582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p7lh\" (UniqueName: \"kubernetes.io/projected/32daf6f5-902a-41e9-be8b-61908c598ed1-kube-api-access-6p7lh\") pod \"migrator-fdbb8fdff-r6zgf\" (UID: \"32daf6f5-902a-41e9-be8b-61908c598ed1\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6zgf"
Sep 10 02:49:59.559956 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.559887    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p7lh\" (UniqueName: \"kubernetes.io/projected/32daf6f5-902a-41e9-be8b-61908c598ed1-kube-api-access-6p7lh\") pod \"migrator-fdbb8fdff-r6zgf\" (UID: \"32daf6f5-902a-41e9-be8b-61908c598ed1\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6zgf"
Sep 10 02:49:59.571240 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.571213    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p7lh\" (UniqueName: \"kubernetes.io/projected/32daf6f5-902a-41e9-be8b-61908c598ed1-kube-api-access-6p7lh\") pod \"migrator-fdbb8fdff-r6zgf\" (UID: \"32daf6f5-902a-41e9-be8b-61908c598ed1\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6zgf"
Sep 10 02:49:59.608256 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.608225    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6zgf"
Sep 10 02:49:59.736759 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.736734    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9cbc9_b45d4297-516d-4031-8116-7a7ca788ad9a/dns-node-resolver/0.log"
Sep 10 02:49:59.762312 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.762279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:59.762441 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.762329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:49:59.762441 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:59.762405    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 02:49:59.762508 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:59.762493    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm podName:83df7f59-7a1c-4fec-91ca-2a48ae8380e6 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:01.762472709 +0000 UTC m=+42.550138020 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5tpwp" (UID: "83df7f59-7a1c-4fec-91ca-2a48ae8380e6") : configmap "kube-rbac-proxy" not found
Sep 10 02:49:59.762508 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:59.762498    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 02:49:59.762575 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:49:59.762539    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls podName:83df7f59-7a1c-4fec-91ca-2a48ae8380e6 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:01.762527295 +0000 UTC m=+42.550192607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5tpwp" (UID: "83df7f59-7a1c-4fec-91ca-2a48ae8380e6") : secret "insights-runtime-extractor-tls" not found
Sep 10 02:49:59.900849 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.900778    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6zgf"]
Sep 10 02:49:59.904374 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:49:59.904347    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32daf6f5_902a_41e9_be8b_61908c598ed1.slice/crio-a69181e8a909cae167b6905abb295f5847c6d04a23bb61a4bb05f462e1d9b83e WatchSource:0}: Error finding container a69181e8a909cae167b6905abb295f5847c6d04a23bb61a4bb05f462e1d9b83e: Status 404 returned error can't find the container with id a69181e8a909cae167b6905abb295f5847c6d04a23bb61a4bb05f462e1d9b83e
Sep 10 02:49:59.925884 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:49:59.925851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6zgf" event={"ID":"32daf6f5-902a-41e9-be8b-61908c598ed1","Type":"ContainerStarted","Data":"a69181e8a909cae167b6905abb295f5847c6d04a23bb61a4bb05f462e1d9b83e"}
Sep 10 02:50:00.811967 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:00.811934    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-hc7hl"]
Sep 10 02:50:00.831433 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:00.831399    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-hc7hl"]
Sep 10 02:50:00.831556 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:00.831505    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-hc7hl"
Sep 10 02:50:00.835060 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:00.835038    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 10 02:50:00.835205 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:00.835193    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 10 02:50:00.835890 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:00.835869    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gxqcv\""
Sep 10 02:50:00.835997 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:00.835898    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 10 02:50:00.836173 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:00.836158    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 10 02:50:00.935926 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:00.935887    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gzsdt_310b155e-c685-4b20-92c9-a640ee2a4797/node-ca/0.log"
Sep 10 02:50:00.972023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:00.971986    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dfeb803c-3586-4caa-a9c2-3449a977cdd2-signing-key\") pod \"service-ca-75d99c484-hc7hl\" (UID: \"dfeb803c-3586-4caa-a9c2-3449a977cdd2\") " pod="openshift-service-ca/service-ca-75d99c484-hc7hl"
Sep 10 02:50:00.972023 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:00.972027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dfeb803c-3586-4caa-a9c2-3449a977cdd2-signing-cabundle\") pod \"service-ca-75d99c484-hc7hl\" (UID: \"dfeb803c-3586-4caa-a9c2-3449a977cdd2\") " pod="openshift-service-ca/service-ca-75d99c484-hc7hl"
Sep 10 02:50:00.972257 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:00.972086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt89b\" (UniqueName: \"kubernetes.io/projected/dfeb803c-3586-4caa-a9c2-3449a977cdd2-kube-api-access-tt89b\") pod \"service-ca-75d99c484-hc7hl\" (UID: \"dfeb803c-3586-4caa-a9c2-3449a977cdd2\") " pod="openshift-service-ca/service-ca-75d99c484-hc7hl"
Sep 10 02:50:01.072988 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.072901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dfeb803c-3586-4caa-a9c2-3449a977cdd2-signing-key\") pod \"service-ca-75d99c484-hc7hl\" (UID: \"dfeb803c-3586-4caa-a9c2-3449a977cdd2\") " pod="openshift-service-ca/service-ca-75d99c484-hc7hl"
Sep 10 02:50:01.072988 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.072943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dfeb803c-3586-4caa-a9c2-3449a977cdd2-signing-cabundle\") pod \"service-ca-75d99c484-hc7hl\" (UID: \"dfeb803c-3586-4caa-a9c2-3449a977cdd2\") " pod="openshift-service-ca/service-ca-75d99c484-hc7hl"
Sep 10 02:50:01.072988 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.072971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt89b\" (UniqueName: \"kubernetes.io/projected/dfeb803c-3586-4caa-a9c2-3449a977cdd2-kube-api-access-tt89b\") pod \"service-ca-75d99c484-hc7hl\" (UID: \"dfeb803c-3586-4caa-a9c2-3449a977cdd2\") " pod="openshift-service-ca/service-ca-75d99c484-hc7hl"
Sep 10 02:50:01.073881 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.073859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dfeb803c-3586-4caa-a9c2-3449a977cdd2-signing-cabundle\") pod \"service-ca-75d99c484-hc7hl\" (UID: \"dfeb803c-3586-4caa-a9c2-3449a977cdd2\") " pod="openshift-service-ca/service-ca-75d99c484-hc7hl"
Sep 10 02:50:01.075850 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.075822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dfeb803c-3586-4caa-a9c2-3449a977cdd2-signing-key\") pod \"service-ca-75d99c484-hc7hl\" (UID: \"dfeb803c-3586-4caa-a9c2-3449a977cdd2\") " pod="openshift-service-ca/service-ca-75d99c484-hc7hl"
Sep 10 02:50:01.082511 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.082489    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt89b\" (UniqueName: \"kubernetes.io/projected/dfeb803c-3586-4caa-a9c2-3449a977cdd2-kube-api-access-tt89b\") pod \"service-ca-75d99c484-hc7hl\" (UID: \"dfeb803c-3586-4caa-a9c2-3449a977cdd2\") " pod="openshift-service-ca/service-ca-75d99c484-hc7hl"
Sep 10 02:50:01.141421 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.141385    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-hc7hl"
Sep 10 02:50:01.275129 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.275093    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:50:01.275276 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:01.275260    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 02:50:01.275349 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:01.275341    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls podName:8378614d-48a8-45e3-8e26-54b397b143b6 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:09.275319165 +0000 UTC m=+50.062984463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls") pod "dns-default-vd7th" (UID: "8378614d-48a8-45e3-8e26-54b397b143b6") : secret "dns-default-metrics-tls" not found
Sep 10 02:50:01.471045 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.471015    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-hc7hl"]
Sep 10 02:50:01.510203 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:50:01.510167    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfeb803c_3586_4caa_a9c2_3449a977cdd2.slice/crio-b15fdf3ede2477f0db3fc2a14e6935323e2320800eed667e7d65a0e4e94517b1 WatchSource:0}: Error finding container b15fdf3ede2477f0db3fc2a14e6935323e2320800eed667e7d65a0e4e94517b1: Status 404 returned error can't find the container with id b15fdf3ede2477f0db3fc2a14e6935323e2320800eed667e7d65a0e4e94517b1
Sep 10 02:50:01.738382 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.738356    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gs9lm_c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a/serve-healthcheck-canary/0.log"
Sep 10 02:50:01.779559 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.779528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:50:01.779742 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.779575    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:50:01.779742 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:01.779687    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 02:50:01.779742 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:01.779709    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 02:50:01.779858 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:01.779755    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls podName:83df7f59-7a1c-4fec-91ca-2a48ae8380e6 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:05.779741577 +0000 UTC m=+46.567406886 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5tpwp" (UID: "83df7f59-7a1c-4fec-91ca-2a48ae8380e6") : secret "insights-runtime-extractor-tls" not found
Sep 10 02:50:01.779858 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:01.779769    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm podName:83df7f59-7a1c-4fec-91ca-2a48ae8380e6 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:05.779761872 +0000 UTC m=+46.567427167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5tpwp" (UID: "83df7f59-7a1c-4fec-91ca-2a48ae8380e6") : configmap "kube-rbac-proxy" not found
Sep 10 02:50:01.933313 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.933275    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6zgf" event={"ID":"32daf6f5-902a-41e9-be8b-61908c598ed1","Type":"ContainerStarted","Data":"96dc2d6a5a0908c380fe4e446e9e8512fe37f0f347d00381eca7d622b92fddd8"}
Sep 10 02:50:01.933783 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.933334    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6zgf" event={"ID":"32daf6f5-902a-41e9-be8b-61908c598ed1","Type":"ContainerStarted","Data":"4391772c23ac645037f4ff7ed6c6663804770d81ebd414464018b7f50f67c568"}
Sep 10 02:50:01.934477 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.934445    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-hc7hl" event={"ID":"dfeb803c-3586-4caa-a9c2-3449a977cdd2","Type":"ContainerStarted","Data":"b15fdf3ede2477f0db3fc2a14e6935323e2320800eed667e7d65a0e4e94517b1"}
Sep 10 02:50:01.969254 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:01.969201    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6zgf" podStartSLOduration=1.333023893 podStartE2EDuration="2.969182481s" totalImagesPullingTime="1.636158588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:01.96610516 +0000 UTC m=+42.753770476" watchObservedRunningTime="2026-09-10 02:50:01.969182481 +0000 UTC m=+42.756847791"
Sep 10 02:50:04.943052 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:04.943021    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-hc7hl" event={"ID":"dfeb803c-3586-4caa-a9c2-3449a977cdd2","Type":"ContainerStarted","Data":"c3fc5fdd2addc847ed746b92f2b19dffb5156e502fc4e70a9042c3b9978997a9"}
Sep 10 02:50:04.970570 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:04.970521    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-hc7hl" podStartSLOduration=2.252377189 podStartE2EDuration="4.970501374s" totalImagesPullingTime="2.718124185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:04.967847885 +0000 UTC m=+45.755513202" watchObservedRunningTime="2026-09-10 02:50:04.970501374 +0000 UTC m=+45.758166693"
Sep 10 02:50:05.812215 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:05.812183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:50:05.812392 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:05.812233    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:50:05.812392 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:05.812325    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 02:50:05.812392 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:05.812364    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 02:50:05.812534 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:05.812405    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm podName:83df7f59-7a1c-4fec-91ca-2a48ae8380e6 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:13.812385137 +0000 UTC m=+54.600050439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5tpwp" (UID: "83df7f59-7a1c-4fec-91ca-2a48ae8380e6") : configmap "kube-rbac-proxy" not found
Sep 10 02:50:05.812534 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:05.812427    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls podName:83df7f59-7a1c-4fec-91ca-2a48ae8380e6 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:13.81241811 +0000 UTC m=+54.600083411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5tpwp" (UID: "83df7f59-7a1c-4fec-91ca-2a48ae8380e6") : secret "insights-runtime-extractor-tls" not found
Sep 10 02:50:09.337841 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:09.337794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:50:09.340327 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:09.340305    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8378614d-48a8-45e3-8e26-54b397b143b6-metrics-tls\") pod \"dns-default-vd7th\" (UID: \"8378614d-48a8-45e3-8e26-54b397b143b6\") " pod="openshift-dns/dns-default-vd7th"
Sep 10 02:50:09.458064 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:09.458018    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vd7th"
Sep 10 02:50:09.748987 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:09.748960    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vd7th"]
Sep 10 02:50:09.752089 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:50:09.752055    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8378614d_48a8_45e3_8e26_54b397b143b6.slice/crio-4770b4669d32dff3e98c0be5e5b0525f4afac627581ad7c017b9f83b8886d843 WatchSource:0}: Error finding container 4770b4669d32dff3e98c0be5e5b0525f4afac627581ad7c017b9f83b8886d843: Status 404 returned error can't find the container with id 4770b4669d32dff3e98c0be5e5b0525f4afac627581ad7c017b9f83b8886d843
Sep 10 02:50:09.957844 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:09.957799    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vd7th" event={"ID":"8378614d-48a8-45e3-8e26-54b397b143b6","Type":"ContainerStarted","Data":"4770b4669d32dff3e98c0be5e5b0525f4afac627581ad7c017b9f83b8886d843"}
Sep 10 02:50:11.966384 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:11.966345    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vd7th" event={"ID":"8378614d-48a8-45e3-8e26-54b397b143b6","Type":"ContainerStarted","Data":"e9618342f239903b4b13cc7db650951f4eb35c2eb72e1235b588e54978b27e05"}
Sep 10 02:50:11.966897 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:11.966447    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vd7th" event={"ID":"8378614d-48a8-45e3-8e26-54b397b143b6","Type":"ContainerStarted","Data":"04e318fc29cebc34b0692d6320669615e7f54f9352c35c3bd63c2c85ed2523e2"}
Sep 10 02:50:11.966897 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:11.966541    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vd7th"
Sep 10 02:50:11.999775 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:11.999708    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vd7th" podStartSLOduration=17.154143016 podStartE2EDuration="18.999687955s" totalImagesPullingTime="1.845544939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:11.998985259 +0000 UTC m=+52.786650579" watchObservedRunningTime="2026-09-10 02:50:11.999687955 +0000 UTC m=+52.787353273"
Sep 10 02:50:13.877679 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:13.877630    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:50:13.878085 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:13.877693    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:50:13.878085 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:13.877784    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 02:50:13.878085 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:13.877858    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls podName:83df7f59-7a1c-4fec-91ca-2a48ae8380e6 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:29.877843045 +0000 UTC m=+70.665508339 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5tpwp" (UID: "83df7f59-7a1c-4fec-91ca-2a48ae8380e6") : secret "insights-runtime-extractor-tls" not found
Sep 10 02:50:13.878203 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:13.878144    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:50:19.892921 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:19.892887    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4kmx"
Sep 10 02:50:21.960744 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:21.960710    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"]
Sep 10 02:50:21.963439 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:21.963416    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:21.968845 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:21.968825    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 10 02:50:21.969100 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:21.969065    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 02:50:21.969197 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:21.969075    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 02:50:21.969509 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:21.969399    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 10 02:50:21.969509 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:21.969415    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 10 02:50:21.969747 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:21.969730    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 02:50:21.970050 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:21.970027    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 10 02:50:21.971482 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:21.971465    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vd7th"
Sep 10 02:50:21.981220 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:21.981202    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"]
Sep 10 02:50:22.031186 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.031153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bc453cbd-9001-4ddd-91c6-8548f719a143-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.031186 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.031186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bc453cbd-9001-4ddd-91c6-8548f719a143-ca\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.031379 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.031210    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc453cbd-9001-4ddd-91c6-8548f719a143-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.031379 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.031308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtxn7\" (UniqueName: \"kubernetes.io/projected/bc453cbd-9001-4ddd-91c6-8548f719a143-kube-api-access-vtxn7\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.031379 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.031345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bc453cbd-9001-4ddd-91c6-8548f719a143-hub\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.031485 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.031406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc453cbd-9001-4ddd-91c6-8548f719a143-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.131713 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.131680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bc453cbd-9001-4ddd-91c6-8548f719a143-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.131713 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.131713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bc453cbd-9001-4ddd-91c6-8548f719a143-ca\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.131981 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.131741    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc453cbd-9001-4ddd-91c6-8548f719a143-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.132089 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.132041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtxn7\" (UniqueName: \"kubernetes.io/projected/bc453cbd-9001-4ddd-91c6-8548f719a143-kube-api-access-vtxn7\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.132165 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.132092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bc453cbd-9001-4ddd-91c6-8548f719a143-hub\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.132165 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.132153    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc453cbd-9001-4ddd-91c6-8548f719a143-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.133135 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.133105    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc453cbd-9001-4ddd-91c6-8548f719a143-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.134600 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.134552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bc453cbd-9001-4ddd-91c6-8548f719a143-ca\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.134738 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.134721    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc453cbd-9001-4ddd-91c6-8548f719a143-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.134959 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.134941    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bc453cbd-9001-4ddd-91c6-8548f719a143-hub\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.135020 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.134959    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bc453cbd-9001-4ddd-91c6-8548f719a143-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.149510 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.149482    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57bbb94767-sqwfk"]
Sep 10 02:50:22.151698 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.151683    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.154684 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.154659    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 02:50:22.154821 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.154697    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-glllk\""
Sep 10 02:50:22.154821 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.154707    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 02:50:22.154821 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.154742    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 02:50:22.155060 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.155011    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtxn7\" (UniqueName: \"kubernetes.io/projected/bc453cbd-9001-4ddd-91c6-8548f719a143-kube-api-access-vtxn7\") pod \"cluster-proxy-proxy-agent-64bcb98bc7-9jrgx\" (UID: \"bc453cbd-9001-4ddd-91c6-8548f719a143\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.159797 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.159776    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 02:50:22.169781 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.169749    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57bbb94767-sqwfk"]
Sep 10 02:50:22.232897 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.232810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb3952fd-9994-47fb-b7e9-b648f2b98913-installation-pull-secrets\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.232897 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.232855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb3952fd-9994-47fb-b7e9-b648f2b98913-registry-certificates\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.232897 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.232872    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb3952fd-9994-47fb-b7e9-b648f2b98913-registry-tls\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.232897 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.232887    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p55cs\" (UniqueName: \"kubernetes.io/projected/eb3952fd-9994-47fb-b7e9-b648f2b98913-kube-api-access-p55cs\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.233153 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.232923    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb3952fd-9994-47fb-b7e9-b648f2b98913-bound-sa-token\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.233153 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.232962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb3952fd-9994-47fb-b7e9-b648f2b98913-ca-trust-extracted\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.233153 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.232991    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb3952fd-9994-47fb-b7e9-b648f2b98913-image-registry-private-configuration\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.233153 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.233006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb3952fd-9994-47fb-b7e9-b648f2b98913-trusted-ca\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.277835 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.277803    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"
Sep 10 02:50:22.333998 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.333955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb3952fd-9994-47fb-b7e9-b648f2b98913-ca-trust-extracted\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.334134 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.334051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb3952fd-9994-47fb-b7e9-b648f2b98913-image-registry-private-configuration\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.334134 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.334084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb3952fd-9994-47fb-b7e9-b648f2b98913-trusted-ca\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.337822 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.337788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb3952fd-9994-47fb-b7e9-b648f2b98913-image-registry-private-configuration\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.338130 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.338106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb3952fd-9994-47fb-b7e9-b648f2b98913-ca-trust-extracted\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.339649 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.339623    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb3952fd-9994-47fb-b7e9-b648f2b98913-trusted-ca\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.339764 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.339740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb3952fd-9994-47fb-b7e9-b648f2b98913-installation-pull-secrets\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.339891 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.339841    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb3952fd-9994-47fb-b7e9-b648f2b98913-registry-certificates\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.339954 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.339929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb3952fd-9994-47fb-b7e9-b648f2b98913-registry-tls\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.340009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.339966    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p55cs\" (UniqueName: \"kubernetes.io/projected/eb3952fd-9994-47fb-b7e9-b648f2b98913-kube-api-access-p55cs\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.340066 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.340011    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb3952fd-9994-47fb-b7e9-b648f2b98913-bound-sa-token\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.341275 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.341252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb3952fd-9994-47fb-b7e9-b648f2b98913-registry-certificates\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.344074 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.344048    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb3952fd-9994-47fb-b7e9-b648f2b98913-registry-tls\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.344330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.344310    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb3952fd-9994-47fb-b7e9-b648f2b98913-installation-pull-secrets\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.353871 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.353853    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p55cs\" (UniqueName: \"kubernetes.io/projected/eb3952fd-9994-47fb-b7e9-b648f2b98913-kube-api-access-p55cs\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.354013 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.353996    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb3952fd-9994-47fb-b7e9-b648f2b98913-bound-sa-token\") pod \"image-registry-57bbb94767-sqwfk\" (UID: \"eb3952fd-9994-47fb-b7e9-b648f2b98913\") " pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.465302 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.465266    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:22.559650 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.559552    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx"]
Sep 10 02:50:22.563508 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:50:22.563484    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc453cbd_9001_4ddd_91c6_8548f719a143.slice/crio-a52f95709a8950e8b22002e0e43a9bf0c20fe318e356ad10ba08a22a57254276 WatchSource:0}: Error finding container a52f95709a8950e8b22002e0e43a9bf0c20fe318e356ad10ba08a22a57254276: Status 404 returned error can't find the container with id a52f95709a8950e8b22002e0e43a9bf0c20fe318e356ad10ba08a22a57254276
Sep 10 02:50:22.746989 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.746953    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57bbb94767-sqwfk"]
Sep 10 02:50:22.749714 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:50:22.749685    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb3952fd_9994_47fb_b7e9_b648f2b98913.slice/crio-9bdb2b376b5bad02560700042893e8c19c5f1901dc33447ecc0b91248abed112 WatchSource:0}: Error finding container 9bdb2b376b5bad02560700042893e8c19c5f1901dc33447ecc0b91248abed112: Status 404 returned error can't find the container with id 9bdb2b376b5bad02560700042893e8c19c5f1901dc33447ecc0b91248abed112
Sep 10 02:50:22.999247 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.999217    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57bbb94767-sqwfk" event={"ID":"eb3952fd-9994-47fb-b7e9-b648f2b98913","Type":"ContainerStarted","Data":"73d78da77d9422604602f2ef32c0a9a91e36d66504ea171d496a3ce519c6a7a5"}
Sep 10 02:50:22.999688 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.999273    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57bbb94767-sqwfk" event={"ID":"eb3952fd-9994-47fb-b7e9-b648f2b98913","Type":"ContainerStarted","Data":"9bdb2b376b5bad02560700042893e8c19c5f1901dc33447ecc0b91248abed112"}
Sep 10 02:50:22.999688 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:22.999311    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:50:23.000587 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:23.000559    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx" event={"ID":"bc453cbd-9001-4ddd-91c6-8548f719a143","Type":"ContainerStarted","Data":"a52f95709a8950e8b22002e0e43a9bf0c20fe318e356ad10ba08a22a57254276"}
Sep 10 02:50:23.021813 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:23.021727    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57bbb94767-sqwfk" podStartSLOduration=1.021707148 podStartE2EDuration="1.021707148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:50:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:23.02012133 +0000 UTC m=+63.807786648" watchObservedRunningTime="2026-09-10 02:50:23.021707148 +0000 UTC m=+63.809372468"
Sep 10 02:50:25.368293 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.368254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs\") pod \"network-metrics-daemon-d4br4\" (UID: \"8466af26-10ce-4dc3-a326-d798025b8220\") " pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:50:25.368912 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.368321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:50:25.371451 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.371409    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 02:50:25.372347 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.372329    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 02:50:25.381575 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.381546    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8466af26-10ce-4dc3-a326-d798025b8220-metrics-certs\") pod \"network-metrics-daemon-d4br4\" (UID: \"8466af26-10ce-4dc3-a326-d798025b8220\") " pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:50:25.381692 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.381556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c14c85f-51c6-41d3-8edd-a3a27ec01497-original-pull-secret\") pod \"global-pull-secret-syncer-r6sxm\" (UID: \"2c14c85f-51c6-41d3-8edd-a3a27ec01497\") " pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:50:25.534500 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.534465    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5skv\""
Sep 10 02:50:25.542053 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.542022    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4br4"
Sep 10 02:50:25.542053 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.542046    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6sxm"
Sep 10 02:50:25.569690 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.569655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq2bw\" (UniqueName: \"kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw\") pod \"network-check-target-9q5w2\" (UID: \"fb961f15-ef6d-43ec-ae98-ffad727af967\") " pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:50:25.572752 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.572727    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 02:50:25.582823 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.582802    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 02:50:25.593248 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.593225    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq2bw\" (UniqueName: \"kubernetes.io/projected/fb961f15-ef6d-43ec-ae98-ffad727af967-kube-api-access-vq2bw\") pod \"network-check-target-9q5w2\" (UID: \"fb961f15-ef6d-43ec-ae98-ffad727af967\") " pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:50:25.849251 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.849218    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lc7sq\""
Sep 10 02:50:25.856533 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:25.856502    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:50:26.326973 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:26.326942    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9q5w2"]
Sep 10 02:50:26.329996 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:50:26.329942    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb961f15_ef6d_43ec_ae98_ffad727af967.slice/crio-391e9a35585aa859447f4b88766534377d68f2f3e9b0d0dfd698dd5287b24cba WatchSource:0}: Error finding container 391e9a35585aa859447f4b88766534377d68f2f3e9b0d0dfd698dd5287b24cba: Status 404 returned error can't find the container with id 391e9a35585aa859447f4b88766534377d68f2f3e9b0d0dfd698dd5287b24cba
Sep 10 02:50:26.331120 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:26.331094    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r6sxm"]
Sep 10 02:50:26.333870 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:50:26.333846    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c14c85f_51c6_41d3_8edd_a3a27ec01497.slice/crio-7f4f6a7663ee1b3dd5044246d76f03f856a730874e65caa3e7aa286d0ce79bc7 WatchSource:0}: Error finding container 7f4f6a7663ee1b3dd5044246d76f03f856a730874e65caa3e7aa286d0ce79bc7: Status 404 returned error can't find the container with id 7f4f6a7663ee1b3dd5044246d76f03f856a730874e65caa3e7aa286d0ce79bc7
Sep 10 02:50:26.358978 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:26.358912    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d4br4"]
Sep 10 02:50:26.362170 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:50:26.362147    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8466af26_10ce_4dc3_a326_d798025b8220.slice/crio-b20ac4e86377bd2ecfdbf2b09f5830ef5b8b28deec9d37479a74893a68d1e5a9 WatchSource:0}: Error finding container b20ac4e86377bd2ecfdbf2b09f5830ef5b8b28deec9d37479a74893a68d1e5a9: Status 404 returned error can't find the container with id b20ac4e86377bd2ecfdbf2b09f5830ef5b8b28deec9d37479a74893a68d1e5a9
Sep 10 02:50:27.020043 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:27.018821    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx" event={"ID":"bc453cbd-9001-4ddd-91c6-8548f719a143","Type":"ContainerStarted","Data":"09a4b229be8e524bbaa87e80aa9f56d7389614fb9332713eafbdb40d12cb1f88"}
Sep 10 02:50:27.020043 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:27.018883    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx" event={"ID":"bc453cbd-9001-4ddd-91c6-8548f719a143","Type":"ContainerStarted","Data":"c26f2a45426bbdbd65c022c33728fdd971a0a5e3db0bcf4763b7ab07de1b778b"}
Sep 10 02:50:27.020043 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:27.018907    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx" event={"ID":"bc453cbd-9001-4ddd-91c6-8548f719a143","Type":"ContainerStarted","Data":"ebc7620cf03b20019effc05d1a6265c168fba9ddb888e3ef9798545c061ac2e3"}
Sep 10 02:50:27.023040 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:27.022938    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d4br4" event={"ID":"8466af26-10ce-4dc3-a326-d798025b8220","Type":"ContainerStarted","Data":"b20ac4e86377bd2ecfdbf2b09f5830ef5b8b28deec9d37479a74893a68d1e5a9"}
Sep 10 02:50:27.025719 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:27.025635    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r6sxm" event={"ID":"2c14c85f-51c6-41d3-8edd-a3a27ec01497","Type":"ContainerStarted","Data":"7f4f6a7663ee1b3dd5044246d76f03f856a730874e65caa3e7aa286d0ce79bc7"}
Sep 10 02:50:27.027592 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:27.027562    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9q5w2" event={"ID":"fb961f15-ef6d-43ec-ae98-ffad727af967","Type":"ContainerStarted","Data":"391e9a35585aa859447f4b88766534377d68f2f3e9b0d0dfd698dd5287b24cba"}
Sep 10 02:50:27.039593 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:27.039536    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bcb98bc7-9jrgx" podStartSLOduration=2.50445904 podStartE2EDuration="6.039515362s" totalImagesPullingTime="3.535056322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:27.039029246 +0000 UTC m=+67.826694566" watchObservedRunningTime="2026-09-10 02:50:27.039515362 +0000 UTC m=+67.827180659"
Sep 10 02:50:28.034681 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:28.034643    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d4br4" event={"ID":"8466af26-10ce-4dc3-a326-d798025b8220","Type":"ContainerStarted","Data":"c3238f195c453d57f4a1ac86e851d0a727a5f841a8804a9866626b99d3736f75"}
Sep 10 02:50:28.035121 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:28.034708    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d4br4" event={"ID":"8466af26-10ce-4dc3-a326-d798025b8220","Type":"ContainerStarted","Data":"52ce8302b4f1e71e8a471d28a434ce37aaf8d5e57ea9c0b60d7ae295c9aac87c"}
Sep 10 02:50:28.055888 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:28.055835    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d4br4" podStartSLOduration=67.86106176 podStartE2EDuration="1m9.055812274s" totalImagesPullingTime="1.194750514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:28.054301046 +0000 UTC m=+68.841966366" watchObservedRunningTime="2026-09-10 02:50:28.055812274 +0000 UTC m=+68.843477593"
Sep 10 02:50:29.902732 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:29.902691    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:50:29.906221 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:29.906189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83df7f59-7a1c-4fec-91ca-2a48ae8380e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tpwp\" (UID: \"83df7f59-7a1c-4fec-91ca-2a48ae8380e6\") " pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:50:30.142266 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:30.142229    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k6lnt\""
Sep 10 02:50:30.149317 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:30.149295    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5tpwp"
Sep 10 02:50:31.279169 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:31.279091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5tpwp"]
Sep 10 02:50:31.283055 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:50:31.283029    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83df7f59_7a1c_4fec_91ca_2a48ae8380e6.slice/crio-f7069cf17a424abd1f64cff04167e40aaafb25fe043947e59d6c02cc70078cd4 WatchSource:0}: Error finding container f7069cf17a424abd1f64cff04167e40aaafb25fe043947e59d6c02cc70078cd4: Status 404 returned error can't find the container with id f7069cf17a424abd1f64cff04167e40aaafb25fe043947e59d6c02cc70078cd4
Sep 10 02:50:32.051723 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:32.051641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5tpwp" event={"ID":"83df7f59-7a1c-4fec-91ca-2a48ae8380e6","Type":"ContainerStarted","Data":"966647fe54f7b3672250d8956d7e43b324fceca63174c332dab1bef3c923b9bf"}
Sep 10 02:50:32.051723 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:32.051695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5tpwp" event={"ID":"83df7f59-7a1c-4fec-91ca-2a48ae8380e6","Type":"ContainerStarted","Data":"4f44a6d405d5462575b62e002ba1fc09867ce0e08dd529d210d9123801318493"}
Sep 10 02:50:32.051901 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:32.051725    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5tpwp" event={"ID":"83df7f59-7a1c-4fec-91ca-2a48ae8380e6","Type":"ContainerStarted","Data":"f7069cf17a424abd1f64cff04167e40aaafb25fe043947e59d6c02cc70078cd4"}
Sep 10 02:50:32.053017 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:32.052990    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r6sxm" event={"ID":"2c14c85f-51c6-41d3-8edd-a3a27ec01497","Type":"ContainerStarted","Data":"02fddb2cb5472b708201a15db2a9141917278536fa513250b3aba2857f34dd1a"}
Sep 10 02:50:32.054500 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:32.054463    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9q5w2" event={"ID":"fb961f15-ef6d-43ec-ae98-ffad727af967","Type":"ContainerStarted","Data":"7babc161fdd4c525670d9d13fef2fc8b65aafd97d2154146fddf86860baf00ad"}
Sep 10 02:50:32.054643 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:32.054544    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:50:32.101807 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:32.101756    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r6sxm" podStartSLOduration=68.421289747 podStartE2EDuration="1m13.101740669s" totalImagesPullingTime="4.680450922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:32.10028083 +0000 UTC m=+72.887946146" watchObservedRunningTime="2026-09-10 02:50:32.101740669 +0000 UTC m=+72.889405997"
Sep 10 02:50:32.130220 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:32.130171    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9q5w2" podStartSLOduration=68.449256796 podStartE2EDuration="1m13.130156742s" totalImagesPullingTime="4.680899946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:32.129232847 +0000 UTC m=+72.916898165" watchObservedRunningTime="2026-09-10 02:50:32.130156742 +0000 UTC m=+72.917822059"
Sep 10 02:50:34.063604 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:34.063566    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5tpwp" event={"ID":"83df7f59-7a1c-4fec-91ca-2a48ae8380e6","Type":"ContainerStarted","Data":"ad29691267c65d22341404c776e8fabcc8925b534850bda47fc34dec69192b44"}
Sep 10 02:50:34.094328 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:34.094279    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5tpwp" podStartSLOduration=35.320394008 podStartE2EDuration="37.094263564s" totalImagesPullingTime="1.773869556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:34.094088411 +0000 UTC m=+74.881753731" watchObservedRunningTime="2026-09-10 02:50:34.094263564 +0000 UTC m=+74.881928880"
Sep 10 02:50:35.399185 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.399141    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"]
Sep 10 02:50:35.401631 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.401597    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:35.412750 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.412725    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 10 02:50:35.414434 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.414411    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 02:50:35.414555 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.414449    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 10 02:50:35.414555 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.414473    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 02:50:35.414891 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.414870    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 02:50:35.415105 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.415084    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-s7tp8\""
Sep 10 02:50:35.444798 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.444759    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/24070250-2e5c-416c-a78f-dde3b35fa512-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7k4mr\" (UID: \"24070250-2e5c-416c-a78f-dde3b35fa512\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:35.444956 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.444807    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw7db\" (UniqueName: \"kubernetes.io/projected/24070250-2e5c-416c-a78f-dde3b35fa512-kube-api-access-lw7db\") pod \"openshift-state-metrics-657fd6c54-7k4mr\" (UID: \"24070250-2e5c-416c-a78f-dde3b35fa512\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:35.444956 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.444889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24070250-2e5c-416c-a78f-dde3b35fa512-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-7k4mr\" (UID: \"24070250-2e5c-416c-a78f-dde3b35fa512\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:35.445040 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.444980    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24070250-2e5c-416c-a78f-dde3b35fa512-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-7k4mr\" (UID: \"24070250-2e5c-416c-a78f-dde3b35fa512\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:35.493668 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.493637    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fdgj6"]
Sep 10 02:50:35.495790 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.495763    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.499855 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.499831    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 02:50:35.500208 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.500062    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 02:50:35.500316 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.500299    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xskv2\""
Sep 10 02:50:35.500486 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.500464    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 02:50:35.505030 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.505007    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"]
Sep 10 02:50:35.545750 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.545708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e845696-6a29-4b46-a3db-3ed7f8182ce7-root\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.545903 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.545759    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.545903 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.545788    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e845696-6a29-4b46-a3db-3ed7f8182ce7-metrics-client-ca\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.545903 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.545819    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.545903 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.545857    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24070250-2e5c-416c-a78f-dde3b35fa512-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-7k4mr\" (UID: \"24070250-2e5c-416c-a78f-dde3b35fa512\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:35.545903 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.545884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsmvs\" (UniqueName: \"kubernetes.io/projected/7e845696-6a29-4b46-a3db-3ed7f8182ce7-kube-api-access-vsmvs\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.546163 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.545911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/24070250-2e5c-416c-a78f-dde3b35fa512-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7k4mr\" (UID: \"24070250-2e5c-416c-a78f-dde3b35fa512\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:35.546163 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.545936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e845696-6a29-4b46-a3db-3ed7f8182ce7-sys\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.546163 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:35.546066    2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 10 02:50:35.546163 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.546072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-wtmp\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.546163 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.546114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw7db\" (UniqueName: \"kubernetes.io/projected/24070250-2e5c-416c-a78f-dde3b35fa512-kube-api-access-lw7db\") pod \"openshift-state-metrics-657fd6c54-7k4mr\" (UID: \"24070250-2e5c-416c-a78f-dde3b35fa512\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:35.546163 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:50:35.546144    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24070250-2e5c-416c-a78f-dde3b35fa512-openshift-state-metrics-tls podName:24070250-2e5c-416c-a78f-dde3b35fa512 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:36.046122701 +0000 UTC m=+76.833788011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/24070250-2e5c-416c-a78f-dde3b35fa512-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-7k4mr" (UID: "24070250-2e5c-416c-a78f-dde3b35fa512") : secret "openshift-state-metrics-tls" not found
Sep 10 02:50:35.546455 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.546184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-tls\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.546455 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.546244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-textfile\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.546455 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.546278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24070250-2e5c-416c-a78f-dde3b35fa512-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-7k4mr\" (UID: \"24070250-2e5c-416c-a78f-dde3b35fa512\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:35.546942 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.546919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24070250-2e5c-416c-a78f-dde3b35fa512-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-7k4mr\" (UID: \"24070250-2e5c-416c-a78f-dde3b35fa512\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:35.548687 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.548669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24070250-2e5c-416c-a78f-dde3b35fa512-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-7k4mr\" (UID: \"24070250-2e5c-416c-a78f-dde3b35fa512\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:35.563769 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.563748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw7db\" (UniqueName: \"kubernetes.io/projected/24070250-2e5c-416c-a78f-dde3b35fa512-kube-api-access-lw7db\") pod \"openshift-state-metrics-657fd6c54-7k4mr\" (UID: \"24070250-2e5c-416c-a78f-dde3b35fa512\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:35.647032 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.646999    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-wtmp\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.647032 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.647038    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-tls\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.647267 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.647066    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-textfile\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.647267 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.647092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e845696-6a29-4b46-a3db-3ed7f8182ce7-root\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.647267 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.647147    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e845696-6a29-4b46-a3db-3ed7f8182ce7-root\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.647267 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.647209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-wtmp\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.647267 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.647227    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.647507 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.647271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e845696-6a29-4b46-a3db-3ed7f8182ce7-metrics-client-ca\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.647507 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.647309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.647507 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.647341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsmvs\" (UniqueName: \"kubernetes.io/projected/7e845696-6a29-4b46-a3db-3ed7f8182ce7-kube-api-access-vsmvs\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.647507 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.647392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e845696-6a29-4b46-a3db-3ed7f8182ce7-sys\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.647507 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.647453    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-textfile\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.647507 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.647464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e845696-6a29-4b46-a3db-3ed7f8182ce7-sys\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.647845 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.647825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.648105 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.648060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e845696-6a29-4b46-a3db-3ed7f8182ce7-metrics-client-ca\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.649679 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.649599    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-tls\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.649778 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.649720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e845696-6a29-4b46-a3db-3ed7f8182ce7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.662500 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.662473    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsmvs\" (UniqueName: \"kubernetes.io/projected/7e845696-6a29-4b46-a3db-3ed7f8182ce7-kube-api-access-vsmvs\") pod \"node-exporter-fdgj6\" (UID: \"7e845696-6a29-4b46-a3db-3ed7f8182ce7\") " pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.807954 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:35.807923    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fdgj6"
Sep 10 02:50:35.817870 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:50:35.817843    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e845696_6a29_4b46_a3db_3ed7f8182ce7.slice/crio-68cf86e7c5d478638627b004caf46f27743e91206c2f397b85a613e178661646 WatchSource:0}: Error finding container 68cf86e7c5d478638627b004caf46f27743e91206c2f397b85a613e178661646: Status 404 returned error can't find the container with id 68cf86e7c5d478638627b004caf46f27743e91206c2f397b85a613e178661646
Sep 10 02:50:36.051150 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:36.051110    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/24070250-2e5c-416c-a78f-dde3b35fa512-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7k4mr\" (UID: \"24070250-2e5c-416c-a78f-dde3b35fa512\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:36.053546 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:36.053528    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/24070250-2e5c-416c-a78f-dde3b35fa512-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7k4mr\" (UID: \"24070250-2e5c-416c-a78f-dde3b35fa512\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:36.071141 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:36.071109    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdgj6" event={"ID":"7e845696-6a29-4b46-a3db-3ed7f8182ce7","Type":"ContainerStarted","Data":"68cf86e7c5d478638627b004caf46f27743e91206c2f397b85a613e178661646"}
Sep 10 02:50:36.312558 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:36.312474    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"
Sep 10 02:50:36.585911 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:36.585751    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr"]
Sep 10 02:50:36.588957 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:50:36.588914    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24070250_2e5c_416c_a78f_dde3b35fa512.slice/crio-0a400b7ffe16a81f872593f2198eaaf29910d9ba1182a9bdc1aba77269419c07 WatchSource:0}: Error finding container 0a400b7ffe16a81f872593f2198eaaf29910d9ba1182a9bdc1aba77269419c07: Status 404 returned error can't find the container with id 0a400b7ffe16a81f872593f2198eaaf29910d9ba1182a9bdc1aba77269419c07
Sep 10 02:50:37.075733 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:37.075698    2564 generic.go:356] "Generic (PLEG): container finished" podID="7e845696-6a29-4b46-a3db-3ed7f8182ce7" containerID="5128915ce780a8bc706cbe4eed93eb8ad5e5e288bd52452d0b49b48e4bfb34a6" exitCode=0
Sep 10 02:50:37.075903 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:37.075774    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdgj6" event={"ID":"7e845696-6a29-4b46-a3db-3ed7f8182ce7","Type":"ContainerDied","Data":"5128915ce780a8bc706cbe4eed93eb8ad5e5e288bd52452d0b49b48e4bfb34a6"}
Sep 10 02:50:37.077767 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:37.077736    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr" event={"ID":"24070250-2e5c-416c-a78f-dde3b35fa512","Type":"ContainerStarted","Data":"c3add0defec8260045a3aa4e7d3b4216958a8bb9467d1355ba59a7df1e597b36"}
Sep 10 02:50:37.077871 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:37.077793    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr" event={"ID":"24070250-2e5c-416c-a78f-dde3b35fa512","Type":"ContainerStarted","Data":"e26ca2c43d423d599ef6f244324914302ea0abfec32dd2589e612b76fe582a42"}
Sep 10 02:50:37.077871 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:37.077821    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr" event={"ID":"24070250-2e5c-416c-a78f-dde3b35fa512","Type":"ContainerStarted","Data":"0a400b7ffe16a81f872593f2198eaaf29910d9ba1182a9bdc1aba77269419c07"}
Sep 10 02:50:38.083750 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:38.083715    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdgj6" event={"ID":"7e845696-6a29-4b46-a3db-3ed7f8182ce7","Type":"ContainerStarted","Data":"a02f81b232102bda193050d177fe95b411df9a8349aff3ea1bb1b059e0b4b6c3"}
Sep 10 02:50:38.084182 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:38.083767    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdgj6" event={"ID":"7e845696-6a29-4b46-a3db-3ed7f8182ce7","Type":"ContainerStarted","Data":"4e6e04b7d4a3b5c6a98393c28f1802b3f6ff89aa73c2acbecf0cba48cc98760c"}
Sep 10 02:50:38.085928 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:38.085902    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr" event={"ID":"24070250-2e5c-416c-a78f-dde3b35fa512","Type":"ContainerStarted","Data":"a94ccb7f0b950807b7882f24c5bcd2184b18715e8743ea29929500448cb859b8"}
Sep 10 02:50:38.183906 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:38.183855    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fdgj6" podStartSLOduration=2.049076789 podStartE2EDuration="3.183836231s" totalImagesPullingTime="1.065163321s" totalInitContainerRuntime="69.596121ms" isStatefulPod=true podCreationTimestamp="2026-09-10 02:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:38.116049222 +0000 UTC m=+78.903714553" watchObservedRunningTime="2026-09-10 02:50:38.183836231 +0000 UTC m=+78.971501549"
Sep 10 02:50:38.184159 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:38.184139    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7k4mr" podStartSLOduration=2.205515547 podStartE2EDuration="3.184134183s" totalImagesPullingTime="978.618636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:38.183561363 +0000 UTC m=+78.971226681" watchObservedRunningTime="2026-09-10 02:50:38.184134183 +0000 UTC m=+78.971799496"
Sep 10 02:50:44.009480 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:50:44.009367    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57bbb94767-sqwfk"
Sep 10 02:51:03.061017 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:51:03.060985    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9q5w2"
Sep 10 02:53:37.847757 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:37.847720    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9dkld"]
Sep 10 02:53:37.849789 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:37.849773    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9dkld"
Sep 10 02:53:37.852223 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:37.852201    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 02:53:37.853203 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:37.853181    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lqjtc\""
Sep 10 02:53:37.853306 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:37.853186    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 02:53:37.860741 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:37.860718    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9dkld"]
Sep 10 02:53:37.922891 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:37.922858    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d9d6502-f587-4c1b-9980-86f4cc662668-bound-sa-token\") pod \"cert-manager-55b4d954d5-9dkld\" (UID: \"4d9d6502-f587-4c1b-9980-86f4cc662668\") " pod="cert-manager/cert-manager-55b4d954d5-9dkld"
Sep 10 02:53:37.923039 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:37.922936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx7pl\" (UniqueName: \"kubernetes.io/projected/4d9d6502-f587-4c1b-9980-86f4cc662668-kube-api-access-gx7pl\") pod \"cert-manager-55b4d954d5-9dkld\" (UID: \"4d9d6502-f587-4c1b-9980-86f4cc662668\") " pod="cert-manager/cert-manager-55b4d954d5-9dkld"
Sep 10 02:53:38.023964 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:38.023931    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx7pl\" (UniqueName: \"kubernetes.io/projected/4d9d6502-f587-4c1b-9980-86f4cc662668-kube-api-access-gx7pl\") pod \"cert-manager-55b4d954d5-9dkld\" (UID: \"4d9d6502-f587-4c1b-9980-86f4cc662668\") " pod="cert-manager/cert-manager-55b4d954d5-9dkld"
Sep 10 02:53:38.023964 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:38.023968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d9d6502-f587-4c1b-9980-86f4cc662668-bound-sa-token\") pod \"cert-manager-55b4d954d5-9dkld\" (UID: \"4d9d6502-f587-4c1b-9980-86f4cc662668\") " pod="cert-manager/cert-manager-55b4d954d5-9dkld"
Sep 10 02:53:38.032997 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:38.032965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d9d6502-f587-4c1b-9980-86f4cc662668-bound-sa-token\") pod \"cert-manager-55b4d954d5-9dkld\" (UID: \"4d9d6502-f587-4c1b-9980-86f4cc662668\") " pod="cert-manager/cert-manager-55b4d954d5-9dkld"
Sep 10 02:53:38.033403 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:38.033386    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx7pl\" (UniqueName: \"kubernetes.io/projected/4d9d6502-f587-4c1b-9980-86f4cc662668-kube-api-access-gx7pl\") pod \"cert-manager-55b4d954d5-9dkld\" (UID: \"4d9d6502-f587-4c1b-9980-86f4cc662668\") " pod="cert-manager/cert-manager-55b4d954d5-9dkld"
Sep 10 02:53:38.158532 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:38.158500    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9dkld"
Sep 10 02:53:38.426159 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:38.426134    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9dkld"]
Sep 10 02:53:38.428883 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:53:38.428861    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d9d6502_f587_4c1b_9980_86f4cc662668.slice/crio-5190d83e6850196cf2d72eb9081dc24840558b260e7edb0c9fa3c39d153fa566 WatchSource:0}: Error finding container 5190d83e6850196cf2d72eb9081dc24840558b260e7edb0c9fa3c39d153fa566: Status 404 returned error can't find the container with id 5190d83e6850196cf2d72eb9081dc24840558b260e7edb0c9fa3c39d153fa566
Sep 10 02:53:38.687208 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:38.687130    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9dkld" event={"ID":"4d9d6502-f587-4c1b-9980-86f4cc662668","Type":"ContainerStarted","Data":"5190d83e6850196cf2d72eb9081dc24840558b260e7edb0c9fa3c39d153fa566"}
Sep 10 02:53:41.699329 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:41.699297    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9dkld" event={"ID":"4d9d6502-f587-4c1b-9980-86f4cc662668","Type":"ContainerStarted","Data":"c1888c5090202fa12e311c1cdbf899bb21db2d57a862e84930d4270e9b308d7e"}
Sep 10 02:53:41.716690 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:53:41.716639    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9dkld" podStartSLOduration=1.574323137 podStartE2EDuration="4.716599883s" totalImagesPullingTime="3.142276746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:53:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:53:41.715056726 +0000 UTC m=+262.502722045" watchObservedRunningTime="2026-09-10 02:53:41.716599883 +0000 UTC m=+262.504265199"
Sep 10 02:54:04.693203 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.693166    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"]
Sep 10 02:54:04.698348 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.698327    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.701213 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.701166    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 02:54:04.701213 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.701179    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 02:54:04.701213 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.701183    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 02:54:04.701213 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.701209    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 02:54:04.701487 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.701223    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7zgks\""
Sep 10 02:54:04.712253 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.712229    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"]
Sep 10 02:54:04.814425 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.814392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41c75544-6630-404c-99b4-e8b7566edae0-webhook-cert\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.814425 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.814430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgxsr\" (UniqueName: \"kubernetes.io/projected/41c75544-6630-404c-99b4-e8b7566edae0-kube-api-access-sgxsr\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.814670 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.814510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41c75544-6630-404c-99b4-e8b7566edae0-tmp\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.814670 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.814537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41c75544-6630-404c-99b4-e8b7566edae0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.814670 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.814571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41c75544-6630-404c-99b4-e8b7566edae0-manifests\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.915850 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.915810    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41c75544-6630-404c-99b4-e8b7566edae0-tmp\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.915850 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.915850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41c75544-6630-404c-99b4-e8b7566edae0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.916063 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.915887    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41c75544-6630-404c-99b4-e8b7566edae0-manifests\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.916063 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.915922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41c75544-6630-404c-99b4-e8b7566edae0-webhook-cert\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.916063 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.915947    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgxsr\" (UniqueName: \"kubernetes.io/projected/41c75544-6630-404c-99b4-e8b7566edae0-kube-api-access-sgxsr\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.916336 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.916313    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41c75544-6630-404c-99b4-e8b7566edae0-manifests\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.918253 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.918231    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41c75544-6630-404c-99b4-e8b7566edae0-tmp\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.918473 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.918456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41c75544-6630-404c-99b4-e8b7566edae0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.918534 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.918485    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41c75544-6630-404c-99b4-e8b7566edae0-webhook-cert\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:04.923516 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:04.923493    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgxsr\" (UniqueName: \"kubernetes.io/projected/41c75544-6630-404c-99b4-e8b7566edae0-kube-api-access-sgxsr\") pod \"opendatahub-operator-controller-manager-78f567c59b-rmnc7\" (UID: \"41c75544-6630-404c-99b4-e8b7566edae0\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:05.007463 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:05.007366    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:05.286040 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:05.285971    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"]
Sep 10 02:54:05.288790 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:54:05.288755    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c75544_6630_404c_99b4_e8b7566edae0.slice/crio-65e2688da44144c03192aa8f32a41dc35286a10fa87fbe195b07c3602e62422f WatchSource:0}: Error finding container 65e2688da44144c03192aa8f32a41dc35286a10fa87fbe195b07c3602e62422f: Status 404 returned error can't find the container with id 65e2688da44144c03192aa8f32a41dc35286a10fa87fbe195b07c3602e62422f
Sep 10 02:54:05.780649 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:05.780589    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7" event={"ID":"41c75544-6630-404c-99b4-e8b7566edae0","Type":"ContainerStarted","Data":"65e2688da44144c03192aa8f32a41dc35286a10fa87fbe195b07c3602e62422f"}
Sep 10 02:54:08.793261 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:08.793224    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7" event={"ID":"41c75544-6630-404c-99b4-e8b7566edae0","Type":"ContainerStarted","Data":"eb2775ac7885d8d5415a2c077c892be5e63dd7fc4fe6ee089f1294ae86c6583c"}
Sep 10 02:54:09.798258 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:09.798165    2564 generic.go:356] "Generic (PLEG): container finished" podID="41c75544-6630-404c-99b4-e8b7566edae0" containerID="eb2775ac7885d8d5415a2c077c892be5e63dd7fc4fe6ee089f1294ae86c6583c" exitCode=0
Sep 10 02:54:09.798258 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:09.798220    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7" event={"ID":"41c75544-6630-404c-99b4-e8b7566edae0","Type":"ContainerDied","Data":"eb2775ac7885d8d5415a2c077c892be5e63dd7fc4fe6ee089f1294ae86c6583c"}
Sep 10 02:54:10.803256 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:10.803176    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7" event={"ID":"41c75544-6630-404c-99b4-e8b7566edae0","Type":"ContainerStarted","Data":"7c355f259256fa2f46fa03a29d48214c92ac44f5a2dcc64b1ab8006cc2e3fee5"}
Sep 10 02:54:10.803651 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:10.803308    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:19.579539 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:19.579498    2564 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 02:54:21.808435 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:21.808402    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7"
Sep 10 02:54:21.831943 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:21.831890    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-rmnc7" podStartSLOduration=13.142957423 podStartE2EDuration="17.831871241s" totalImagesPullingTime="3.639691332s" totalInitContainerRuntime="1.049222486s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:54:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:54:10.827804775 +0000 UTC m=+291.615470093" watchObservedRunningTime="2026-09-10 02:54:21.831871241 +0000 UTC m=+302.619536574"
Sep 10 02:54:34.867302 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:34.867270    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"]
Sep 10 02:54:34.869366 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:34.869351    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"
Sep 10 02:54:34.875865 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:34.875843    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 02:54:34.876124 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:34.875908    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 02:54:34.876930 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:34.876910    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jcvfd\""
Sep 10 02:54:34.877035 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:34.876953    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 02:54:34.877035 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:34.876962    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 02:54:34.882603 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:34.882578    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"]
Sep 10 02:54:34.994438 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:34.994405    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4gkkc"]
Sep 10 02:54:34.996474 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:34.996458    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4gkkc"
Sep 10 02:54:34.999260 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:34.999242    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 02:54:34.999350 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:34.999251    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xfldf\""
Sep 10 02:54:35.007419 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.007393    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4gkkc"]
Sep 10 02:54:35.049004 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.048973    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmxnp\" (UniqueName: \"kubernetes.io/projected/b96e4700-2203-4a26-b9d4-2611f29f0064-kube-api-access-cmxnp\") pod \"kube-auth-proxy-846bd484f-4qxsz\" (UID: \"b96e4700-2203-4a26-b9d4-2611f29f0064\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"
Sep 10 02:54:35.049174 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.049044    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b96e4700-2203-4a26-b9d4-2611f29f0064-tmp\") pod \"kube-auth-proxy-846bd484f-4qxsz\" (UID: \"b96e4700-2203-4a26-b9d4-2611f29f0064\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"
Sep 10 02:54:35.049224 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.049174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b96e4700-2203-4a26-b9d4-2611f29f0064-tls-certs\") pod \"kube-auth-proxy-846bd484f-4qxsz\" (UID: \"b96e4700-2203-4a26-b9d4-2611f29f0064\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"
Sep 10 02:54:35.150344 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.150246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmxnp\" (UniqueName: \"kubernetes.io/projected/b96e4700-2203-4a26-b9d4-2611f29f0064-kube-api-access-cmxnp\") pod \"kube-auth-proxy-846bd484f-4qxsz\" (UID: \"b96e4700-2203-4a26-b9d4-2611f29f0064\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"
Sep 10 02:54:35.150344 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.150306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b96e4700-2203-4a26-b9d4-2611f29f0064-tmp\") pod \"kube-auth-proxy-846bd484f-4qxsz\" (UID: \"b96e4700-2203-4a26-b9d4-2611f29f0064\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"
Sep 10 02:54:35.150344 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.150330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42cc036a-0516-417e-9180-dbd9bfc55c82-cert\") pod \"odh-model-controller-7998c67dc4-4gkkc\" (UID: \"42cc036a-0516-417e-9180-dbd9bfc55c82\") " pod="opendatahub/odh-model-controller-7998c67dc4-4gkkc"
Sep 10 02:54:35.150641 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.150356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw9k6\" (UniqueName: \"kubernetes.io/projected/42cc036a-0516-417e-9180-dbd9bfc55c82-kube-api-access-hw9k6\") pod \"odh-model-controller-7998c67dc4-4gkkc\" (UID: \"42cc036a-0516-417e-9180-dbd9bfc55c82\") " pod="opendatahub/odh-model-controller-7998c67dc4-4gkkc"
Sep 10 02:54:35.150641 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.150375    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b96e4700-2203-4a26-b9d4-2611f29f0064-tls-certs\") pod \"kube-auth-proxy-846bd484f-4qxsz\" (UID: \"b96e4700-2203-4a26-b9d4-2611f29f0064\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"
Sep 10 02:54:35.152826 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.152803    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b96e4700-2203-4a26-b9d4-2611f29f0064-tmp\") pod \"kube-auth-proxy-846bd484f-4qxsz\" (UID: \"b96e4700-2203-4a26-b9d4-2611f29f0064\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"
Sep 10 02:54:35.153044 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.153025    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b96e4700-2203-4a26-b9d4-2611f29f0064-tls-certs\") pod \"kube-auth-proxy-846bd484f-4qxsz\" (UID: \"b96e4700-2203-4a26-b9d4-2611f29f0064\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"
Sep 10 02:54:35.160299 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.160269    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmxnp\" (UniqueName: \"kubernetes.io/projected/b96e4700-2203-4a26-b9d4-2611f29f0064-kube-api-access-cmxnp\") pod \"kube-auth-proxy-846bd484f-4qxsz\" (UID: \"b96e4700-2203-4a26-b9d4-2611f29f0064\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"
Sep 10 02:54:35.178977 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.178947    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"
Sep 10 02:54:35.251182 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.251145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42cc036a-0516-417e-9180-dbd9bfc55c82-cert\") pod \"odh-model-controller-7998c67dc4-4gkkc\" (UID: \"42cc036a-0516-417e-9180-dbd9bfc55c82\") " pod="opendatahub/odh-model-controller-7998c67dc4-4gkkc"
Sep 10 02:54:35.251322 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.251213    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw9k6\" (UniqueName: \"kubernetes.io/projected/42cc036a-0516-417e-9180-dbd9bfc55c82-kube-api-access-hw9k6\") pod \"odh-model-controller-7998c67dc4-4gkkc\" (UID: \"42cc036a-0516-417e-9180-dbd9bfc55c82\") " pod="opendatahub/odh-model-controller-7998c67dc4-4gkkc"
Sep 10 02:54:35.253707 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.253665    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42cc036a-0516-417e-9180-dbd9bfc55c82-cert\") pod \"odh-model-controller-7998c67dc4-4gkkc\" (UID: \"42cc036a-0516-417e-9180-dbd9bfc55c82\") " pod="opendatahub/odh-model-controller-7998c67dc4-4gkkc"
Sep 10 02:54:35.260828 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.260672    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw9k6\" (UniqueName: \"kubernetes.io/projected/42cc036a-0516-417e-9180-dbd9bfc55c82-kube-api-access-hw9k6\") pod \"odh-model-controller-7998c67dc4-4gkkc\" (UID: \"42cc036a-0516-417e-9180-dbd9bfc55c82\") " pod="opendatahub/odh-model-controller-7998c67dc4-4gkkc"
Sep 10 02:54:35.307637 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.307583    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4gkkc"
Sep 10 02:54:35.450795 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.450763    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-846bd484f-4qxsz"]
Sep 10 02:54:35.454007 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:54:35.453970    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96e4700_2203_4a26_b9d4_2611f29f0064.slice/crio-b4a7c7c7f9f35b910497e2b7174a1efb37d2c0230aa6ff33094164aeca471f8c WatchSource:0}: Error finding container b4a7c7c7f9f35b910497e2b7174a1efb37d2c0230aa6ff33094164aeca471f8c: Status 404 returned error can't find the container with id b4a7c7c7f9f35b910497e2b7174a1efb37d2c0230aa6ff33094164aeca471f8c
Sep 10 02:54:35.456262 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.456239    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 02:54:35.580582 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.580560    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4gkkc"]
Sep 10 02:54:35.582817 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:54:35.582787    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cc036a_0516_417e_9180_dbd9bfc55c82.slice/crio-6c8188744addf114423632a3334f44a4e8e6b31fe273363e9e139f4cf29c383e WatchSource:0}: Error finding container 6c8188744addf114423632a3334f44a4e8e6b31fe273363e9e139f4cf29c383e: Status 404 returned error can't find the container with id 6c8188744addf114423632a3334f44a4e8e6b31fe273363e9e139f4cf29c383e
Sep 10 02:54:35.711637 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.711543    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-98rpl"]
Sep 10 02:54:35.714976 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.714947    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-98rpl"
Sep 10 02:54:35.717766 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.717739    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 02:54:35.729051 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.729015    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-98rpl"]
Sep 10 02:54:35.856557 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.856510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19b58033-3f3d-4ac0-a133-0729effd783c-tls-certs\") pod \"model-serving-api-54d89bd5fc-98rpl\" (UID: \"19b58033-3f3d-4ac0-a133-0729effd783c\") " pod="opendatahub/model-serving-api-54d89bd5fc-98rpl"
Sep 10 02:54:35.856756 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.856564    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mzct\" (UniqueName: \"kubernetes.io/projected/19b58033-3f3d-4ac0-a133-0729effd783c-kube-api-access-4mzct\") pod \"model-serving-api-54d89bd5fc-98rpl\" (UID: \"19b58033-3f3d-4ac0-a133-0729effd783c\") " pod="opendatahub/model-serving-api-54d89bd5fc-98rpl"
Sep 10 02:54:35.892546 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.892511    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4gkkc" event={"ID":"42cc036a-0516-417e-9180-dbd9bfc55c82","Type":"ContainerStarted","Data":"6c8188744addf114423632a3334f44a4e8e6b31fe273363e9e139f4cf29c383e"}
Sep 10 02:54:35.893678 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.893657    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz" event={"ID":"b96e4700-2203-4a26-b9d4-2611f29f0064","Type":"ContainerStarted","Data":"b4a7c7c7f9f35b910497e2b7174a1efb37d2c0230aa6ff33094164aeca471f8c"}
Sep 10 02:54:35.957071 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.957029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19b58033-3f3d-4ac0-a133-0729effd783c-tls-certs\") pod \"model-serving-api-54d89bd5fc-98rpl\" (UID: \"19b58033-3f3d-4ac0-a133-0729effd783c\") " pod="opendatahub/model-serving-api-54d89bd5fc-98rpl"
Sep 10 02:54:35.957240 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.957112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mzct\" (UniqueName: \"kubernetes.io/projected/19b58033-3f3d-4ac0-a133-0729effd783c-kube-api-access-4mzct\") pod \"model-serving-api-54d89bd5fc-98rpl\" (UID: \"19b58033-3f3d-4ac0-a133-0729effd783c\") " pod="opendatahub/model-serving-api-54d89bd5fc-98rpl"
Sep 10 02:54:35.957325 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:54:35.957243    2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 10 02:54:35.957380 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:54:35.957345    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b58033-3f3d-4ac0-a133-0729effd783c-tls-certs podName:19b58033-3f3d-4ac0-a133-0729effd783c nodeName:}" failed. No retries permitted until 2026-09-10 02:54:36.457321591 +0000 UTC m=+317.244986891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/19b58033-3f3d-4ac0-a133-0729effd783c-tls-certs") pod "model-serving-api-54d89bd5fc-98rpl" (UID: "19b58033-3f3d-4ac0-a133-0729effd783c") : secret "model-serving-api-tls" not found
Sep 10 02:54:35.966008 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:35.965938    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mzct\" (UniqueName: \"kubernetes.io/projected/19b58033-3f3d-4ac0-a133-0729effd783c-kube-api-access-4mzct\") pod \"model-serving-api-54d89bd5fc-98rpl\" (UID: \"19b58033-3f3d-4ac0-a133-0729effd783c\") " pod="opendatahub/model-serving-api-54d89bd5fc-98rpl"
Sep 10 02:54:36.024336 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.024299    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"]
Sep 10 02:54:36.027905 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.027876    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.030805 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.030777    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 02:54:36.031883 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.031772    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cxmz5\""
Sep 10 02:54:36.032122 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.032105    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 02:54:36.032300 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.032284    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 02:54:36.032502 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.032487    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 02:54:36.044053 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.043987    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"]
Sep 10 02:54:36.160021 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.159979    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.160196 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.160045    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctzh6\" (UniqueName: \"kubernetes.io/projected/45e7cb3d-53aa-4b72-8480-a87837bbee4b-kube-api-access-ctzh6\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.160196 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.160108    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e7cb3d-53aa-4b72-8480-a87837bbee4b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.160300 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.160201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.160300 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.160254    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.160300 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.160278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.160438 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.160344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.263171 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.263077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.263171 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.263139    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.263413 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.263182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzh6\" (UniqueName: \"kubernetes.io/projected/45e7cb3d-53aa-4b72-8480-a87837bbee4b-kube-api-access-ctzh6\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.263413 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.263235    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e7cb3d-53aa-4b72-8480-a87837bbee4b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.263413 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.263262    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.263413 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.263306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.263413 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.263331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.264302 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.264278    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.268200 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.268172    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.268334 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.268312    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e7cb3d-53aa-4b72-8480-a87837bbee4b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.268883 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.268858    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.269920 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.269896    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.272479 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.272456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.274998 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.274959    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctzh6\" (UniqueName: \"kubernetes.io/projected/45e7cb3d-53aa-4b72-8480-a87837bbee4b-kube-api-access-ctzh6\") pod \"istiod-openshift-gateway-7b7995d5cd-zb9kb\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.353230 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.352901    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:36.466239 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.466199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19b58033-3f3d-4ac0-a133-0729effd783c-tls-certs\") pod \"model-serving-api-54d89bd5fc-98rpl\" (UID: \"19b58033-3f3d-4ac0-a133-0729effd783c\") " pod="opendatahub/model-serving-api-54d89bd5fc-98rpl"
Sep 10 02:54:36.469453 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.469424    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19b58033-3f3d-4ac0-a133-0729effd783c-tls-certs\") pod \"model-serving-api-54d89bd5fc-98rpl\" (UID: \"19b58033-3f3d-4ac0-a133-0729effd783c\") " pod="opendatahub/model-serving-api-54d89bd5fc-98rpl"
Sep 10 02:54:36.627512 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.627378    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-98rpl"
Sep 10 02:54:36.674598 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.674567    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"]
Sep 10 02:54:36.900827 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.900699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb" event={"ID":"45e7cb3d-53aa-4b72-8480-a87837bbee4b","Type":"ContainerStarted","Data":"2f367510e879dff4ff503fd5528dbc9c2b9c3cb37feaa59d62a6b9b04b1c3816"}
Sep 10 02:54:36.960894 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:36.960107    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-98rpl"]
Sep 10 02:54:36.967074 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:54:36.967046    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b58033_3f3d_4ac0_a133_0729effd783c.slice/crio-2a4a8bab744061f93ebf630135b925817ec049d2c5ecbe8d1f6f10e986e10085 WatchSource:0}: Error finding container 2a4a8bab744061f93ebf630135b925817ec049d2c5ecbe8d1f6f10e986e10085: Status 404 returned error can't find the container with id 2a4a8bab744061f93ebf630135b925817ec049d2c5ecbe8d1f6f10e986e10085
Sep 10 02:54:37.907477 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:37.907425    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-98rpl" event={"ID":"19b58033-3f3d-4ac0-a133-0729effd783c","Type":"ContainerStarted","Data":"2a4a8bab744061f93ebf630135b925817ec049d2c5ecbe8d1f6f10e986e10085"}
Sep 10 02:54:42.229751 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:42.229603    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 02:54:42.229751 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:42.229680    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 02:54:42.937298 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:42.937093    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4gkkc" event={"ID":"42cc036a-0516-417e-9180-dbd9bfc55c82","Type":"ContainerStarted","Data":"64f107391dae6e97a1eb95923518df11c887bf5286b8fffaaeb91e3884878c56"}
Sep 10 02:54:42.937298 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:42.937211    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4gkkc"
Sep 10 02:54:42.939289 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:42.939051    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz" event={"ID":"b96e4700-2203-4a26-b9d4-2611f29f0064","Type":"ContainerStarted","Data":"39e0b6970da13c16ad2acd3363b8821bb04dafdecf01b0f9133a0b9bdc3b321b"}
Sep 10 02:54:42.941437 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:42.941410    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-98rpl" event={"ID":"19b58033-3f3d-4ac0-a133-0729effd783c","Type":"ContainerStarted","Data":"acb86b7e514657e259010e51981285cc4b4d0e5f022a85e9a8e7319250842a6b"}
Sep 10 02:54:42.941560 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:42.941470    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-98rpl"
Sep 10 02:54:42.943447 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:42.943423    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb" event={"ID":"45e7cb3d-53aa-4b72-8480-a87837bbee4b","Type":"ContainerStarted","Data":"44c2378b980ba023f2cfe9b19e4b71209e20b0faa9056319dd1f27f896053119"}
Sep 10 02:54:42.943566 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:42.943479    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:42.955176 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:42.955120    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4gkkc" podStartSLOduration=2.317444776 podStartE2EDuration="8.955101564s" totalImagesPullingTime="6.637656788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:54:42.952824854 +0000 UTC m=+323.740490173" watchObservedRunningTime="2026-09-10 02:54:42.955101564 +0000 UTC m=+323.742766883"
Sep 10 02:54:42.972181 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:42.972134    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-98rpl" podStartSLOduration=2.718354224 podStartE2EDuration="7.972121479s" totalImagesPullingTime="5.253767255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:54:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:54:42.971035761 +0000 UTC m=+323.758701079" watchObservedRunningTime="2026-09-10 02:54:42.972121479 +0000 UTC m=+323.759786816"
Sep 10 02:54:42.993843 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:42.993794    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb" podStartSLOduration=1.435328443 podStartE2EDuration="6.993774852s" totalImagesPullingTime="5.558446409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:54:42.991855253 +0000 UTC m=+323.779520571" watchObservedRunningTime="2026-09-10 02:54:42.993774852 +0000 UTC m=+323.781440170"
Sep 10 02:54:43.011970 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:43.011923    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-846bd484f-4qxsz" podStartSLOduration=2.25117645 podStartE2EDuration="9.011907534s" totalImagesPullingTime="6.760731084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:54:43.010848644 +0000 UTC m=+323.798513961" watchObservedRunningTime="2026-09-10 02:54:43.011907534 +0000 UTC m=+323.799572853"
Sep 10 02:54:43.949575 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:43.949550    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:46.543707 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.543669    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sflqv"]
Sep 10 02:54:46.546002 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.545984    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sflqv"
Sep 10 02:54:46.549747 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.549727    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qrpth\""
Sep 10 02:54:46.550799 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.550770    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 02:54:46.552218 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.552198    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"]
Sep 10 02:54:46.554660 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.554643    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"
Sep 10 02:54:46.557706 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.557688    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 02:54:46.557803 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.557704    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vmcbh\""
Sep 10 02:54:46.562079 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.561828    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sflqv"]
Sep 10 02:54:46.569091 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.568986    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"]
Sep 10 02:54:46.654193 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.654153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n47pk\" (UniqueName: \"kubernetes.io/projected/2f1c8ad7-d2a4-434b-93d4-def1c7ef8812-kube-api-access-n47pk\") pod \"llmisvc-controller-manager-777c6bd7d5-55cgr\" (UID: \"2f1c8ad7-d2a4-434b-93d4-def1c7ef8812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"
Sep 10 02:54:46.654193 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.654196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-455mq\" (UniqueName: \"kubernetes.io/projected/ad0be7d7-e22e-4d61-8a91-5a8bca3ff167-kube-api-access-455mq\") pod \"kserve-controller-manager-d6f4b65b8-sflqv\" (UID: \"ad0be7d7-e22e-4d61-8a91-5a8bca3ff167\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sflqv"
Sep 10 02:54:46.654443 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.654219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f1c8ad7-d2a4-434b-93d4-def1c7ef8812-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-55cgr\" (UID: \"2f1c8ad7-d2a4-434b-93d4-def1c7ef8812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"
Sep 10 02:54:46.654443 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.654305    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad0be7d7-e22e-4d61-8a91-5a8bca3ff167-cert\") pod \"kserve-controller-manager-d6f4b65b8-sflqv\" (UID: \"ad0be7d7-e22e-4d61-8a91-5a8bca3ff167\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sflqv"
Sep 10 02:54:46.755697 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.755655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n47pk\" (UniqueName: \"kubernetes.io/projected/2f1c8ad7-d2a4-434b-93d4-def1c7ef8812-kube-api-access-n47pk\") pod \"llmisvc-controller-manager-777c6bd7d5-55cgr\" (UID: \"2f1c8ad7-d2a4-434b-93d4-def1c7ef8812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"
Sep 10 02:54:46.755697 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.755700    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455mq\" (UniqueName: \"kubernetes.io/projected/ad0be7d7-e22e-4d61-8a91-5a8bca3ff167-kube-api-access-455mq\") pod \"kserve-controller-manager-d6f4b65b8-sflqv\" (UID: \"ad0be7d7-e22e-4d61-8a91-5a8bca3ff167\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sflqv"
Sep 10 02:54:46.755945 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.755719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f1c8ad7-d2a4-434b-93d4-def1c7ef8812-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-55cgr\" (UID: \"2f1c8ad7-d2a4-434b-93d4-def1c7ef8812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"
Sep 10 02:54:46.755945 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.755747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad0be7d7-e22e-4d61-8a91-5a8bca3ff167-cert\") pod \"kserve-controller-manager-d6f4b65b8-sflqv\" (UID: \"ad0be7d7-e22e-4d61-8a91-5a8bca3ff167\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sflqv"
Sep 10 02:54:46.755945 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:54:46.755831    2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 10 02:54:46.755945 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:54:46.755900    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1c8ad7-d2a4-434b-93d4-def1c7ef8812-cert podName:2f1c8ad7-d2a4-434b-93d4-def1c7ef8812 nodeName:}" failed. No retries permitted until 2026-09-10 02:54:47.255881538 +0000 UTC m=+328.043546832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2f1c8ad7-d2a4-434b-93d4-def1c7ef8812-cert") pod "llmisvc-controller-manager-777c6bd7d5-55cgr" (UID: "2f1c8ad7-d2a4-434b-93d4-def1c7ef8812") : secret "llmisvc-webhook-server-cert" not found
Sep 10 02:54:46.758388 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.758355    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad0be7d7-e22e-4d61-8a91-5a8bca3ff167-cert\") pod \"kserve-controller-manager-d6f4b65b8-sflqv\" (UID: \"ad0be7d7-e22e-4d61-8a91-5a8bca3ff167\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sflqv"
Sep 10 02:54:46.764937 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.764914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-455mq\" (UniqueName: \"kubernetes.io/projected/ad0be7d7-e22e-4d61-8a91-5a8bca3ff167-kube-api-access-455mq\") pod \"kserve-controller-manager-d6f4b65b8-sflqv\" (UID: \"ad0be7d7-e22e-4d61-8a91-5a8bca3ff167\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sflqv"
Sep 10 02:54:46.765047 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.764970    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n47pk\" (UniqueName: \"kubernetes.io/projected/2f1c8ad7-d2a4-434b-93d4-def1c7ef8812-kube-api-access-n47pk\") pod \"llmisvc-controller-manager-777c6bd7d5-55cgr\" (UID: \"2f1c8ad7-d2a4-434b-93d4-def1c7ef8812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"
Sep 10 02:54:46.856861 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:46.856777    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sflqv"
Sep 10 02:54:47.134097 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:47.134025    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sflqv"]
Sep 10 02:54:47.136516 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:54:47.136490    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0be7d7_e22e_4d61_8a91_5a8bca3ff167.slice/crio-10fc191202efa5014a2a340178345b9cb66e05e4d8d19a7bb0e3c4ea87b31a6e WatchSource:0}: Error finding container 10fc191202efa5014a2a340178345b9cb66e05e4d8d19a7bb0e3c4ea87b31a6e: Status 404 returned error can't find the container with id 10fc191202efa5014a2a340178345b9cb66e05e4d8d19a7bb0e3c4ea87b31a6e
Sep 10 02:54:47.258952 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:47.258912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f1c8ad7-d2a4-434b-93d4-def1c7ef8812-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-55cgr\" (UID: \"2f1c8ad7-d2a4-434b-93d4-def1c7ef8812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"
Sep 10 02:54:47.261432 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:47.261413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f1c8ad7-d2a4-434b-93d4-def1c7ef8812-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-55cgr\" (UID: \"2f1c8ad7-d2a4-434b-93d4-def1c7ef8812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"
Sep 10 02:54:47.466929 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:47.466885    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"
Sep 10 02:54:47.738692 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:47.738558    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"]
Sep 10 02:54:47.741092 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:54:47.741066    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2f1c8ad7_d2a4_434b_93d4_def1c7ef8812.slice/crio-a1b82a3c215742c13899cecea7f40be85066439ec8c4514122191a6a5e594ca6 WatchSource:0}: Error finding container a1b82a3c215742c13899cecea7f40be85066439ec8c4514122191a6a5e594ca6: Status 404 returned error can't find the container with id a1b82a3c215742c13899cecea7f40be85066439ec8c4514122191a6a5e594ca6
Sep 10 02:54:47.966672 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:47.966631    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sflqv" event={"ID":"ad0be7d7-e22e-4d61-8a91-5a8bca3ff167","Type":"ContainerStarted","Data":"10fc191202efa5014a2a340178345b9cb66e05e4d8d19a7bb0e3c4ea87b31a6e"}
Sep 10 02:54:47.967978 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:47.967956    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr" event={"ID":"2f1c8ad7-d2a4-434b-93d4-def1c7ef8812","Type":"ContainerStarted","Data":"a1b82a3c215742c13899cecea7f40be85066439ec8c4514122191a6a5e594ca6"}
Sep 10 02:54:49.406210 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.406177    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"]
Sep 10 02:54:49.406572 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.406385    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb" podUID="45e7cb3d-53aa-4b72-8480-a87837bbee4b" containerName="discovery" containerID="cri-o://44c2378b980ba023f2cfe9b19e4b71209e20b0faa9056319dd1f27f896053119" gracePeriod=30
Sep 10 02:54:49.696733 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.696704    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:49.781154 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.781120    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e7cb3d-53aa-4b72-8480-a87837bbee4b-local-certs\") pod \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") "
Sep 10 02:54:49.781378 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.781176    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-kubeconfig\") pod \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") "
Sep 10 02:54:49.781378 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.781210    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-csr-dns-cert\") pod \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") "
Sep 10 02:54:49.781378 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.781242    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-cacerts\") pod \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") "
Sep 10 02:54:49.781378 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.781297    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-token\") pod \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") "
Sep 10 02:54:49.781378 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.781324    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-csr-ca-configmap\") pod \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") "
Sep 10 02:54:49.781378 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.781364    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctzh6\" (UniqueName: \"kubernetes.io/projected/45e7cb3d-53aa-4b72-8480-a87837bbee4b-kube-api-access-ctzh6\") pod \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\" (UID: \"45e7cb3d-53aa-4b72-8480-a87837bbee4b\") "
Sep 10 02:54:49.781882 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.781824    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "45e7cb3d-53aa-4b72-8480-a87837bbee4b" (UID: "45e7cb3d-53aa-4b72-8480-a87837bbee4b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 02:54:49.784145 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.784120    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-cacerts" (OuterVolumeSpecName: "cacerts") pod "45e7cb3d-53aa-4b72-8480-a87837bbee4b" (UID: "45e7cb3d-53aa-4b72-8480-a87837bbee4b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 02:54:49.784326 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.784306    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "45e7cb3d-53aa-4b72-8480-a87837bbee4b" (UID: "45e7cb3d-53aa-4b72-8480-a87837bbee4b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 02:54:49.784646 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.784593    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-token" (OuterVolumeSpecName: "istio-token") pod "45e7cb3d-53aa-4b72-8480-a87837bbee4b" (UID: "45e7cb3d-53aa-4b72-8480-a87837bbee4b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 02:54:49.784871 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.784844    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "45e7cb3d-53aa-4b72-8480-a87837bbee4b" (UID: "45e7cb3d-53aa-4b72-8480-a87837bbee4b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 02:54:49.784987 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.784945    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e7cb3d-53aa-4b72-8480-a87837bbee4b-local-certs" (OuterVolumeSpecName: "local-certs") pod "45e7cb3d-53aa-4b72-8480-a87837bbee4b" (UID: "45e7cb3d-53aa-4b72-8480-a87837bbee4b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 02:54:49.785044 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.784988    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e7cb3d-53aa-4b72-8480-a87837bbee4b-kube-api-access-ctzh6" (OuterVolumeSpecName: "kube-api-access-ctzh6") pod "45e7cb3d-53aa-4b72-8480-a87837bbee4b" (UID: "45e7cb3d-53aa-4b72-8480-a87837bbee4b"). InnerVolumeSpecName "kube-api-access-ctzh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 02:54:49.882944 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.882850    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctzh6\" (UniqueName: \"kubernetes.io/projected/45e7cb3d-53aa-4b72-8480-a87837bbee4b-kube-api-access-ctzh6\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:54:49.882944 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.882876    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e7cb3d-53aa-4b72-8480-a87837bbee4b-local-certs\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:54:49.882944 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.882886    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-kubeconfig\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:54:49.882944 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.882894    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-csr-dns-cert\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:54:49.882944 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.882903    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/45e7cb3d-53aa-4b72-8480-a87837bbee4b-cacerts\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:54:49.882944 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.882911    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-token\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:54:49.882944 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.882919    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/45e7cb3d-53aa-4b72-8480-a87837bbee4b-istio-csr-ca-configmap\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:54:49.981205 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.981160    2564 generic.go:356] "Generic (PLEG): container finished" podID="45e7cb3d-53aa-4b72-8480-a87837bbee4b" containerID="44c2378b980ba023f2cfe9b19e4b71209e20b0faa9056319dd1f27f896053119" exitCode=0
Sep 10 02:54:49.981372 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.981279    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"
Sep 10 02:54:49.981372 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.981294    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb" event={"ID":"45e7cb3d-53aa-4b72-8480-a87837bbee4b","Type":"ContainerDied","Data":"44c2378b980ba023f2cfe9b19e4b71209e20b0faa9056319dd1f27f896053119"}
Sep 10 02:54:49.981486 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.981391    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb" event={"ID":"45e7cb3d-53aa-4b72-8480-a87837bbee4b","Type":"ContainerDied","Data":"2f367510e879dff4ff503fd5528dbc9c2b9c3cb37feaa59d62a6b9b04b1c3816"}
Sep 10 02:54:49.982362 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.982324    2564 scope.go:117] "RemoveContainer" containerID="44c2378b980ba023f2cfe9b19e4b71209e20b0faa9056319dd1f27f896053119"
Sep 10 02:54:49.983174 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.983147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sflqv" event={"ID":"ad0be7d7-e22e-4d61-8a91-5a8bca3ff167","Type":"ContainerStarted","Data":"37ad1989cc76fafcca1c24e3ea1922b9e9387dc910dafb55a0e326ae9ff3411f"}
Sep 10 02:54:49.983382 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:49.983363    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sflqv"
Sep 10 02:54:50.002809 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:50.002768    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sflqv" podStartSLOduration=1.659351563 podStartE2EDuration="4.002754244s" totalImagesPullingTime="2.343402681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:54:50.001249996 +0000 UTC m=+330.788915338" watchObservedRunningTime="2026-09-10 02:54:50.002754244 +0000 UTC m=+330.790419561"
Sep 10 02:54:50.015480 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:50.015447    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"]
Sep 10 02:54:50.019343 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:50.019321    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zb9kb"]
Sep 10 02:54:50.254791 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:50.254771    2564 scope.go:117] "RemoveContainer" containerID="44c2378b980ba023f2cfe9b19e4b71209e20b0faa9056319dd1f27f896053119"
Sep 10 02:54:50.255137 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:54:50.255117    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44c2378b980ba023f2cfe9b19e4b71209e20b0faa9056319dd1f27f896053119\": container with ID starting with 44c2378b980ba023f2cfe9b19e4b71209e20b0faa9056319dd1f27f896053119 not found: ID does not exist" containerID="44c2378b980ba023f2cfe9b19e4b71209e20b0faa9056319dd1f27f896053119"
Sep 10 02:54:50.255223 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:50.255144    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44c2378b980ba023f2cfe9b19e4b71209e20b0faa9056319dd1f27f896053119"} err="failed to get container status \"44c2378b980ba023f2cfe9b19e4b71209e20b0faa9056319dd1f27f896053119\": rpc error: code = NotFound desc = could not find container \"44c2378b980ba023f2cfe9b19e4b71209e20b0faa9056319dd1f27f896053119\": container with ID starting with 44c2378b980ba023f2cfe9b19e4b71209e20b0faa9056319dd1f27f896053119 not found: ID does not exist"
Sep 10 02:54:50.989702 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:50.989672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr" event={"ID":"2f1c8ad7-d2a4-434b-93d4-def1c7ef8812","Type":"ContainerStarted","Data":"5f7cb5f44d419e191ebb9a584a8977863f43bbfead79dddeffcf721f112cb480"}
Sep 10 02:54:51.007464 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:51.007416    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr" podStartSLOduration=2.468995635 podStartE2EDuration="5.007401679s" totalImagesPullingTime="2.538406044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:54:51.006535511 +0000 UTC m=+331.794200842" watchObservedRunningTime="2026-09-10 02:54:51.007401679 +0000 UTC m=+331.795066995"
Sep 10 02:54:51.726640 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:51.726592    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45e7cb3d-53aa-4b72-8480-a87837bbee4b" path="/var/lib/kubelet/pods/45e7cb3d-53aa-4b72-8480-a87837bbee4b/volumes"
Sep 10 02:54:51.993996 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:51.993910    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"
Sep 10 02:54:53.950036 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:53.950003    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4gkkc"
Sep 10 02:54:53.953249 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:54:53.953228    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-98rpl"
Sep 10 02:55:20.995582 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:20.995552    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sflqv"
Sep 10 02:55:23.000356 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:23.000322    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-55cgr"
Sep 10 02:55:54.345679 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.345648    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"]
Sep 10 02:55:54.346146 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.345935    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e7cb3d-53aa-4b72-8480-a87837bbee4b" containerName="discovery"
Sep 10 02:55:54.346146 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.345945    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e7cb3d-53aa-4b72-8480-a87837bbee4b" containerName="discovery"
Sep 10 02:55:54.346146 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.345999    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="45e7cb3d-53aa-4b72-8480-a87837bbee4b" containerName="discovery"
Sep 10 02:55:54.347878 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.347862    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:55:54.350791 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.350767    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-96cq5\""
Sep 10 02:55:54.350880 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.350776    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 02:55:54.350880 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.350776    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 02:55:54.363603 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.363573    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"]
Sep 10 02:55:54.381419 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.381394    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsxwq\" (UniqueName: \"kubernetes.io/projected/3e5d2ac7-776d-4074-89f8-99a9591af2ae-kube-api-access-rsxwq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" (UID: \"3e5d2ac7-776d-4074-89f8-99a9591af2ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:55:54.381538 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.381447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e5d2ac7-776d-4074-89f8-99a9591af2ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" (UID: \"3e5d2ac7-776d-4074-89f8-99a9591af2ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:55:54.482722 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.482680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsxwq\" (UniqueName: \"kubernetes.io/projected/3e5d2ac7-776d-4074-89f8-99a9591af2ae-kube-api-access-rsxwq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" (UID: \"3e5d2ac7-776d-4074-89f8-99a9591af2ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:55:54.482902 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.482769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e5d2ac7-776d-4074-89f8-99a9591af2ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" (UID: \"3e5d2ac7-776d-4074-89f8-99a9591af2ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:55:54.483103 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.483088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e5d2ac7-776d-4074-89f8-99a9591af2ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" (UID: \"3e5d2ac7-776d-4074-89f8-99a9591af2ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:55:54.509258 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.509228    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsxwq\" (UniqueName: \"kubernetes.io/projected/3e5d2ac7-776d-4074-89f8-99a9591af2ae-kube-api-access-rsxwq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" (UID: \"3e5d2ac7-776d-4074-89f8-99a9591af2ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:55:54.658312 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.658277    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:55:54.936587 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:54.936563    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"]
Sep 10 02:55:54.939189 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:55:54.939162    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5d2ac7_776d_4074_89f8_99a9591af2ae.slice/crio-7cd6a1b3368c7e5248a203a2701aa1aea5540ff1a3848620d3db1202d9353597 WatchSource:0}: Error finding container 7cd6a1b3368c7e5248a203a2701aa1aea5540ff1a3848620d3db1202d9353597: Status 404 returned error can't find the container with id 7cd6a1b3368c7e5248a203a2701aa1aea5540ff1a3848620d3db1202d9353597
Sep 10 02:55:55.252218 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:55.252137    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk" event={"ID":"3e5d2ac7-776d-4074-89f8-99a9591af2ae","Type":"ContainerStarted","Data":"7cd6a1b3368c7e5248a203a2701aa1aea5540ff1a3848620d3db1202d9353597"}
Sep 10 02:55:56.205139 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:56.205104    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"]
Sep 10 02:55:56.207628 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:56.207592    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:55:56.210297 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:56.210265    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9lc7h\""
Sep 10 02:55:56.218835 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:56.218780    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"]
Sep 10 02:55:56.296585 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:56.296546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh865\" (UniqueName: \"kubernetes.io/projected/f1359c33-16b5-412f-8661-0e7df5870676-kube-api-access-gh865\") pod \"limitador-operator-controller-manager-74495c69f8-xv6tc\" (UID: \"f1359c33-16b5-412f-8661-0e7df5870676\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:55:56.397733 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:56.397688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh865\" (UniqueName: \"kubernetes.io/projected/f1359c33-16b5-412f-8661-0e7df5870676-kube-api-access-gh865\") pod \"limitador-operator-controller-manager-74495c69f8-xv6tc\" (UID: \"f1359c33-16b5-412f-8661-0e7df5870676\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:55:56.408450 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:56.408406    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh865\" (UniqueName: \"kubernetes.io/projected/f1359c33-16b5-412f-8661-0e7df5870676-kube-api-access-gh865\") pod \"limitador-operator-controller-manager-74495c69f8-xv6tc\" (UID: \"f1359c33-16b5-412f-8661-0e7df5870676\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:55:56.523146 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:56.523049    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:55:56.813332 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:56.813246    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"]
Sep 10 02:55:57.484751 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:55:57.484716    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1359c33_16b5_412f_8661_0e7df5870676.slice/crio-f98040dcb1e3ee473fe9391a316428feedcf712c8e5d123b63b4a5d7d83f0e10 WatchSource:0}: Error finding container f98040dcb1e3ee473fe9391a316428feedcf712c8e5d123b63b4a5d7d83f0e10: Status 404 returned error can't find the container with id f98040dcb1e3ee473fe9391a316428feedcf712c8e5d123b63b4a5d7d83f0e10
Sep 10 02:55:58.269727 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:58.269672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc" event={"ID":"f1359c33-16b5-412f-8661-0e7df5870676","Type":"ContainerStarted","Data":"f98040dcb1e3ee473fe9391a316428feedcf712c8e5d123b63b4a5d7d83f0e10"}
Sep 10 02:55:58.637826 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:58.637734    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8rm5w"]
Sep 10 02:55:58.640725 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:58.640706    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8rm5w"
Sep 10 02:55:58.643385 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:58.643213    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 02:55:58.643385 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:58.643238    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wglq5\""
Sep 10 02:55:58.652316 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:58.652290    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8rm5w"]
Sep 10 02:55:58.720028 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:58.719989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htvd6\" (UniqueName: \"kubernetes.io/projected/6df5c1cf-6fb8-4143-b43a-a087da381f5f-kube-api-access-htvd6\") pod \"dns-operator-controller-manager-7b84cd7c9c-8rm5w\" (UID: \"6df5c1cf-6fb8-4143-b43a-a087da381f5f\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8rm5w"
Sep 10 02:55:58.820541 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:58.820500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htvd6\" (UniqueName: \"kubernetes.io/projected/6df5c1cf-6fb8-4143-b43a-a087da381f5f-kube-api-access-htvd6\") pod \"dns-operator-controller-manager-7b84cd7c9c-8rm5w\" (UID: \"6df5c1cf-6fb8-4143-b43a-a087da381f5f\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8rm5w"
Sep 10 02:55:58.833835 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:58.833779    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htvd6\" (UniqueName: \"kubernetes.io/projected/6df5c1cf-6fb8-4143-b43a-a087da381f5f-kube-api-access-htvd6\") pod \"dns-operator-controller-manager-7b84cd7c9c-8rm5w\" (UID: \"6df5c1cf-6fb8-4143-b43a-a087da381f5f\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8rm5w"
Sep 10 02:55:58.954429 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:58.954392    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8rm5w"
Sep 10 02:55:59.276153 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:59.276112    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk" event={"ID":"3e5d2ac7-776d-4074-89f8-99a9591af2ae","Type":"ContainerStarted","Data":"40eeaa06eda6964413e978b1275861c8a84d835e88645a5c695223bd3287e3c8"}
Sep 10 02:55:59.276331 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:59.276251    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:55:59.296932 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:59.296877    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk" podStartSLOduration=1.089124144 podStartE2EDuration="5.296860539s" totalImagesPullingTime="4.207736395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:55:59.295091754 +0000 UTC m=+400.082757074" watchObservedRunningTime="2026-09-10 02:55:59.296860539 +0000 UTC m=+400.084525855"
Sep 10 02:55:59.370589 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:55:59.370554    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8rm5w"]
Sep 10 02:55:59.373330 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:55:59.373303    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df5c1cf_6fb8_4143_b43a_a087da381f5f.slice/crio-ca6e9b7c26a091eac8cc5fb4b2bf748f1fcbdf76fb606619d0b2b0de44c82cfe WatchSource:0}: Error finding container ca6e9b7c26a091eac8cc5fb4b2bf748f1fcbdf76fb606619d0b2b0de44c82cfe: Status 404 returned error can't find the container with id ca6e9b7c26a091eac8cc5fb4b2bf748f1fcbdf76fb606619d0b2b0de44c82cfe
Sep 10 02:56:00.283702 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:00.283591    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8rm5w" event={"ID":"6df5c1cf-6fb8-4143-b43a-a087da381f5f","Type":"ContainerStarted","Data":"ca6e9b7c26a091eac8cc5fb4b2bf748f1fcbdf76fb606619d0b2b0de44c82cfe"}
Sep 10 02:56:00.285795 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:00.285765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc" event={"ID":"f1359c33-16b5-412f-8661-0e7df5870676","Type":"ContainerStarted","Data":"0a9997709b10ff2615ea939baeb3d1e267b9e9ccc4ea49cdbd2556fce2e944d9"}
Sep 10 02:56:00.320042 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:00.319990    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc" podStartSLOduration=1.871043376 podStartE2EDuration="4.319972196s" totalImagesPullingTime="2.44892882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:56:00.317502057 +0000 UTC m=+401.105167381" watchObservedRunningTime="2026-09-10 02:56:00.319972196 +0000 UTC m=+401.107637519"
Sep 10 02:56:01.291867 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:01.291774    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8rm5w" event={"ID":"6df5c1cf-6fb8-4143-b43a-a087da381f5f","Type":"ContainerStarted","Data":"0fe071e52533a917a4b01fc7ac42c2c6d6e349ec4d48a306e59ee155dc6f237b"}
Sep 10 02:56:01.292311 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:01.291968    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:56:01.292311 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:01.291990    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8rm5w"
Sep 10 02:56:01.309595 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:01.309544    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8rm5w" podStartSLOduration=1.6858824000000001 podStartE2EDuration="3.309528568s" totalImagesPullingTime="1.623646168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:55:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:56:01.308051438 +0000 UTC m=+402.095716753" watchObservedRunningTime="2026-09-10 02:56:01.309528568 +0000 UTC m=+402.097193885"
Sep 10 02:56:01.375657 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:01.375596    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-4dhc2"]
Sep 10 02:56:01.378838 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:01.378822    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-4dhc2"
Sep 10 02:56:01.382619 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:01.382579    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fkv6h\""
Sep 10 02:56:01.395410 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:01.395388    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-4dhc2"]
Sep 10 02:56:01.443510 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:01.443474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6jpz\" (UniqueName: \"kubernetes.io/projected/4f327683-c873-42f2-8905-1888f775d882-kube-api-access-d6jpz\") pod \"authorino-operator-76b478bd78-4dhc2\" (UID: \"4f327683-c873-42f2-8905-1888f775d882\") " pod="kuadrant-system/authorino-operator-76b478bd78-4dhc2"
Sep 10 02:56:01.544773 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:01.544685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6jpz\" (UniqueName: \"kubernetes.io/projected/4f327683-c873-42f2-8905-1888f775d882-kube-api-access-d6jpz\") pod \"authorino-operator-76b478bd78-4dhc2\" (UID: \"4f327683-c873-42f2-8905-1888f775d882\") " pod="kuadrant-system/authorino-operator-76b478bd78-4dhc2"
Sep 10 02:56:01.554128 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:01.554105    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6jpz\" (UniqueName: \"kubernetes.io/projected/4f327683-c873-42f2-8905-1888f775d882-kube-api-access-d6jpz\") pod \"authorino-operator-76b478bd78-4dhc2\" (UID: \"4f327683-c873-42f2-8905-1888f775d882\") " pod="kuadrant-system/authorino-operator-76b478bd78-4dhc2"
Sep 10 02:56:01.689074 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:01.689034    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-4dhc2"
Sep 10 02:56:01.965796 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:01.965767    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-4dhc2"]
Sep 10 02:56:01.969583 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:56:01.969558    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f327683_c873_42f2_8905_1888f775d882.slice/crio-0a8666fd95de076a2e4341f9853a8298fe5fdc4d269754a539a5c984c8a71b65 WatchSource:0}: Error finding container 0a8666fd95de076a2e4341f9853a8298fe5fdc4d269754a539a5c984c8a71b65: Status 404 returned error can't find the container with id 0a8666fd95de076a2e4341f9853a8298fe5fdc4d269754a539a5c984c8a71b65
Sep 10 02:56:02.167245 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.167210    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"]
Sep 10 02:56:02.171879 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.171859    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"
Sep 10 02:56:02.174797 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.174777    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 10 02:56:02.174880 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.174778    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 10 02:56:02.174880 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.174866    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tks8z\""
Sep 10 02:56:02.178966 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.178944    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"]
Sep 10 02:56:02.251709 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.251632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whbf4\" (UniqueName: \"kubernetes.io/projected/1c2b7278-6896-4c9c-893b-f3bc4273e3ba-kube-api-access-whbf4\") pod \"kuadrant-console-plugin-fbdd4f445-kxtzv\" (UID: \"1c2b7278-6896-4c9c-893b-f3bc4273e3ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"
Sep 10 02:56:02.251709 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.251665    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c2b7278-6896-4c9c-893b-f3bc4273e3ba-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-kxtzv\" (UID: \"1c2b7278-6896-4c9c-893b-f3bc4273e3ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"
Sep 10 02:56:02.251874 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.251774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c2b7278-6896-4c9c-893b-f3bc4273e3ba-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-kxtzv\" (UID: \"1c2b7278-6896-4c9c-893b-f3bc4273e3ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"
Sep 10 02:56:02.297712 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.297676    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-4dhc2" event={"ID":"4f327683-c873-42f2-8905-1888f775d882","Type":"ContainerStarted","Data":"0a8666fd95de076a2e4341f9853a8298fe5fdc4d269754a539a5c984c8a71b65"}
Sep 10 02:56:02.353001 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.352969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c2b7278-6896-4c9c-893b-f3bc4273e3ba-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-kxtzv\" (UID: \"1c2b7278-6896-4c9c-893b-f3bc4273e3ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"
Sep 10 02:56:02.353172 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.353024    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whbf4\" (UniqueName: \"kubernetes.io/projected/1c2b7278-6896-4c9c-893b-f3bc4273e3ba-kube-api-access-whbf4\") pod \"kuadrant-console-plugin-fbdd4f445-kxtzv\" (UID: \"1c2b7278-6896-4c9c-893b-f3bc4273e3ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"
Sep 10 02:56:02.353172 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.353042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c2b7278-6896-4c9c-893b-f3bc4273e3ba-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-kxtzv\" (UID: \"1c2b7278-6896-4c9c-893b-f3bc4273e3ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"
Sep 10 02:56:02.353718 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.353654    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c2b7278-6896-4c9c-893b-f3bc4273e3ba-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-kxtzv\" (UID: \"1c2b7278-6896-4c9c-893b-f3bc4273e3ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"
Sep 10 02:56:02.355532 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.355511    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c2b7278-6896-4c9c-893b-f3bc4273e3ba-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-kxtzv\" (UID: \"1c2b7278-6896-4c9c-893b-f3bc4273e3ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"
Sep 10 02:56:02.361652 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.361605    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whbf4\" (UniqueName: \"kubernetes.io/projected/1c2b7278-6896-4c9c-893b-f3bc4273e3ba-kube-api-access-whbf4\") pod \"kuadrant-console-plugin-fbdd4f445-kxtzv\" (UID: \"1c2b7278-6896-4c9c-893b-f3bc4273e3ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"
Sep 10 02:56:02.482348 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.482316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"
Sep 10 02:56:02.758423 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:02.758381    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv"]
Sep 10 02:56:02.760454 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:56:02.760431    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c2b7278_6896_4c9c_893b_f3bc4273e3ba.slice/crio-5937dc4bcfe8b8725313ce8a632abd1a93db3e6d998ccaf1c2107f1a2a9d3f41 WatchSource:0}: Error finding container 5937dc4bcfe8b8725313ce8a632abd1a93db3e6d998ccaf1c2107f1a2a9d3f41: Status 404 returned error can't find the container with id 5937dc4bcfe8b8725313ce8a632abd1a93db3e6d998ccaf1c2107f1a2a9d3f41
Sep 10 02:56:03.303335 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:03.303293    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv" event={"ID":"1c2b7278-6896-4c9c-893b-f3bc4273e3ba","Type":"ContainerStarted","Data":"5937dc4bcfe8b8725313ce8a632abd1a93db3e6d998ccaf1c2107f1a2a9d3f41"}
Sep 10 02:56:04.310355 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:04.310318    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-4dhc2" event={"ID":"4f327683-c873-42f2-8905-1888f775d882","Type":"ContainerStarted","Data":"07128d28e8889593843ff7ef592ab5cdf1585bbd1b43c9c09b3ab04f581d500e"}
Sep 10 02:56:04.310856 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:04.310465    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-4dhc2"
Sep 10 02:56:04.329241 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:04.329188    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-4dhc2" podStartSLOduration=1.740881436 podStartE2EDuration="3.329171004s" totalImagesPullingTime="1.588289568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:56:04.326759463 +0000 UTC m=+405.114424780" watchObservedRunningTime="2026-09-10 02:56:04.329171004 +0000 UTC m=+405.116836327"
Sep 10 02:56:08.333842 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:08.333809    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv" event={"ID":"1c2b7278-6896-4c9c-893b-f3bc4273e3ba","Type":"ContainerStarted","Data":"4afc6d0af0ac4bc190ff4b722139aaeb3de4345fa18db19a066682aaed2bc8a6"}
Sep 10 02:56:08.350027 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:08.349972    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kxtzv" podStartSLOduration=1.616140987 podStartE2EDuration="6.349954146s" totalImagesPullingTime="4.733813159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:56:08.348642019 +0000 UTC m=+409.136307409" watchObservedRunningTime="2026-09-10 02:56:08.349954146 +0000 UTC m=+409.137619492"
Sep 10 02:56:10.288897 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:10.288865    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:56:12.299853 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.299824    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:56:12.300218 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.299892    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8rm5w"
Sep 10 02:56:12.437321 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.437285    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"]
Sep 10 02:56:12.437482 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.437460    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk" podUID="3e5d2ac7-776d-4074-89f8-99a9591af2ae" containerName="manager" containerID="cri-o://40eeaa06eda6964413e978b1275861c8a84d835e88645a5c695223bd3287e3c8" gracePeriod=2
Sep 10 02:56:12.450417 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.450389    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"]
Sep 10 02:56:12.464912 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:12.464869    2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3e5d2ac7-776d-4074-89f8-99a9591af2ae\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\": pods \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:56:12.480069 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.480035    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"]
Sep 10 02:56:12.480489 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.480467    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e5d2ac7-776d-4074-89f8-99a9591af2ae" containerName="manager"
Sep 10 02:56:12.480585 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.480492    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e5d2ac7-776d-4074-89f8-99a9591af2ae" containerName="manager"
Sep 10 02:56:12.480676 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.480586    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e5d2ac7-776d-4074-89f8-99a9591af2ae" containerName="manager"
Sep 10 02:56:12.483458 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.483434    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"]
Sep 10 02:56:12.483573 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.483478    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"]
Sep 10 02:56:12.483573 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.483551    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"
Sep 10 02:56:12.483703 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.483682    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc" podUID="f1359c33-16b5-412f-8661-0e7df5870676" containerName="manager" containerID="cri-o://0a9997709b10ff2615ea939baeb3d1e267b9e9ccc4ea49cdbd2556fce2e944d9" gracePeriod=2
Sep 10 02:56:12.485919 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:12.485890    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="3e5d2ac7-776d-4074-89f8-99a9591af2ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:56:12.490768 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.490733    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"]
Sep 10 02:56:12.499585 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.499562    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-df8rf"]
Sep 10 02:56:12.499939 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.499922    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1359c33-16b5-412f-8661-0e7df5870676" containerName="manager"
Sep 10 02:56:12.500013 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.499942    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1359c33-16b5-412f-8661-0e7df5870676" containerName="manager"
Sep 10 02:56:12.500071 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.500016    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1359c33-16b5-412f-8661-0e7df5870676" containerName="manager"
Sep 10 02:56:12.502883 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.502865    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-df8rf"
Sep 10 02:56:12.523642 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:12.523584    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xv6tc\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="f1359c33-16b5-412f-8661-0e7df5870676" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:56:12.524332 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.524304    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-df8rf"]
Sep 10 02:56:12.525889 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:12.525863    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="3e5d2ac7-776d-4074-89f8-99a9591af2ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:56:12.528143 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:12.528119    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xv6tc\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="f1359c33-16b5-412f-8661-0e7df5870676" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:56:12.539986 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.539955    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59b61bfd-107b-424a-a5cf-088be40df82c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zwjv8\" (UID: \"59b61bfd-107b-424a-a5cf-088be40df82c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"
Sep 10 02:56:12.540095 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.540026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq2zt\" (UniqueName: \"kubernetes.io/projected/59b61bfd-107b-424a-a5cf-088be40df82c-kube-api-access-bq2zt\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zwjv8\" (UID: \"59b61bfd-107b-424a-a5cf-088be40df82c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"
Sep 10 02:56:12.540095 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.540064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz6qr\" (UniqueName: \"kubernetes.io/projected/be27aefe-a8ed-4f2c-a92d-4c08753593de-kube-api-access-vz6qr\") pod \"limitador-operator-controller-manager-74495c69f8-df8rf\" (UID: \"be27aefe-a8ed-4f2c-a92d-4c08753593de\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-df8rf"
Sep 10 02:56:12.640633 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.640573    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59b61bfd-107b-424a-a5cf-088be40df82c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zwjv8\" (UID: \"59b61bfd-107b-424a-a5cf-088be40df82c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"
Sep 10 02:56:12.640785 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.640663    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2zt\" (UniqueName: \"kubernetes.io/projected/59b61bfd-107b-424a-a5cf-088be40df82c-kube-api-access-bq2zt\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zwjv8\" (UID: \"59b61bfd-107b-424a-a5cf-088be40df82c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"
Sep 10 02:56:12.640785 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.640690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz6qr\" (UniqueName: \"kubernetes.io/projected/be27aefe-a8ed-4f2c-a92d-4c08753593de-kube-api-access-vz6qr\") pod \"limitador-operator-controller-manager-74495c69f8-df8rf\" (UID: \"be27aefe-a8ed-4f2c-a92d-4c08753593de\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-df8rf"
Sep 10 02:56:12.640968 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.640938    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59b61bfd-107b-424a-a5cf-088be40df82c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zwjv8\" (UID: \"59b61bfd-107b-424a-a5cf-088be40df82c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"
Sep 10 02:56:12.660388 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.660339    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq2zt\" (UniqueName: \"kubernetes.io/projected/59b61bfd-107b-424a-a5cf-088be40df82c-kube-api-access-bq2zt\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zwjv8\" (UID: \"59b61bfd-107b-424a-a5cf-088be40df82c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"
Sep 10 02:56:12.661742 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.661676    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz6qr\" (UniqueName: \"kubernetes.io/projected/be27aefe-a8ed-4f2c-a92d-4c08753593de-kube-api-access-vz6qr\") pod \"limitador-operator-controller-manager-74495c69f8-df8rf\" (UID: \"be27aefe-a8ed-4f2c-a92d-4c08753593de\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-df8rf"
Sep 10 02:56:12.717828 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.717804    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:56:12.720394 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:12.720364    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="3e5d2ac7-776d-4074-89f8-99a9591af2ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:56:12.720801 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.720785    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:56:12.722755 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:12.722728    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xv6tc\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="f1359c33-16b5-412f-8661-0e7df5870676" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:56:12.724766 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:12.724746    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="3e5d2ac7-776d-4074-89f8-99a9591af2ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:56:12.726695 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:12.726674    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xv6tc\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="f1359c33-16b5-412f-8661-0e7df5870676" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:56:12.842299 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.842212    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e5d2ac7-776d-4074-89f8-99a9591af2ae-extensions-socket-volume\") pod \"3e5d2ac7-776d-4074-89f8-99a9591af2ae\" (UID: \"3e5d2ac7-776d-4074-89f8-99a9591af2ae\") "
Sep 10 02:56:12.842445 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.842321    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh865\" (UniqueName: \"kubernetes.io/projected/f1359c33-16b5-412f-8661-0e7df5870676-kube-api-access-gh865\") pod \"f1359c33-16b5-412f-8661-0e7df5870676\" (UID: \"f1359c33-16b5-412f-8661-0e7df5870676\") "
Sep 10 02:56:12.842445 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.842351    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsxwq\" (UniqueName: \"kubernetes.io/projected/3e5d2ac7-776d-4074-89f8-99a9591af2ae-kube-api-access-rsxwq\") pod \"3e5d2ac7-776d-4074-89f8-99a9591af2ae\" (UID: \"3e5d2ac7-776d-4074-89f8-99a9591af2ae\") "
Sep 10 02:56:12.842773 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.842747    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e5d2ac7-776d-4074-89f8-99a9591af2ae-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3e5d2ac7-776d-4074-89f8-99a9591af2ae" (UID: "3e5d2ac7-776d-4074-89f8-99a9591af2ae"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 02:56:12.844799 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.844774    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e5d2ac7-776d-4074-89f8-99a9591af2ae-kube-api-access-rsxwq" (OuterVolumeSpecName: "kube-api-access-rsxwq") pod "3e5d2ac7-776d-4074-89f8-99a9591af2ae" (UID: "3e5d2ac7-776d-4074-89f8-99a9591af2ae"). InnerVolumeSpecName "kube-api-access-rsxwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 02:56:12.844862 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.844780    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1359c33-16b5-412f-8661-0e7df5870676-kube-api-access-gh865" (OuterVolumeSpecName: "kube-api-access-gh865") pod "f1359c33-16b5-412f-8661-0e7df5870676" (UID: "f1359c33-16b5-412f-8661-0e7df5870676"). InnerVolumeSpecName "kube-api-access-gh865". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 02:56:12.869119 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.869084    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"
Sep 10 02:56:12.875038 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.875010    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-df8rf"
Sep 10 02:56:12.954638 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.945487    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh865\" (UniqueName: \"kubernetes.io/projected/f1359c33-16b5-412f-8661-0e7df5870676-kube-api-access-gh865\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:56:12.954638 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.945516    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsxwq\" (UniqueName: \"kubernetes.io/projected/3e5d2ac7-776d-4074-89f8-99a9591af2ae-kube-api-access-rsxwq\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:56:12.954638 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:12.945533    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e5d2ac7-776d-4074-89f8-99a9591af2ae-extensions-socket-volume\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:56:13.179039 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.179012    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-df8rf"]
Sep 10 02:56:13.180751 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:56:13.180725    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe27aefe_a8ed_4f2c_a92d_4c08753593de.slice/crio-42db04ea511220764ac86c72b268d208a75a6eaf6fbfb2298d5d49db2a58f18f WatchSource:0}: Error finding container 42db04ea511220764ac86c72b268d208a75a6eaf6fbfb2298d5d49db2a58f18f: Status 404 returned error can't find the container with id 42db04ea511220764ac86c72b268d208a75a6eaf6fbfb2298d5d49db2a58f18f
Sep 10 02:56:13.186669 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.186649    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"]
Sep 10 02:56:13.188506 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:56:13.188485    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b61bfd_107b_424a_a5cf_088be40df82c.slice/crio-131289e4490421f6235cac795e08e1be31eab584d6c02c0801867fe14ea3357b WatchSource:0}: Error finding container 131289e4490421f6235cac795e08e1be31eab584d6c02c0801867fe14ea3357b: Status 404 returned error can't find the container with id 131289e4490421f6235cac795e08e1be31eab584d6c02c0801867fe14ea3357b
Sep 10 02:56:13.357727 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.357699    2564 generic.go:356] "Generic (PLEG): container finished" podID="f1359c33-16b5-412f-8661-0e7df5870676" containerID="0a9997709b10ff2615ea939baeb3d1e267b9e9ccc4ea49cdbd2556fce2e944d9" exitCode=0
Sep 10 02:56:13.358166 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.357745    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:56:13.358166 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.357781    2564 scope.go:117] "RemoveContainer" containerID="0a9997709b10ff2615ea939baeb3d1e267b9e9ccc4ea49cdbd2556fce2e944d9"
Sep 10 02:56:13.359735 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.359707    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-df8rf" event={"ID":"be27aefe-a8ed-4f2c-a92d-4c08753593de","Type":"ContainerStarted","Data":"823140f4758068c810ec6d65b726e3f58b7baec99a6811a0b6e15132cd8c40e2"}
Sep 10 02:56:13.359865 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.359765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-df8rf" event={"ID":"be27aefe-a8ed-4f2c-a92d-4c08753593de","Type":"ContainerStarted","Data":"42db04ea511220764ac86c72b268d208a75a6eaf6fbfb2298d5d49db2a58f18f"}
Sep 10 02:56:13.359933 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.359883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-df8rf"
Sep 10 02:56:13.360073 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:13.360047    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="3e5d2ac7-776d-4074-89f8-99a9591af2ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:56:13.361787 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.361761    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8" event={"ID":"59b61bfd-107b-424a-a5cf-088be40df82c","Type":"ContainerStarted","Data":"4fc6a9790d4502a0f6d4baa030bd61b05ec8e87511741a5a00d146b4b508b46f"}
Sep 10 02:56:13.361879 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.361810    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8" event={"ID":"59b61bfd-107b-424a-a5cf-088be40df82c","Type":"ContainerStarted","Data":"131289e4490421f6235cac795e08e1be31eab584d6c02c0801867fe14ea3357b"}
Sep 10 02:56:13.361879 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.361841    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"
Sep 10 02:56:13.361992 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:13.361961    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xv6tc\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="f1359c33-16b5-412f-8661-0e7df5870676" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:56:13.363451 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.363429    2564 generic.go:356] "Generic (PLEG): container finished" podID="3e5d2ac7-776d-4074-89f8-99a9591af2ae" containerID="40eeaa06eda6964413e978b1275861c8a84d835e88645a5c695223bd3287e3c8" exitCode=0
Sep 10 02:56:13.363579 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.363461    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:56:13.363917 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:13.363896    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="3e5d2ac7-776d-4074-89f8-99a9591af2ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:56:13.368048 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.368034    2564 scope.go:117] "RemoveContainer" containerID="0a9997709b10ff2615ea939baeb3d1e267b9e9ccc4ea49cdbd2556fce2e944d9"
Sep 10 02:56:13.368339 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:13.368320    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a9997709b10ff2615ea939baeb3d1e267b9e9ccc4ea49cdbd2556fce2e944d9\": container with ID starting with 0a9997709b10ff2615ea939baeb3d1e267b9e9ccc4ea49cdbd2556fce2e944d9 not found: ID does not exist" containerID="0a9997709b10ff2615ea939baeb3d1e267b9e9ccc4ea49cdbd2556fce2e944d9"
Sep 10 02:56:13.368393 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.368347    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a9997709b10ff2615ea939baeb3d1e267b9e9ccc4ea49cdbd2556fce2e944d9"} err="failed to get container status \"0a9997709b10ff2615ea939baeb3d1e267b9e9ccc4ea49cdbd2556fce2e944d9\": rpc error: code = NotFound desc = could not find container \"0a9997709b10ff2615ea939baeb3d1e267b9e9ccc4ea49cdbd2556fce2e944d9\": container with ID starting with 0a9997709b10ff2615ea939baeb3d1e267b9e9ccc4ea49cdbd2556fce2e944d9 not found: ID does not exist"
Sep 10 02:56:13.368393 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.368362    2564 scope.go:117] "RemoveContainer" containerID="40eeaa06eda6964413e978b1275861c8a84d835e88645a5c695223bd3287e3c8"
Sep 10 02:56:13.376143 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.376124    2564 scope.go:117] "RemoveContainer" containerID="40eeaa06eda6964413e978b1275861c8a84d835e88645a5c695223bd3287e3c8"
Sep 10 02:56:13.376418 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:13.376400    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40eeaa06eda6964413e978b1275861c8a84d835e88645a5c695223bd3287e3c8\": container with ID starting with 40eeaa06eda6964413e978b1275861c8a84d835e88645a5c695223bd3287e3c8 not found: ID does not exist" containerID="40eeaa06eda6964413e978b1275861c8a84d835e88645a5c695223bd3287e3c8"
Sep 10 02:56:13.376479 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.376427    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40eeaa06eda6964413e978b1275861c8a84d835e88645a5c695223bd3287e3c8"} err="failed to get container status \"40eeaa06eda6964413e978b1275861c8a84d835e88645a5c695223bd3287e3c8\": rpc error: code = NotFound desc = could not find container \"40eeaa06eda6964413e978b1275861c8a84d835e88645a5c695223bd3287e3c8\": container with ID starting with 40eeaa06eda6964413e978b1275861c8a84d835e88645a5c695223bd3287e3c8 not found: ID does not exist"
Sep 10 02:56:13.387037 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.386998    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8" podStartSLOduration=1.386985169 podStartE2EDuration="1.386985169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:56:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:56:13.386279845 +0000 UTC m=+414.173945210" watchObservedRunningTime="2026-09-10 02:56:13.386985169 +0000 UTC m=+414.174650487"
Sep 10 02:56:13.388387 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:13.388363    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xv6tc\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="f1359c33-16b5-412f-8661-0e7df5870676" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:56:13.408302 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.408257    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-df8rf" podStartSLOduration=1.408248253 podStartE2EDuration="1.408248253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:56:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:56:13.406976505 +0000 UTC m=+414.194641816" watchObservedRunningTime="2026-09-10 02:56:13.408248253 +0000 UTC m=+414.195913571"
Sep 10 02:56:13.409083 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:13.409057    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hg9zk\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="3e5d2ac7-776d-4074-89f8-99a9591af2ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hg9zk"
Sep 10 02:56:13.411162 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:56:13.411131    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xv6tc\" is forbidden: User \"system:node:ip-10-0-143-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-198.ec2.internal' and this object" podUID="f1359c33-16b5-412f-8661-0e7df5870676" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xv6tc"
Sep 10 02:56:13.726995 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.726921    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e5d2ac7-776d-4074-89f8-99a9591af2ae" path="/var/lib/kubelet/pods/3e5d2ac7-776d-4074-89f8-99a9591af2ae/volumes"
Sep 10 02:56:13.727265 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:13.727252    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1359c33-16b5-412f-8661-0e7df5870676" path="/var/lib/kubelet/pods/f1359c33-16b5-412f-8661-0e7df5870676/volumes"
Sep 10 02:56:15.318792 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:15.318765    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-4dhc2"
Sep 10 02:56:24.371944 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:24.371916    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-df8rf"
Sep 10 02:56:24.372336 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:24.371979    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"
Sep 10 02:56:28.226030 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:28.225992    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"]
Sep 10 02:56:28.226380 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:28.226220    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8" podUID="59b61bfd-107b-424a-a5cf-088be40df82c" containerName="manager" containerID="cri-o://4fc6a9790d4502a0f6d4baa030bd61b05ec8e87511741a5a00d146b4b508b46f" gracePeriod=10
Sep 10 02:56:28.434300 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:28.434269    2564 generic.go:356] "Generic (PLEG): container finished" podID="59b61bfd-107b-424a-a5cf-088be40df82c" containerID="4fc6a9790d4502a0f6d4baa030bd61b05ec8e87511741a5a00d146b4b508b46f" exitCode=0
Sep 10 02:56:28.434457 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:28.434338    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8" event={"ID":"59b61bfd-107b-424a-a5cf-088be40df82c","Type":"ContainerDied","Data":"4fc6a9790d4502a0f6d4baa030bd61b05ec8e87511741a5a00d146b4b508b46f"}
Sep 10 02:56:28.468930 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:28.468906    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"
Sep 10 02:56:28.572759 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:28.572671    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq2zt\" (UniqueName: \"kubernetes.io/projected/59b61bfd-107b-424a-a5cf-088be40df82c-kube-api-access-bq2zt\") pod \"59b61bfd-107b-424a-a5cf-088be40df82c\" (UID: \"59b61bfd-107b-424a-a5cf-088be40df82c\") "
Sep 10 02:56:28.572759 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:28.572743    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59b61bfd-107b-424a-a5cf-088be40df82c-extensions-socket-volume\") pod \"59b61bfd-107b-424a-a5cf-088be40df82c\" (UID: \"59b61bfd-107b-424a-a5cf-088be40df82c\") "
Sep 10 02:56:28.573171 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:28.573142    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59b61bfd-107b-424a-a5cf-088be40df82c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "59b61bfd-107b-424a-a5cf-088be40df82c" (UID: "59b61bfd-107b-424a-a5cf-088be40df82c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 02:56:28.574963 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:28.574944    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59b61bfd-107b-424a-a5cf-088be40df82c-kube-api-access-bq2zt" (OuterVolumeSpecName: "kube-api-access-bq2zt") pod "59b61bfd-107b-424a-a5cf-088be40df82c" (UID: "59b61bfd-107b-424a-a5cf-088be40df82c"). InnerVolumeSpecName "kube-api-access-bq2zt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 02:56:28.673512 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:28.673473    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59b61bfd-107b-424a-a5cf-088be40df82c-extensions-socket-volume\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:56:28.673512 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:28.673504    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq2zt\" (UniqueName: \"kubernetes.io/projected/59b61bfd-107b-424a-a5cf-088be40df82c-kube-api-access-bq2zt\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:56:29.440436 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:29.440401    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8" event={"ID":"59b61bfd-107b-424a-a5cf-088be40df82c","Type":"ContainerDied","Data":"131289e4490421f6235cac795e08e1be31eab584d6c02c0801867fe14ea3357b"}
Sep 10 02:56:29.440856 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:29.440445    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"
Sep 10 02:56:29.440856 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:29.440488    2564 scope.go:117] "RemoveContainer" containerID="4fc6a9790d4502a0f6d4baa030bd61b05ec8e87511741a5a00d146b4b508b46f"
Sep 10 02:56:29.464801 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:29.464767    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"]
Sep 10 02:56:29.471018 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:29.470994    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zwjv8"]
Sep 10 02:56:29.726872 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:29.726797    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59b61bfd-107b-424a-a5cf-088be40df82c" path="/var/lib/kubelet/pods/59b61bfd-107b-424a-a5cf-088be40df82c/volumes"
Sep 10 02:56:44.527409 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.527314    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"]
Sep 10 02:56:44.527956 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.527791    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b61bfd-107b-424a-a5cf-088be40df82c" containerName="manager"
Sep 10 02:56:44.527956 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.527810    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b61bfd-107b-424a-a5cf-088be40df82c" containerName="manager"
Sep 10 02:56:44.527956 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.527902    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="59b61bfd-107b-424a-a5cf-088be40df82c" containerName="manager"
Sep 10 02:56:44.532852 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.532829    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.535494 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.535463    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 02:56:44.535652 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.535514    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5sfnk\""
Sep 10 02:56:44.541801 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.541375    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"]
Sep 10 02:56:44.700995 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.700951    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24a0331e-2321-4c75-8f8f-67f168e2d160-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.701180 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.701007    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58vdh\" (UniqueName: \"kubernetes.io/projected/24a0331e-2321-4c75-8f8f-67f168e2d160-kube-api-access-58vdh\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.701180 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.701072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24a0331e-2321-4c75-8f8f-67f168e2d160-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.701180 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.701100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.701180 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.701151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.701330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.701211    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24a0331e-2321-4c75-8f8f-67f168e2d160-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.701330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.701244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.701330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.701278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.701330 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.701303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.802189 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.802106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.802189 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.802150    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.802189 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.802171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.802463 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.802194    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24a0331e-2321-4c75-8f8f-67f168e2d160-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.802463 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.802214    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58vdh\" (UniqueName: \"kubernetes.io/projected/24a0331e-2321-4c75-8f8f-67f168e2d160-kube-api-access-58vdh\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.802463 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.802240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24a0331e-2321-4c75-8f8f-67f168e2d160-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.802463 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.802261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.802463 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.802278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.802463 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.802328    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24a0331e-2321-4c75-8f8f-67f168e2d160-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.802755 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.802652    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.802914 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.802888    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.803009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.802917    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.803057 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.803031    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.803121 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.803101    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24a0331e-2321-4c75-8f8f-67f168e2d160-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.804966 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.804944    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24a0331e-2321-4c75-8f8f-67f168e2d160-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.805356 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.805339    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24a0331e-2321-4c75-8f8f-67f168e2d160-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.810047 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.810026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24a0331e-2321-4c75-8f8f-67f168e2d160-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.810305 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.810284    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58vdh\" (UniqueName: \"kubernetes.io/projected/24a0331e-2321-4c75-8f8f-67f168e2d160-kube-api-access-58vdh\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s7n4k\" (UID: \"24a0331e-2321-4c75-8f8f-67f168e2d160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:44.845277 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:44.845246    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:45.118273 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:45.118249    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"]
Sep 10 02:56:45.120741 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:56:45.120715    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a0331e_2321_4c75_8f8f_67f168e2d160.slice/crio-7a8ca2753955bffc346ee86c29bb3944817c89bb8cafe0393cc83f44ea481aef WatchSource:0}: Error finding container 7a8ca2753955bffc346ee86c29bb3944817c89bb8cafe0393cc83f44ea481aef: Status 404 returned error can't find the container with id 7a8ca2753955bffc346ee86c29bb3944817c89bb8cafe0393cc83f44ea481aef
Sep 10 02:56:45.509849 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:45.509819    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k" event={"ID":"24a0331e-2321-4c75-8f8f-67f168e2d160","Type":"ContainerStarted","Data":"7a8ca2753955bffc346ee86c29bb3944817c89bb8cafe0393cc83f44ea481aef"}
Sep 10 02:56:47.636436 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:47.636400    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 02:56:47.636695 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:47.636473    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 02:56:47.636695 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:47.636500    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 02:56:48.526913 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:48.526876    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k" event={"ID":"24a0331e-2321-4c75-8f8f-67f168e2d160","Type":"ContainerStarted","Data":"8d6c73ae3d129e97cb24a22ed7a01612969a8f81a3f8a3f834b12898bfc7093b"}
Sep 10 02:56:48.548179 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:48.548128    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k" podStartSLOduration=2.035159672 podStartE2EDuration="4.548111126s" totalImagesPullingTime="2.512951454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:56:48.546573367 +0000 UTC m=+449.334238683" watchObservedRunningTime="2026-09-10 02:56:48.548111126 +0000 UTC m=+449.335776444"
Sep 10 02:56:48.846132 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:48.846042    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:48.850748 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:48.850722    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:49.513507 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.513472    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ktwnm"]
Sep 10 02:56:49.516869 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.516847    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-ktwnm"
Sep 10 02:56:49.519605 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.519585    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 02:56:49.524922 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.524901    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ktwnm"]
Sep 10 02:56:49.531833 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.531811    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:49.532841 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.532822    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:56:49.608535 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.608501    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ktwnm"]
Sep 10 02:56:49.643761 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.643731    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj2mn\" (UniqueName: \"kubernetes.io/projected/2a8fba98-3843-4549-9111-decd43249249-kube-api-access-nj2mn\") pod \"limitador-limitador-8588749977-ktwnm\" (UID: \"2a8fba98-3843-4549-9111-decd43249249\") " pod="kuadrant-system/limitador-limitador-8588749977-ktwnm"
Sep 10 02:56:49.643949 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.643790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a8fba98-3843-4549-9111-decd43249249-config-file\") pod \"limitador-limitador-8588749977-ktwnm\" (UID: \"2a8fba98-3843-4549-9111-decd43249249\") " pod="kuadrant-system/limitador-limitador-8588749977-ktwnm"
Sep 10 02:56:49.744546 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.744512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a8fba98-3843-4549-9111-decd43249249-config-file\") pod \"limitador-limitador-8588749977-ktwnm\" (UID: \"2a8fba98-3843-4549-9111-decd43249249\") " pod="kuadrant-system/limitador-limitador-8588749977-ktwnm"
Sep 10 02:56:49.744723 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.744604    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj2mn\" (UniqueName: \"kubernetes.io/projected/2a8fba98-3843-4549-9111-decd43249249-kube-api-access-nj2mn\") pod \"limitador-limitador-8588749977-ktwnm\" (UID: \"2a8fba98-3843-4549-9111-decd43249249\") " pod="kuadrant-system/limitador-limitador-8588749977-ktwnm"
Sep 10 02:56:49.745131 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.745111    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a8fba98-3843-4549-9111-decd43249249-config-file\") pod \"limitador-limitador-8588749977-ktwnm\" (UID: \"2a8fba98-3843-4549-9111-decd43249249\") " pod="kuadrant-system/limitador-limitador-8588749977-ktwnm"
Sep 10 02:56:49.752937 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.752905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj2mn\" (UniqueName: \"kubernetes.io/projected/2a8fba98-3843-4549-9111-decd43249249-kube-api-access-nj2mn\") pod \"limitador-limitador-8588749977-ktwnm\" (UID: \"2a8fba98-3843-4549-9111-decd43249249\") " pod="kuadrant-system/limitador-limitador-8588749977-ktwnm"
Sep 10 02:56:49.827880 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.827789    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-ktwnm"
Sep 10 02:56:49.913779 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.913750    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"]
Sep 10 02:56:49.917849 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.917833    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"
Sep 10 02:56:49.939668 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.939604    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"]
Sep 10 02:56:49.969534 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:49.969500    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"]
Sep 10 02:56:50.047305 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.047269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc-config-file\") pod \"limitador-limitador-84994f7ffc-lfcf2\" (UID: \"006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"
Sep 10 02:56:50.047492 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.047324    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8pdj\" (UniqueName: \"kubernetes.io/projected/006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc-kube-api-access-s8pdj\") pod \"limitador-limitador-84994f7ffc-lfcf2\" (UID: \"006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"
Sep 10 02:56:50.096904 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.096880    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ktwnm"]
Sep 10 02:56:50.099521 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:56:50.099495    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8fba98_3843_4549_9111_decd43249249.slice/crio-f2a4d192407b0a3309f8cd17a1cb32c4f5ca1bb1271ef364c8b8cb556332246f WatchSource:0}: Error finding container f2a4d192407b0a3309f8cd17a1cb32c4f5ca1bb1271ef364c8b8cb556332246f: Status 404 returned error can't find the container with id f2a4d192407b0a3309f8cd17a1cb32c4f5ca1bb1271ef364c8b8cb556332246f
Sep 10 02:56:50.148750 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.148718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8pdj\" (UniqueName: \"kubernetes.io/projected/006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc-kube-api-access-s8pdj\") pod \"limitador-limitador-84994f7ffc-lfcf2\" (UID: \"006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"
Sep 10 02:56:50.148868 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.148789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc-config-file\") pod \"limitador-limitador-84994f7ffc-lfcf2\" (UID: \"006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"
Sep 10 02:56:50.149319 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.149301    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc-config-file\") pod \"limitador-limitador-84994f7ffc-lfcf2\" (UID: \"006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"
Sep 10 02:56:50.160471 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.160437    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8pdj\" (UniqueName: \"kubernetes.io/projected/006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc-kube-api-access-s8pdj\") pod \"limitador-limitador-84994f7ffc-lfcf2\" (UID: \"006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"
Sep 10 02:56:50.227778 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.227745    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"
Sep 10 02:56:50.497579 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.497532    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"]
Sep 10 02:56:50.499706 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:56:50.499677    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod006e1f5b_eba6_4a5a_a71d_d4f5a1f621cc.slice/crio-e2829afed2aeffcaa1cc6233e88834cc4abfe6dc17e7b5390cb5cac55bc24b15 WatchSource:0}: Error finding container e2829afed2aeffcaa1cc6233e88834cc4abfe6dc17e7b5390cb5cac55bc24b15: Status 404 returned error can't find the container with id e2829afed2aeffcaa1cc6233e88834cc4abfe6dc17e7b5390cb5cac55bc24b15
Sep 10 02:56:50.537535 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.537493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-lfcf2" event={"ID":"006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc","Type":"ContainerStarted","Data":"e2829afed2aeffcaa1cc6233e88834cc4abfe6dc17e7b5390cb5cac55bc24b15"}
Sep 10 02:56:50.538912 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.538887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-ktwnm" event={"ID":"2a8fba98-3843-4549-9111-decd43249249","Type":"ContainerStarted","Data":"f2a4d192407b0a3309f8cd17a1cb32c4f5ca1bb1271ef364c8b8cb556332246f"}
Sep 10 02:56:50.569557 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.569531    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-jh7ch"]
Sep 10 02:56:50.573845 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.573828    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-jh7ch"
Sep 10 02:56:50.576663 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.576642    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-v9vxt\""
Sep 10 02:56:50.579624 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.579583    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-jh7ch"]
Sep 10 02:56:50.755430 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.755341    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfrnc\" (UniqueName: \"kubernetes.io/projected/676ad5ec-e2cc-4f13-8950-2e3582ed7902-kube-api-access-hfrnc\") pod \"authorino-59c974bd48-jh7ch\" (UID: \"676ad5ec-e2cc-4f13-8950-2e3582ed7902\") " pod="kuadrant-system/authorino-59c974bd48-jh7ch"
Sep 10 02:56:50.856818 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.856779    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfrnc\" (UniqueName: \"kubernetes.io/projected/676ad5ec-e2cc-4f13-8950-2e3582ed7902-kube-api-access-hfrnc\") pod \"authorino-59c974bd48-jh7ch\" (UID: \"676ad5ec-e2cc-4f13-8950-2e3582ed7902\") " pod="kuadrant-system/authorino-59c974bd48-jh7ch"
Sep 10 02:56:50.864945 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.864916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfrnc\" (UniqueName: \"kubernetes.io/projected/676ad5ec-e2cc-4f13-8950-2e3582ed7902-kube-api-access-hfrnc\") pod \"authorino-59c974bd48-jh7ch\" (UID: \"676ad5ec-e2cc-4f13-8950-2e3582ed7902\") " pod="kuadrant-system/authorino-59c974bd48-jh7ch"
Sep 10 02:56:50.883881 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:50.883846    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-jh7ch"
Sep 10 02:56:51.151497 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:51.151399    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-jh7ch"]
Sep 10 02:56:51.154865 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:56:51.154835    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod676ad5ec_e2cc_4f13_8950_2e3582ed7902.slice/crio-f56e2c872c90a38359bf6e521309a13dc2ca39b9a24ab5d98132b4ec1dbdcf04 WatchSource:0}: Error finding container f56e2c872c90a38359bf6e521309a13dc2ca39b9a24ab5d98132b4ec1dbdcf04: Status 404 returned error can't find the container with id f56e2c872c90a38359bf6e521309a13dc2ca39b9a24ab5d98132b4ec1dbdcf04
Sep 10 02:56:51.544245 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:51.544215    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-jh7ch" event={"ID":"676ad5ec-e2cc-4f13-8950-2e3582ed7902","Type":"ContainerStarted","Data":"f56e2c872c90a38359bf6e521309a13dc2ca39b9a24ab5d98132b4ec1dbdcf04"}
Sep 10 02:56:52.550887 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:52.550850    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-lfcf2" event={"ID":"006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc","Type":"ContainerStarted","Data":"9199afdadf95be2213768dd439d1f7ff0e9dcc027a580cebcf43d1afd3964213"}
Sep 10 02:56:52.551586 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:52.551563    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"
Sep 10 02:56:52.553587 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:52.553525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-ktwnm" event={"ID":"2a8fba98-3843-4549-9111-decd43249249","Type":"ContainerStarted","Data":"d1164a4be105c0724c2a8c303186736e31cc6c7e2fd5dcf4a85b4a3ba8d02d41"}
Sep 10 02:56:52.553797 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:52.553749    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-ktwnm"
Sep 10 02:56:52.570166 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:52.570086    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-lfcf2" podStartSLOduration=2.534413057 podStartE2EDuration="3.570066533s" totalImagesPullingTime="1.035653476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:56:52.569787697 +0000 UTC m=+453.357453014" watchObservedRunningTime="2026-09-10 02:56:52.570066533 +0000 UTC m=+453.357731868"
Sep 10 02:56:52.588305 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:52.588244    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-ktwnm" podStartSLOduration=2.151300189 podStartE2EDuration="3.588227353s" totalImagesPullingTime="1.436927164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:56:52.586816086 +0000 UTC m=+453.374481403" watchObservedRunningTime="2026-09-10 02:56:52.588227353 +0000 UTC m=+453.375892670"
Sep 10 02:56:53.559677 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:53.559637    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-jh7ch" event={"ID":"676ad5ec-e2cc-4f13-8950-2e3582ed7902","Type":"ContainerStarted","Data":"33d949f0b3c1cf7ec21baf120201a1f6b94a087ef1c44258af4d6c8dbfbed7be"}
Sep 10 02:56:53.574248 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:56:53.574198    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-jh7ch" podStartSLOduration=2.071111701 podStartE2EDuration="3.574181939s" totalImagesPullingTime="1.503070238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:56:53.573199803 +0000 UTC m=+454.360865121" watchObservedRunningTime="2026-09-10 02:56:53.574181939 +0000 UTC m=+454.361847255"
Sep 10 02:57:03.561059 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:03.561023    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-ktwnm"
Sep 10 02:57:04.565583 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:04.565547    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"
Sep 10 02:57:04.609891 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:04.609863    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ktwnm"]
Sep 10 02:57:04.611548 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:04.611477    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-ktwnm" podUID="2a8fba98-3843-4549-9111-decd43249249" containerName="limitador" containerID="cri-o://d1164a4be105c0724c2a8c303186736e31cc6c7e2fd5dcf4a85b4a3ba8d02d41" gracePeriod=30
Sep 10 02:57:05.153115 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.153092    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-ktwnm"
Sep 10 02:57:05.176570 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.176502    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a8fba98-3843-4549-9111-decd43249249-config-file\") pod \"2a8fba98-3843-4549-9111-decd43249249\" (UID: \"2a8fba98-3843-4549-9111-decd43249249\") "
Sep 10 02:57:05.176570 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.176543    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj2mn\" (UniqueName: \"kubernetes.io/projected/2a8fba98-3843-4549-9111-decd43249249-kube-api-access-nj2mn\") pod \"2a8fba98-3843-4549-9111-decd43249249\" (UID: \"2a8fba98-3843-4549-9111-decd43249249\") "
Sep 10 02:57:05.176902 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.176880    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a8fba98-3843-4549-9111-decd43249249-config-file" (OuterVolumeSpecName: "config-file") pod "2a8fba98-3843-4549-9111-decd43249249" (UID: "2a8fba98-3843-4549-9111-decd43249249"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 02:57:05.178727 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.178707    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a8fba98-3843-4549-9111-decd43249249-kube-api-access-nj2mn" (OuterVolumeSpecName: "kube-api-access-nj2mn") pod "2a8fba98-3843-4549-9111-decd43249249" (UID: "2a8fba98-3843-4549-9111-decd43249249"). InnerVolumeSpecName "kube-api-access-nj2mn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 02:57:05.277402 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.277364    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a8fba98-3843-4549-9111-decd43249249-config-file\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:57:05.277402 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.277394    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj2mn\" (UniqueName: \"kubernetes.io/projected/2a8fba98-3843-4549-9111-decd43249249-kube-api-access-nj2mn\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:57:05.616739 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.616663    2564 generic.go:356] "Generic (PLEG): container finished" podID="2a8fba98-3843-4549-9111-decd43249249" containerID="d1164a4be105c0724c2a8c303186736e31cc6c7e2fd5dcf4a85b4a3ba8d02d41" exitCode=0
Sep 10 02:57:05.616739 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.616712    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-ktwnm"
Sep 10 02:57:05.617190 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.616749    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-ktwnm" event={"ID":"2a8fba98-3843-4549-9111-decd43249249","Type":"ContainerDied","Data":"d1164a4be105c0724c2a8c303186736e31cc6c7e2fd5dcf4a85b4a3ba8d02d41"}
Sep 10 02:57:05.617190 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.616798    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-ktwnm" event={"ID":"2a8fba98-3843-4549-9111-decd43249249","Type":"ContainerDied","Data":"f2a4d192407b0a3309f8cd17a1cb32c4f5ca1bb1271ef364c8b8cb556332246f"}
Sep 10 02:57:05.617190 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.616819    2564 scope.go:117] "RemoveContainer" containerID="d1164a4be105c0724c2a8c303186736e31cc6c7e2fd5dcf4a85b4a3ba8d02d41"
Sep 10 02:57:05.625484 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.625465    2564 scope.go:117] "RemoveContainer" containerID="d1164a4be105c0724c2a8c303186736e31cc6c7e2fd5dcf4a85b4a3ba8d02d41"
Sep 10 02:57:05.625771 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:57:05.625753    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1164a4be105c0724c2a8c303186736e31cc6c7e2fd5dcf4a85b4a3ba8d02d41\": container with ID starting with d1164a4be105c0724c2a8c303186736e31cc6c7e2fd5dcf4a85b4a3ba8d02d41 not found: ID does not exist" containerID="d1164a4be105c0724c2a8c303186736e31cc6c7e2fd5dcf4a85b4a3ba8d02d41"
Sep 10 02:57:05.625847 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.625785    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1164a4be105c0724c2a8c303186736e31cc6c7e2fd5dcf4a85b4a3ba8d02d41"} err="failed to get container status \"d1164a4be105c0724c2a8c303186736e31cc6c7e2fd5dcf4a85b4a3ba8d02d41\": rpc error: code = NotFound desc = could not find container \"d1164a4be105c0724c2a8c303186736e31cc6c7e2fd5dcf4a85b4a3ba8d02d41\": container with ID starting with d1164a4be105c0724c2a8c303186736e31cc6c7e2fd5dcf4a85b4a3ba8d02d41 not found: ID does not exist"
Sep 10 02:57:05.652757 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.652719    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ktwnm"]
Sep 10 02:57:05.657415 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.657386    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ktwnm"]
Sep 10 02:57:05.726970 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:05.726938    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a8fba98-3843-4549-9111-decd43249249" path="/var/lib/kubelet/pods/2a8fba98-3843-4549-9111-decd43249249/volumes"
Sep 10 02:57:18.718076 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.718044    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-vdlds"]
Sep 10 02:57:18.718524 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.718372    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a8fba98-3843-4549-9111-decd43249249" containerName="limitador"
Sep 10 02:57:18.718524 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.718382    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a8fba98-3843-4549-9111-decd43249249" containerName="limitador"
Sep 10 02:57:18.718524 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.718444    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a8fba98-3843-4549-9111-decd43249249" containerName="limitador"
Sep 10 02:57:18.726669 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.726637    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-vdlds"
Sep 10 02:57:18.728499 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.728472    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-vdlds"]
Sep 10 02:57:18.729425 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.729406    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 10 02:57:18.790897 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.790863    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-vdlds"]
Sep 10 02:57:18.791119 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:57:18.791101    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-466c4 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-vdlds" podUID="6864b14f-204b-4772-85aa-81bcf63dffef"
Sep 10 02:57:18.793779 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.793756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-466c4\" (UniqueName: \"kubernetes.io/projected/6864b14f-204b-4772-85aa-81bcf63dffef-kube-api-access-466c4\") pod \"authorino-6d4dfc649f-vdlds\" (UID: \"6864b14f-204b-4772-85aa-81bcf63dffef\") " pod="kuadrant-system/authorino-6d4dfc649f-vdlds"
Sep 10 02:57:18.793886 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.793869    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6864b14f-204b-4772-85aa-81bcf63dffef-tls-cert\") pod \"authorino-6d4dfc649f-vdlds\" (UID: \"6864b14f-204b-4772-85aa-81bcf63dffef\") " pod="kuadrant-system/authorino-6d4dfc649f-vdlds"
Sep 10 02:57:18.895206 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.895164    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6864b14f-204b-4772-85aa-81bcf63dffef-tls-cert\") pod \"authorino-6d4dfc649f-vdlds\" (UID: \"6864b14f-204b-4772-85aa-81bcf63dffef\") " pod="kuadrant-system/authorino-6d4dfc649f-vdlds"
Sep 10 02:57:18.895424 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.895231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-466c4\" (UniqueName: \"kubernetes.io/projected/6864b14f-204b-4772-85aa-81bcf63dffef-kube-api-access-466c4\") pod \"authorino-6d4dfc649f-vdlds\" (UID: \"6864b14f-204b-4772-85aa-81bcf63dffef\") " pod="kuadrant-system/authorino-6d4dfc649f-vdlds"
Sep 10 02:57:18.897798 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.897775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6864b14f-204b-4772-85aa-81bcf63dffef-tls-cert\") pod \"authorino-6d4dfc649f-vdlds\" (UID: \"6864b14f-204b-4772-85aa-81bcf63dffef\") " pod="kuadrant-system/authorino-6d4dfc649f-vdlds"
Sep 10 02:57:18.903581 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:18.903560    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-466c4\" (UniqueName: \"kubernetes.io/projected/6864b14f-204b-4772-85aa-81bcf63dffef-kube-api-access-466c4\") pod \"authorino-6d4dfc649f-vdlds\" (UID: \"6864b14f-204b-4772-85aa-81bcf63dffef\") " pod="kuadrant-system/authorino-6d4dfc649f-vdlds"
Sep 10 02:57:19.677689 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:19.677661    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-vdlds"
Sep 10 02:57:19.686020 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:19.685999    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-vdlds"
Sep 10 02:57:19.802994 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:19.802946    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6864b14f-204b-4772-85aa-81bcf63dffef-tls-cert\") pod \"6864b14f-204b-4772-85aa-81bcf63dffef\" (UID: \"6864b14f-204b-4772-85aa-81bcf63dffef\") "
Sep 10 02:57:19.803382 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:19.803013    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-466c4\" (UniqueName: \"kubernetes.io/projected/6864b14f-204b-4772-85aa-81bcf63dffef-kube-api-access-466c4\") pod \"6864b14f-204b-4772-85aa-81bcf63dffef\" (UID: \"6864b14f-204b-4772-85aa-81bcf63dffef\") "
Sep 10 02:57:19.805293 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:19.805258    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6864b14f-204b-4772-85aa-81bcf63dffef-kube-api-access-466c4" (OuterVolumeSpecName: "kube-api-access-466c4") pod "6864b14f-204b-4772-85aa-81bcf63dffef" (UID: "6864b14f-204b-4772-85aa-81bcf63dffef"). InnerVolumeSpecName "kube-api-access-466c4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 02:57:19.805293 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:19.805276    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6864b14f-204b-4772-85aa-81bcf63dffef-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6864b14f-204b-4772-85aa-81bcf63dffef" (UID: "6864b14f-204b-4772-85aa-81bcf63dffef"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 02:57:19.903971 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:19.903945    2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6864b14f-204b-4772-85aa-81bcf63dffef-tls-cert\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:57:19.903971 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:19.903973    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-466c4\" (UniqueName: \"kubernetes.io/projected/6864b14f-204b-4772-85aa-81bcf63dffef-kube-api-access-466c4\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:57:20.543871 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:20.543836    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-jh7ch"]
Sep 10 02:57:20.544207 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:20.544154    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-jh7ch" podUID="676ad5ec-e2cc-4f13-8950-2e3582ed7902" containerName="authorino" containerID="cri-o://33d949f0b3c1cf7ec21baf120201a1f6b94a087ef1c44258af4d6c8dbfbed7be" gracePeriod=30
Sep 10 02:57:20.683643 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:20.683588    2564 generic.go:356] "Generic (PLEG): container finished" podID="676ad5ec-e2cc-4f13-8950-2e3582ed7902" containerID="33d949f0b3c1cf7ec21baf120201a1f6b94a087ef1c44258af4d6c8dbfbed7be" exitCode=0
Sep 10 02:57:20.683808 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:20.683642    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-jh7ch" event={"ID":"676ad5ec-e2cc-4f13-8950-2e3582ed7902","Type":"ContainerDied","Data":"33d949f0b3c1cf7ec21baf120201a1f6b94a087ef1c44258af4d6c8dbfbed7be"}
Sep 10 02:57:20.683808 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:20.683758    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-vdlds"
Sep 10 02:57:20.712837 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:20.712803    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-vdlds"]
Sep 10 02:57:20.714398 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:20.714373    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-vdlds"]
Sep 10 02:57:20.804355 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:20.804289    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-jh7ch"
Sep 10 02:57:20.913187 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:20.913148    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfrnc\" (UniqueName: \"kubernetes.io/projected/676ad5ec-e2cc-4f13-8950-2e3582ed7902-kube-api-access-hfrnc\") pod \"676ad5ec-e2cc-4f13-8950-2e3582ed7902\" (UID: \"676ad5ec-e2cc-4f13-8950-2e3582ed7902\") "
Sep 10 02:57:20.915477 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:20.915450    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/676ad5ec-e2cc-4f13-8950-2e3582ed7902-kube-api-access-hfrnc" (OuterVolumeSpecName: "kube-api-access-hfrnc") pod "676ad5ec-e2cc-4f13-8950-2e3582ed7902" (UID: "676ad5ec-e2cc-4f13-8950-2e3582ed7902"). InnerVolumeSpecName "kube-api-access-hfrnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 02:57:21.014596 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:21.014561    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfrnc\" (UniqueName: \"kubernetes.io/projected/676ad5ec-e2cc-4f13-8950-2e3582ed7902-kube-api-access-hfrnc\") on node \"ip-10-0-143-198.ec2.internal\" DevicePath \"\""
Sep 10 02:57:21.689670 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:21.689637    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-jh7ch"
Sep 10 02:57:21.689670 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:21.689648    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-jh7ch" event={"ID":"676ad5ec-e2cc-4f13-8950-2e3582ed7902","Type":"ContainerDied","Data":"f56e2c872c90a38359bf6e521309a13dc2ca39b9a24ab5d98132b4ec1dbdcf04"}
Sep 10 02:57:21.689904 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:21.689703    2564 scope.go:117] "RemoveContainer" containerID="33d949f0b3c1cf7ec21baf120201a1f6b94a087ef1c44258af4d6c8dbfbed7be"
Sep 10 02:57:21.708708 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:21.708686    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-jh7ch"]
Sep 10 02:57:21.712172 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:21.712150    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-jh7ch"]
Sep 10 02:57:21.726412 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:21.726385    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="676ad5ec-e2cc-4f13-8950-2e3582ed7902" path="/var/lib/kubelet/pods/676ad5ec-e2cc-4f13-8950-2e3582ed7902/volumes"
Sep 10 02:57:21.726810 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:57:21.726792    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6864b14f-204b-4772-85aa-81bcf63dffef" path="/var/lib/kubelet/pods/6864b14f-204b-4772-85aa-81bcf63dffef/volumes"
Sep 10 02:58:02.131461 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.131424    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"]
Sep 10 02:58:02.131985 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.131788    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="676ad5ec-e2cc-4f13-8950-2e3582ed7902" containerName="authorino"
Sep 10 02:58:02.131985 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.131801    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="676ad5ec-e2cc-4f13-8950-2e3582ed7902" containerName="authorino"
Sep 10 02:58:02.131985 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.131867    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="676ad5ec-e2cc-4f13-8950-2e3582ed7902" containerName="authorino"
Sep 10 02:58:02.134894 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.134879    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:02.137775 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.137750    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 02:58:02.137905 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.137806    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 02:58:02.138877 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.138855    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 02:58:02.138988 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.138967    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vhkgd\""
Sep 10 02:58:02.139054 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.139020    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 02:58:02.145400 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.145376    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"]
Sep 10 02:58:02.159088 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.159065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-229xh\" (UniqueName: \"kubernetes.io/projected/5a656a5f-315e-4d7a-952f-81c3b032da70-kube-api-access-229xh\") pod \"maas-api-dc6944fb9-l686r\" (UID: \"5a656a5f-315e-4d7a-952f-81c3b032da70\") " pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:02.159210 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.159140    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a656a5f-315e-4d7a-952f-81c3b032da70-metrics-certs\") pod \"maas-api-dc6944fb9-l686r\" (UID: \"5a656a5f-315e-4d7a-952f-81c3b032da70\") " pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:02.159210 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.159167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a656a5f-315e-4d7a-952f-81c3b032da70-openshift-service-ca\") pod \"maas-api-dc6944fb9-l686r\" (UID: \"5a656a5f-315e-4d7a-952f-81c3b032da70\") " pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:02.159210 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.159194    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a656a5f-315e-4d7a-952f-81c3b032da70-maas-api-tls\") pod \"maas-api-dc6944fb9-l686r\" (UID: \"5a656a5f-315e-4d7a-952f-81c3b032da70\") " pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:02.259576 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.259546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a656a5f-315e-4d7a-952f-81c3b032da70-metrics-certs\") pod \"maas-api-dc6944fb9-l686r\" (UID: \"5a656a5f-315e-4d7a-952f-81c3b032da70\") " pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:02.259576 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.259578    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a656a5f-315e-4d7a-952f-81c3b032da70-openshift-service-ca\") pod \"maas-api-dc6944fb9-l686r\" (UID: \"5a656a5f-315e-4d7a-952f-81c3b032da70\") " pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:02.259859 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.259598    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a656a5f-315e-4d7a-952f-81c3b032da70-maas-api-tls\") pod \"maas-api-dc6944fb9-l686r\" (UID: \"5a656a5f-315e-4d7a-952f-81c3b032da70\") " pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:02.259859 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.259654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-229xh\" (UniqueName: \"kubernetes.io/projected/5a656a5f-315e-4d7a-952f-81c3b032da70-kube-api-access-229xh\") pod \"maas-api-dc6944fb9-l686r\" (UID: \"5a656a5f-315e-4d7a-952f-81c3b032da70\") " pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:02.259859 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:58:02.259726    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 10 02:58:02.259859 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:58:02.259796    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a656a5f-315e-4d7a-952f-81c3b032da70-metrics-certs podName:5a656a5f-315e-4d7a-952f-81c3b032da70 nodeName:}" failed. No retries permitted until 2026-09-10 02:58:02.759778351 +0000 UTC m=+523.547443647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a656a5f-315e-4d7a-952f-81c3b032da70-metrics-certs") pod "maas-api-dc6944fb9-l686r" (UID: "5a656a5f-315e-4d7a-952f-81c3b032da70") : secret "maas-api-metrics-tls" not found
Sep 10 02:58:02.260292 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.260269    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a656a5f-315e-4d7a-952f-81c3b032da70-openshift-service-ca\") pod \"maas-api-dc6944fb9-l686r\" (UID: \"5a656a5f-315e-4d7a-952f-81c3b032da70\") " pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:02.262357 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.262334    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a656a5f-315e-4d7a-952f-81c3b032da70-maas-api-tls\") pod \"maas-api-dc6944fb9-l686r\" (UID: \"5a656a5f-315e-4d7a-952f-81c3b032da70\") " pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:02.270512 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.270488    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-229xh\" (UniqueName: \"kubernetes.io/projected/5a656a5f-315e-4d7a-952f-81c3b032da70-kube-api-access-229xh\") pod \"maas-api-dc6944fb9-l686r\" (UID: \"5a656a5f-315e-4d7a-952f-81c3b032da70\") " pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:02.609012 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.608980    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"]
Sep 10 02:58:02.764844 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.764809    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a656a5f-315e-4d7a-952f-81c3b032da70-metrics-certs\") pod \"maas-api-dc6944fb9-l686r\" (UID: \"5a656a5f-315e-4d7a-952f-81c3b032da70\") " pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:02.767431 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:02.767398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a656a5f-315e-4d7a-952f-81c3b032da70-metrics-certs\") pod \"maas-api-dc6944fb9-l686r\" (UID: \"5a656a5f-315e-4d7a-952f-81c3b032da70\") " pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:03.047739 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:03.047708    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:03.323805 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:03.323674    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"]
Sep 10 02:58:03.328980 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:58:03.328939    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a656a5f_315e_4d7a_952f_81c3b032da70.slice/crio-aa16e40f6086976c76495993fd1fdf064fc7d8985853d097b69fb9ab3ea7a77c WatchSource:0}: Error finding container aa16e40f6086976c76495993fd1fdf064fc7d8985853d097b69fb9ab3ea7a77c: Status 404 returned error can't find the container with id aa16e40f6086976c76495993fd1fdf064fc7d8985853d097b69fb9ab3ea7a77c
Sep 10 02:58:03.877721 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:03.877680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r" event={"ID":"5a656a5f-315e-4d7a-952f-81c3b032da70","Type":"ContainerStarted","Data":"aa16e40f6086976c76495993fd1fdf064fc7d8985853d097b69fb9ab3ea7a77c"}
Sep 10 02:58:06.895997 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:06.895898    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r" event={"ID":"5a656a5f-315e-4d7a-952f-81c3b032da70","Type":"ContainerStarted","Data":"d7561806164ba8d3ef00ee184dbcc2fdfd09e62890b0455a5c136532d14e43fc"}
Sep 10 02:58:06.896430 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:06.896010    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:06.913685 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:06.913596    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r" podStartSLOduration=1.802960294 podStartE2EDuration="4.913575485s" totalImagesPullingTime="3.110615191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:58:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:58:06.912089487 +0000 UTC m=+527.699754805" watchObservedRunningTime="2026-09-10 02:58:06.913575485 +0000 UTC m=+527.701240803"
Sep 10 02:58:12.905434 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:12.905405    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-dc6944fb9-l686r"
Sep 10 02:58:12.924783 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:12.924752    2564 generic.go:356] "Generic (PLEG): container finished" podID="24a0331e-2321-4c75-8f8f-67f168e2d160" containerID="8d6c73ae3d129e97cb24a22ed7a01612969a8f81a3f8a3f834b12898bfc7093b" exitCode=0
Sep 10 02:58:12.924953 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:12.924817    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k" event={"ID":"24a0331e-2321-4c75-8f8f-67f168e2d160","Type":"ContainerDied","Data":"8d6c73ae3d129e97cb24a22ed7a01612969a8f81a3f8a3f834b12898bfc7093b"}
Sep 10 02:58:12.925162 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:12.925150    2564 scope.go:117] "RemoveContainer" containerID="8d6c73ae3d129e97cb24a22ed7a01612969a8f81a3f8a3f834b12898bfc7093b"
Sep 10 02:58:12.926141 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:12.926110    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 02:58:12.926201 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:12.926177    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 02:58:12.926239 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:12.926210    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 02:58:13.934049 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:13.934004    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k" event={"ID":"24a0331e-2321-4c75-8f8f-67f168e2d160","Type":"ContainerStarted","Data":"c95f469be2fdfc9e4dbdcb1c79147da47ece889d73d4d209032b3c94108b7c4e"}
Sep 10 02:58:14.845695 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:14.845656    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:58:14.845888 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:14.845864    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s7n4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 10 02:58:14.845939 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:14.845916    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k" podUID="24a0331e-2321-4c75-8f8f-67f168e2d160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 10 02:58:15.845997 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:15.845957    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s7n4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 10 02:58:15.846380 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:15.846012    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k" podUID="24a0331e-2321-4c75-8f8f-67f168e2d160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 10 02:58:16.846763 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:16.846726    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s7n4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 10 02:58:16.847137 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:16.846802    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k" podUID="24a0331e-2321-4c75-8f8f-67f168e2d160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 10 02:58:17.846637 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:17.846571    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s7n4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 10 02:58:17.846818 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:17.846677    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k" podUID="24a0331e-2321-4c75-8f8f-67f168e2d160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 10 02:58:18.846034 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:18.845996    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s7n4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 10 02:58:18.846209 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:18.846059    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k" podUID="24a0331e-2321-4c75-8f8f-67f168e2d160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 10 02:58:19.532543 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:19.532504    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:58:19.850191 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:19.850118    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:58:19.965225 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:19.965194    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s7n4k"
Sep 10 02:58:32.256296 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.256261    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"]
Sep 10 02:58:32.263058 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.263039    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.266640 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.266579    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 02:58:32.266640 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.266598    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 02:58:32.266640 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.266579    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 02:58:32.266905 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.266698    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c9khk\""
Sep 10 02:58:32.270295 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.270270    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"]
Sep 10 02:58:32.423896 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.423859    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.423896 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.423896    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.424097 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.423917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5gnh\" (UniqueName: \"kubernetes.io/projected/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-kube-api-access-v5gnh\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.424097 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.424002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.424097 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.424034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.424097 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.424069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.525036 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.524954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.525036 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.524994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.525207 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.525117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.525207 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.525150    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5gnh\" (UniqueName: \"kubernetes.io/projected/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-kube-api-access-v5gnh\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.525290 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.525207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.525290 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.525256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.525390 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.525327    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.525439 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.525392    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.525602 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.525578    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.527595 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.527575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.527772 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.527752    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.532936 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.532917    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5gnh\" (UniqueName: \"kubernetes.io/projected/f0f11f64-544f-4e49-8d82-7e47ed9fb4b8-kube-api-access-v5gnh\") pod \"e2e-distinct-2-simulated-kserve-859856b874-bp2tg\" (UID: \"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.574979 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.574953    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:32.731950 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.731916    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"]
Sep 10 02:58:32.852494 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:32.852470    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"]
Sep 10 02:58:32.854832 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:58:32.854804    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f11f64_544f_4e49_8d82_7e47ed9fb4b8.slice/crio-c7cfe6f80788903e60e9024b264a15ce2fe0ee8f061f885cbbc4185ff2234305 WatchSource:0}: Error finding container c7cfe6f80788903e60e9024b264a15ce2fe0ee8f061f885cbbc4185ff2234305: Status 404 returned error can't find the container with id c7cfe6f80788903e60e9024b264a15ce2fe0ee8f061f885cbbc4185ff2234305
Sep 10 02:58:33.023316 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:33.023284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" event={"ID":"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8","Type":"ContainerStarted","Data":"c7cfe6f80788903e60e9024b264a15ce2fe0ee8f061f885cbbc4185ff2234305"}
Sep 10 02:58:34.030103 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:34.030067    2564 generic.go:356] "Generic (PLEG): container finished" podID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8" containerID="82e4be873719d4a339c4ca29637a37e39fc55951279a3ba5ba7fcee639ca4cd8" exitCode=0
Sep 10 02:58:34.030468 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:34.030158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" event={"ID":"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8","Type":"ContainerDied","Data":"82e4be873719d4a339c4ca29637a37e39fc55951279a3ba5ba7fcee639ca4cd8"}
Sep 10 02:58:34.030468 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:34.030386    2564 scope.go:117] "RemoveContainer" containerID="82e4be873719d4a339c4ca29637a37e39fc55951279a3ba5ba7fcee639ca4cd8"
Sep 10 02:58:35.037249 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:35.037214    2564 generic.go:356] "Generic (PLEG): container finished" podID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8" containerID="1f1711824fbd48347ec935aafda56143cde08f8406ab4ef1c7c6fd0274f31ca8" exitCode=0
Sep 10 02:58:35.037673 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:35.037304    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" event={"ID":"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8","Type":"ContainerDied","Data":"1f1711824fbd48347ec935aafda56143cde08f8406ab4ef1c7c6fd0274f31ca8"}
Sep 10 02:58:35.037673 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:35.037391    2564 scope.go:117] "RemoveContainer" containerID="82e4be873719d4a339c4ca29637a37e39fc55951279a3ba5ba7fcee639ca4cd8"
Sep 10 02:58:35.037673 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:35.037576    2564 scope.go:117] "RemoveContainer" containerID="1f1711824fbd48347ec935aafda56143cde08f8406ab4ef1c7c6fd0274f31ca8"
Sep 10 02:58:35.037814 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:58:35.037787    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 02:58:36.043791 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:36.043767    2564 scope.go:117] "RemoveContainer" containerID="1f1711824fbd48347ec935aafda56143cde08f8406ab4ef1c7c6fd0274f31ca8"
Sep 10 02:58:36.044155 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:58:36.043929    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 02:58:37.134561 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:37.134529    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"]
Sep 10 02:58:42.575327 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:42.575272    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:42.575761 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:42.575355    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:42.575761 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:42.575380    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:42.575761 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:42.575392    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:58:42.575859 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:42.575788    2564 scope.go:117] "RemoveContainer" containerID="1f1711824fbd48347ec935aafda56143cde08f8406ab4ef1c7c6fd0274f31ca8"
Sep 10 02:58:42.575962 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:58:42.575942    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 02:58:46.836733 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:46.836700    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"]
Sep 10 02:58:53.721061 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:53.721027    2564 scope.go:117] "RemoveContainer" containerID="1f1711824fbd48347ec935aafda56143cde08f8406ab4ef1c7c6fd0274f31ca8"
Sep 10 02:58:54.127702 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:54.127671    2564 generic.go:356] "Generic (PLEG): container finished" podID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8" containerID="5f3b9eb5c4f89bf0bcfa42066d425ee6e6a1c5df37e07d2a1d55ccaebe9997ff" exitCode=0
Sep 10 02:58:54.127858 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:54.127748    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" event={"ID":"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8","Type":"ContainerDied","Data":"5f3b9eb5c4f89bf0bcfa42066d425ee6e6a1c5df37e07d2a1d55ccaebe9997ff"}
Sep 10 02:58:54.127858 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:54.127806    2564 scope.go:117] "RemoveContainer" containerID="1f1711824fbd48347ec935aafda56143cde08f8406ab4ef1c7c6fd0274f31ca8"
Sep 10 02:58:54.128095 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:54.128080    2564 scope.go:117] "RemoveContainer" containerID="5f3b9eb5c4f89bf0bcfa42066d425ee6e6a1c5df37e07d2a1d55ccaebe9997ff"
Sep 10 02:58:54.128303 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:58:54.128286    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 02:58:54.629836 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:58:54.629802    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"]
Sep 10 02:59:02.476605 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.476560    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"]
Sep 10 02:59:02.483107 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.483086    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.485900 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.485874    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 02:59:02.489797 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.489773    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"]
Sep 10 02:59:02.575735 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.575699    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:59:02.575921 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.575771    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:59:02.575921 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.575790    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:59:02.575921 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.575812    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:59:02.576243 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.576224    2564 scope.go:117] "RemoveContainer" containerID="5f3b9eb5c4f89bf0bcfa42066d425ee6e6a1c5df37e07d2a1d55ccaebe9997ff"
Sep 10 02:59:02.576452 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:59:02.576433    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 02:59:02.578439 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.578415    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/853fe7ed-4dc2-42ce-a730-233befdce497-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.578558 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.578453    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/853fe7ed-4dc2-42ce-a730-233befdce497-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.578558 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.578497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/853fe7ed-4dc2-42ce-a730-233befdce497-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.578558 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.578534    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/853fe7ed-4dc2-42ce-a730-233befdce497-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.578701 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.578599    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7t5w\" (UniqueName: \"kubernetes.io/projected/853fe7ed-4dc2-42ce-a730-233befdce497-kube-api-access-m7t5w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.578701 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.578673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/853fe7ed-4dc2-42ce-a730-233befdce497-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.680007 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.679964    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/853fe7ed-4dc2-42ce-a730-233befdce497-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.680207 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.680043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/853fe7ed-4dc2-42ce-a730-233befdce497-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.680207 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.680104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/853fe7ed-4dc2-42ce-a730-233befdce497-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.680207 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.680146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/853fe7ed-4dc2-42ce-a730-233befdce497-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.680207 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.680178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7t5w\" (UniqueName: \"kubernetes.io/projected/853fe7ed-4dc2-42ce-a730-233befdce497-kube-api-access-m7t5w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.680420 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.680230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/853fe7ed-4dc2-42ce-a730-233befdce497-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.680549 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.680527    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/853fe7ed-4dc2-42ce-a730-233befdce497-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.680603 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.680582    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/853fe7ed-4dc2-42ce-a730-233befdce497-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.680692 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.680670    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/853fe7ed-4dc2-42ce-a730-233befdce497-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.682590 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.682562    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/853fe7ed-4dc2-42ce-a730-233befdce497-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.682700 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.682655    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/853fe7ed-4dc2-42ce-a730-233befdce497-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.688670 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.688653    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7t5w\" (UniqueName: \"kubernetes.io/projected/853fe7ed-4dc2-42ce-a730-233befdce497-kube-api-access-m7t5w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j\" (UID: \"853fe7ed-4dc2-42ce-a730-233befdce497\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:02.794743 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:02.794659    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:03.068334 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:03.068311    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"]
Sep 10 02:59:03.070526 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:59:03.070500    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853fe7ed_4dc2_42ce_a730_233befdce497.slice/crio-860fdfa8847bed178859f5b394c1e6a84d08e68a593a21ca3755ed02b2ca1d99 WatchSource:0}: Error finding container 860fdfa8847bed178859f5b394c1e6a84d08e68a593a21ca3755ed02b2ca1d99: Status 404 returned error can't find the container with id 860fdfa8847bed178859f5b394c1e6a84d08e68a593a21ca3755ed02b2ca1d99
Sep 10 02:59:03.175009 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:03.174976    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j" event={"ID":"853fe7ed-4dc2-42ce-a730-233befdce497","Type":"ContainerStarted","Data":"860fdfa8847bed178859f5b394c1e6a84d08e68a593a21ca3755ed02b2ca1d99"}
Sep 10 02:59:04.039707 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:04.039673    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"]
Sep 10 02:59:04.181291 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:04.181257    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j" event={"ID":"853fe7ed-4dc2-42ce-a730-233befdce497","Type":"ContainerStarted","Data":"98d2f561a339ef4cf507fe4ed55b7d0b042fb2b3112b6013d2dc6e822ec7c0c3"}
Sep 10 02:59:04.198604 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:04.198557    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j" podStartSLOduration=2.011512004 podStartE2EDuration="2.198542772s" totalImagesPullingTime="187.030768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:59:04.197182494 +0000 UTC m=+584.984847821" watchObservedRunningTime="2026-09-10 02:59:04.198542772 +0000 UTC m=+584.986208089"
Sep 10 02:59:12.795196 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:12.795153    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:12.795741 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:12.795234    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:12.807751 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:12.807725    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:13.233250 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:13.233216    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j"
Sep 10 02:59:17.721227 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:17.721189    2564 scope.go:117] "RemoveContainer" containerID="5f3b9eb5c4f89bf0bcfa42066d425ee6e6a1c5df37e07d2a1d55ccaebe9997ff"
Sep 10 02:59:18.247211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:18.247127    2564 generic.go:356] "Generic (PLEG): container finished" podID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8" containerID="a738897b3f94a80e6478d881028b778f8e2261ec3a718d66f68dbc2ed402af87" exitCode=0
Sep 10 02:59:18.247211 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:18.247178    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" event={"ID":"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8","Type":"ContainerDied","Data":"a738897b3f94a80e6478d881028b778f8e2261ec3a718d66f68dbc2ed402af87"}
Sep 10 02:59:18.247445 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:18.247231    2564 scope.go:117] "RemoveContainer" containerID="5f3b9eb5c4f89bf0bcfa42066d425ee6e6a1c5df37e07d2a1d55ccaebe9997ff"
Sep 10 02:59:18.247569 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:18.247550    2564 scope.go:117] "RemoveContainer" containerID="a738897b3f94a80e6478d881028b778f8e2261ec3a718d66f68dbc2ed402af87"
Sep 10 02:59:18.247824 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:59:18.247799    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 02:59:22.575606 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:22.575560    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:59:22.576030 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:22.575653    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:59:22.576030 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:22.575670    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:59:22.576030 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:22.575684    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 02:59:22.576030 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:22.576018    2564 scope.go:117] "RemoveContainer" containerID="a738897b3f94a80e6478d881028b778f8e2261ec3a718d66f68dbc2ed402af87"
Sep 10 02:59:22.576261 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:59:22.576235    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 02:59:23.439890 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:23.439858    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"]
Sep 10 02:59:31.164270 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.164236    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"]
Sep 10 02:59:31.169768 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.169741    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.172793 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.172770    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 10 02:59:31.176819 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.176793    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"]
Sep 10 02:59:31.332556 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.332525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2968s\" (UniqueName: \"kubernetes.io/projected/f8889941-9ee9-45ec-a508-dd2e125e62d6-kube-api-access-2968s\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.332752 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.332571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8889941-9ee9-45ec-a508-dd2e125e62d6-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.332752 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.332654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8889941-9ee9-45ec-a508-dd2e125e62d6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.332752 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.332739    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8889941-9ee9-45ec-a508-dd2e125e62d6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.332884 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.332792    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8889941-9ee9-45ec-a508-dd2e125e62d6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.332884 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.332830    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8889941-9ee9-45ec-a508-dd2e125e62d6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.433556 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.433466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8889941-9ee9-45ec-a508-dd2e125e62d6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.433556 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.433512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2968s\" (UniqueName: \"kubernetes.io/projected/f8889941-9ee9-45ec-a508-dd2e125e62d6-kube-api-access-2968s\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.433556 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.433547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8889941-9ee9-45ec-a508-dd2e125e62d6-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.433869 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.433579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8889941-9ee9-45ec-a508-dd2e125e62d6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.433869 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.433679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8889941-9ee9-45ec-a508-dd2e125e62d6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.433869 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.433735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8889941-9ee9-45ec-a508-dd2e125e62d6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.434020 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.433922    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8889941-9ee9-45ec-a508-dd2e125e62d6-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.434020 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.433956    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8889941-9ee9-45ec-a508-dd2e125e62d6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.434149 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.434080    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8889941-9ee9-45ec-a508-dd2e125e62d6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.436082 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.436060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8889941-9ee9-45ec-a508-dd2e125e62d6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.436247 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.436229    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8889941-9ee9-45ec-a508-dd2e125e62d6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.441408 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.441389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2968s\" (UniqueName: \"kubernetes.io/projected/f8889941-9ee9-45ec-a508-dd2e125e62d6-kube-api-access-2968s\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-rt766\" (UID: \"f8889941-9ee9-45ec-a508-dd2e125e62d6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.482468 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.482438    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:31.753294 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:31.753223    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"]
Sep 10 02:59:31.755872 ip-10-0-143-198 kubenswrapper[2564]: W0910 02:59:31.755841    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8889941_9ee9_45ec_a508_dd2e125e62d6.slice/crio-769d957d97674ffb7f545d92191f05102d1fafed1adcd10c08dae9d9c0164526 WatchSource:0}: Error finding container 769d957d97674ffb7f545d92191f05102d1fafed1adcd10c08dae9d9c0164526: Status 404 returned error can't find the container with id 769d957d97674ffb7f545d92191f05102d1fafed1adcd10c08dae9d9c0164526
Sep 10 02:59:32.314231 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:32.314131    2564 generic.go:356] "Generic (PLEG): container finished" podID="f8889941-9ee9-45ec-a508-dd2e125e62d6" containerID="2d51538338f65a7420e9945468cace550e4d80e57a4713e5f4a0049b714a93f3" exitCode=0
Sep 10 02:59:32.314231 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:32.314218    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" event={"ID":"f8889941-9ee9-45ec-a508-dd2e125e62d6","Type":"ContainerDied","Data":"2d51538338f65a7420e9945468cace550e4d80e57a4713e5f4a0049b714a93f3"}
Sep 10 02:59:32.314772 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:32.314278    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" event={"ID":"f8889941-9ee9-45ec-a508-dd2e125e62d6","Type":"ContainerStarted","Data":"769d957d97674ffb7f545d92191f05102d1fafed1adcd10c08dae9d9c0164526"}
Sep 10 02:59:32.314772 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:32.314498    2564 scope.go:117] "RemoveContainer" containerID="2d51538338f65a7420e9945468cace550e4d80e57a4713e5f4a0049b714a93f3"
Sep 10 02:59:33.321527 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:33.321496    2564 generic.go:356] "Generic (PLEG): container finished" podID="f8889941-9ee9-45ec-a508-dd2e125e62d6" containerID="cf4da236329da8a840e1774ea9b86b418e59ee4b8dcec4a33c36bda1dcf7df0f" exitCode=0
Sep 10 02:59:33.321956 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:33.321556    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" event={"ID":"f8889941-9ee9-45ec-a508-dd2e125e62d6","Type":"ContainerDied","Data":"cf4da236329da8a840e1774ea9b86b418e59ee4b8dcec4a33c36bda1dcf7df0f"}
Sep 10 02:59:33.321956 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:33.321593    2564 scope.go:117] "RemoveContainer" containerID="2d51538338f65a7420e9945468cace550e4d80e57a4713e5f4a0049b714a93f3"
Sep 10 02:59:33.321956 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:33.321855    2564 scope.go:117] "RemoveContainer" containerID="cf4da236329da8a840e1774ea9b86b418e59ee4b8dcec4a33c36bda1dcf7df0f"
Sep 10 02:59:33.322104 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:59:33.322057    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 02:59:33.435192 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:33.435153    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-lfcf2"]
Sep 10 02:59:33.721989 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:33.721953    2564 scope.go:117] "RemoveContainer" containerID="a738897b3f94a80e6478d881028b778f8e2261ec3a718d66f68dbc2ed402af87"
Sep 10 02:59:33.722181 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:59:33.722100    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 02:59:34.328244 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:34.328216    2564 scope.go:117] "RemoveContainer" containerID="cf4da236329da8a840e1774ea9b86b418e59ee4b8dcec4a33c36bda1dcf7df0f"
Sep 10 02:59:34.328637 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:59:34.328373    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 02:59:41.483045 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:41.482963    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:41.483045 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:41.483012    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:41.483045 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:41.483029    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:41.483045 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:41.483042    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 02:59:41.483508 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:41.483427    2564 scope.go:117] "RemoveContainer" containerID="cf4da236329da8a840e1774ea9b86b418e59ee4b8dcec4a33c36bda1dcf7df0f"
Sep 10 02:59:41.483636 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:59:41.483588    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 02:59:44.722202 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:44.722168    2564 scope.go:117] "RemoveContainer" containerID="a738897b3f94a80e6478d881028b778f8e2261ec3a718d66f68dbc2ed402af87"
Sep 10 02:59:44.722587 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:59:44.722363    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 02:59:56.721828 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:56.721793    2564 scope.go:117] "RemoveContainer" containerID="cf4da236329da8a840e1774ea9b86b418e59ee4b8dcec4a33c36bda1dcf7df0f"
Sep 10 02:59:56.722217 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:56.722069    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 02:59:57.435666 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:57.435600    2564 generic.go:356] "Generic (PLEG): container finished" podID="f8889941-9ee9-45ec-a508-dd2e125e62d6" containerID="b2b2033b0aa45ea3ce2d9b8fe08bba0e843c5d1dd6993f3f82e45b52604df84b" exitCode=0
Sep 10 02:59:57.435833 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:57.435672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" event={"ID":"f8889941-9ee9-45ec-a508-dd2e125e62d6","Type":"ContainerDied","Data":"b2b2033b0aa45ea3ce2d9b8fe08bba0e843c5d1dd6993f3f82e45b52604df84b"}
Sep 10 02:59:57.435833 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:57.435722    2564 scope.go:117] "RemoveContainer" containerID="cf4da236329da8a840e1774ea9b86b418e59ee4b8dcec4a33c36bda1dcf7df0f"
Sep 10 02:59:57.436088 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:57.436071    2564 scope.go:117] "RemoveContainer" containerID="b2b2033b0aa45ea3ce2d9b8fe08bba0e843c5d1dd6993f3f82e45b52604df84b"
Sep 10 02:59:57.436282 ip-10-0-143-198 kubenswrapper[2564]: E0910 02:59:57.436259    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 02:59:59.729092 ip-10-0-143-198 kubenswrapper[2564]: I0910 02:59:59.725873    2564 scope.go:117] "RemoveContainer" containerID="a738897b3f94a80e6478d881028b778f8e2261ec3a718d66f68dbc2ed402af87"
Sep 10 03:00:00.453157 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:00.453126    2564 generic.go:356] "Generic (PLEG): container finished" podID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8" containerID="1d7b1c71c4d6141570cabf6acc682214d0571535b4ce226fa663cb7badc6f1f9" exitCode=0
Sep 10 03:00:00.453340 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:00.453194    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" event={"ID":"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8","Type":"ContainerDied","Data":"1d7b1c71c4d6141570cabf6acc682214d0571535b4ce226fa663cb7badc6f1f9"}
Sep 10 03:00:00.453340 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:00.453243    2564 scope.go:117] "RemoveContainer" containerID="a738897b3f94a80e6478d881028b778f8e2261ec3a718d66f68dbc2ed402af87"
Sep 10 03:00:00.453601 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:00.453572    2564 scope.go:117] "RemoveContainer" containerID="1d7b1c71c4d6141570cabf6acc682214d0571535b4ce226fa663cb7badc6f1f9"
Sep 10 03:00:00.453835 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:00:00.453809    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:00:01.483133 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:01.483103    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:00:01.483133 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:01.483140    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:00:01.483558 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:01.483151    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:00:01.483558 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:01.483160    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:00:01.483558 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:01.483448    2564 scope.go:117] "RemoveContainer" containerID="b2b2033b0aa45ea3ce2d9b8fe08bba0e843c5d1dd6993f3f82e45b52604df84b"
Sep 10 03:00:01.483680 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:00:01.483595    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:00:02.575056 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:02.575016    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 03:00:02.575579 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:02.575079    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 03:00:02.575579 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:02.575097    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 03:00:02.575579 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:02.575110    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 03:00:02.575579 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:02.575412    2564 scope.go:117] "RemoveContainer" containerID="1d7b1c71c4d6141570cabf6acc682214d0571535b4ce226fa663cb7badc6f1f9"
Sep 10 03:00:02.575759 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:00:02.575575    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:00:12.722046 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:12.722012    2564 scope.go:117] "RemoveContainer" containerID="1d7b1c71c4d6141570cabf6acc682214d0571535b4ce226fa663cb7badc6f1f9"
Sep 10 03:00:12.722436 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:12.722167    2564 scope.go:117] "RemoveContainer" containerID="b2b2033b0aa45ea3ce2d9b8fe08bba0e843c5d1dd6993f3f82e45b52604df84b"
Sep 10 03:00:12.722436 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:00:12.722187    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:00:12.722436 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:00:12.722348    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:00:27.721394 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:27.721362    2564 scope.go:117] "RemoveContainer" containerID="b2b2033b0aa45ea3ce2d9b8fe08bba0e843c5d1dd6993f3f82e45b52604df84b"
Sep 10 03:00:27.721806 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:27.721555    2564 scope.go:117] "RemoveContainer" containerID="1d7b1c71c4d6141570cabf6acc682214d0571535b4ce226fa663cb7badc6f1f9"
Sep 10 03:00:27.721806 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:00:27.721776    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:00:28.584010 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:28.583982    2564 generic.go:356] "Generic (PLEG): container finished" podID="f8889941-9ee9-45ec-a508-dd2e125e62d6" containerID="67776cd5d094a301716f1df6c5dc92436ef95c59e9ebc026719da251220d6bbf" exitCode=0
Sep 10 03:00:28.584183 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:28.584034    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" event={"ID":"f8889941-9ee9-45ec-a508-dd2e125e62d6","Type":"ContainerDied","Data":"67776cd5d094a301716f1df6c5dc92436ef95c59e9ebc026719da251220d6bbf"}
Sep 10 03:00:28.584183 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:28.584070    2564 scope.go:117] "RemoveContainer" containerID="b2b2033b0aa45ea3ce2d9b8fe08bba0e843c5d1dd6993f3f82e45b52604df84b"
Sep 10 03:00:28.584443 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:28.584418    2564 scope.go:117] "RemoveContainer" containerID="67776cd5d094a301716f1df6c5dc92436ef95c59e9ebc026719da251220d6bbf"
Sep 10 03:00:28.584656 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:00:28.584634    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:00:31.483095 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:31.483056    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:00:31.483626 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:31.483107    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:00:31.483626 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:31.483138    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:00:31.483626 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:31.483171    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:00:31.483626 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:31.483520    2564 scope.go:117] "RemoveContainer" containerID="67776cd5d094a301716f1df6c5dc92436ef95c59e9ebc026719da251220d6bbf"
Sep 10 03:00:31.483834 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:00:31.483748    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:00:31.600827 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:31.600797    2564 scope.go:117] "RemoveContainer" containerID="67776cd5d094a301716f1df6c5dc92436ef95c59e9ebc026719da251220d6bbf"
Sep 10 03:00:31.600989 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:00:31.600959    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:00:38.721191 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:38.721157    2564 scope.go:117] "RemoveContainer" containerID="1d7b1c71c4d6141570cabf6acc682214d0571535b4ce226fa663cb7badc6f1f9"
Sep 10 03:00:38.721729 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:00:38.721334    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:00:42.721391 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:42.721360    2564 scope.go:117] "RemoveContainer" containerID="67776cd5d094a301716f1df6c5dc92436ef95c59e9ebc026719da251220d6bbf"
Sep 10 03:00:42.721810 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:00:42.721519    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:00:51.721348 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:51.721315    2564 scope.go:117] "RemoveContainer" containerID="1d7b1c71c4d6141570cabf6acc682214d0571535b4ce226fa663cb7badc6f1f9"
Sep 10 03:00:51.721950 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:00:51.721483    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:00:56.721272 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:00:56.721240    2564 scope.go:117] "RemoveContainer" containerID="67776cd5d094a301716f1df6c5dc92436ef95c59e9ebc026719da251220d6bbf"
Sep 10 03:00:56.721746 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:00:56.721574    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:01:06.721824 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:06.721785    2564 scope.go:117] "RemoveContainer" containerID="1d7b1c71c4d6141570cabf6acc682214d0571535b4ce226fa663cb7badc6f1f9"
Sep 10 03:01:06.722307 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:01:06.721976    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:01:09.723176 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:09.723145    2564 scope.go:117] "RemoveContainer" containerID="67776cd5d094a301716f1df6c5dc92436ef95c59e9ebc026719da251220d6bbf"
Sep 10 03:01:10.792743 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:10.792706    2564 generic.go:356] "Generic (PLEG): container finished" podID="f8889941-9ee9-45ec-a508-dd2e125e62d6" containerID="7067207b3b89dabcaddb0da69fe9eb964b7ddc01d78198f05323d7a0f19552a9" exitCode=0
Sep 10 03:01:10.792743 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:10.792746    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" event={"ID":"f8889941-9ee9-45ec-a508-dd2e125e62d6","Type":"ContainerDied","Data":"7067207b3b89dabcaddb0da69fe9eb964b7ddc01d78198f05323d7a0f19552a9"}
Sep 10 03:01:10.793237 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:10.792791    2564 scope.go:117] "RemoveContainer" containerID="67776cd5d094a301716f1df6c5dc92436ef95c59e9ebc026719da251220d6bbf"
Sep 10 03:01:10.793237 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:10.793210    2564 scope.go:117] "RemoveContainer" containerID="7067207b3b89dabcaddb0da69fe9eb964b7ddc01d78198f05323d7a0f19552a9"
Sep 10 03:01:10.793436 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:01:10.793411    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:01:11.482556 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:11.482519    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:01:11.482749 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:11.482576    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:01:11.482749 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:11.482588    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:01:11.482749 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:11.482597    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:01:11.799256 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:11.799180    2564 scope.go:117] "RemoveContainer" containerID="7067207b3b89dabcaddb0da69fe9eb964b7ddc01d78198f05323d7a0f19552a9"
Sep 10 03:01:11.799641 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:01:11.799338    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:01:19.723876 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:19.723845    2564 scope.go:117] "RemoveContainer" containerID="1d7b1c71c4d6141570cabf6acc682214d0571535b4ce226fa663cb7badc6f1f9"
Sep 10 03:01:19.724322 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:01:19.724048    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:01:23.721331 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:23.721299    2564 scope.go:117] "RemoveContainer" containerID="7067207b3b89dabcaddb0da69fe9eb964b7ddc01d78198f05323d7a0f19552a9"
Sep 10 03:01:23.721733 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:01:23.721470    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:01:33.721924 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:33.721889    2564 scope.go:117] "RemoveContainer" containerID="1d7b1c71c4d6141570cabf6acc682214d0571535b4ce226fa663cb7badc6f1f9"
Sep 10 03:01:34.908998 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:34.908961    2564 generic.go:356] "Generic (PLEG): container finished" podID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8" containerID="a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806" exitCode=0
Sep 10 03:01:34.908998 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:34.909000    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" event={"ID":"f0f11f64-544f-4e49-8d82-7e47ed9fb4b8","Type":"ContainerDied","Data":"a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806"}
Sep 10 03:01:34.909467 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:34.909056    2564 scope.go:117] "RemoveContainer" containerID="1d7b1c71c4d6141570cabf6acc682214d0571535b4ce226fa663cb7badc6f1f9"
Sep 10 03:01:34.909528 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:34.909505    2564 scope.go:117] "RemoveContainer" containerID="a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806"
Sep 10 03:01:34.909780 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:01:34.909761    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:01:36.720964 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:36.720935    2564 scope.go:117] "RemoveContainer" containerID="7067207b3b89dabcaddb0da69fe9eb964b7ddc01d78198f05323d7a0f19552a9"
Sep 10 03:01:36.721346 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:01:36.721099    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:01:42.575828 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:42.575786    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 03:01:42.576267 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:42.575854    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 03:01:42.576267 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:42.575870    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 03:01:42.576267 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:42.575883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg"
Sep 10 03:01:42.576365 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:42.576268    2564 scope.go:117] "RemoveContainer" containerID="a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806"
Sep 10 03:01:42.576482 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:01:42.576461    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:01:48.721924 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:48.721888    2564 scope.go:117] "RemoveContainer" containerID="7067207b3b89dabcaddb0da69fe9eb964b7ddc01d78198f05323d7a0f19552a9"
Sep 10 03:01:48.722290 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:01:48.722033    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:01:55.721920 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:55.721884    2564 scope.go:117] "RemoveContainer" containerID="a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806"
Sep 10 03:01:55.722383 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:01:55.722035    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:01:59.723576 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:01:59.723539    2564 scope.go:117] "RemoveContainer" containerID="7067207b3b89dabcaddb0da69fe9eb964b7ddc01d78198f05323d7a0f19552a9"
Sep 10 03:01:59.723956 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:01:59.723755    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:02:09.723529 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:09.723501    2564 scope.go:117] "RemoveContainer" containerID="a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806"
Sep 10 03:02:09.723929 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:02:09.723711    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:02:11.721267 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:11.721233    2564 scope.go:117] "RemoveContainer" containerID="7067207b3b89dabcaddb0da69fe9eb964b7ddc01d78198f05323d7a0f19552a9"
Sep 10 03:02:11.721688 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:02:11.721374    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:02:23.721328 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:23.721294    2564 scope.go:117] "RemoveContainer" containerID="a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806"
Sep 10 03:02:23.721780 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:02:23.721481    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:02:25.727177 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:25.727146    2564 scope.go:117] "RemoveContainer" containerID="7067207b3b89dabcaddb0da69fe9eb964b7ddc01d78198f05323d7a0f19552a9"
Sep 10 03:02:25.727578 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:02:25.727302    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:02:35.721244 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:35.721203    2564 scope.go:117] "RemoveContainer" containerID="a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806"
Sep 10 03:02:35.721853 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:02:35.721376    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:02:39.723055 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:39.723020    2564 scope.go:117] "RemoveContainer" containerID="7067207b3b89dabcaddb0da69fe9eb964b7ddc01d78198f05323d7a0f19552a9"
Sep 10 03:02:40.213276 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:40.213242    2564 generic.go:356] "Generic (PLEG): container finished" podID="f8889941-9ee9-45ec-a508-dd2e125e62d6" containerID="ad370d9934da3e6ac41f293e7c546aa5df62b0419f60dcb9bef5314706ad4938" exitCode=0
Sep 10 03:02:40.213451 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:40.213316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" event={"ID":"f8889941-9ee9-45ec-a508-dd2e125e62d6","Type":"ContainerDied","Data":"ad370d9934da3e6ac41f293e7c546aa5df62b0419f60dcb9bef5314706ad4938"}
Sep 10 03:02:40.213451 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:40.213365    2564 scope.go:117] "RemoveContainer" containerID="7067207b3b89dabcaddb0da69fe9eb964b7ddc01d78198f05323d7a0f19552a9"
Sep 10 03:02:40.213742 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:40.213724    2564 scope.go:117] "RemoveContainer" containerID="ad370d9934da3e6ac41f293e7c546aa5df62b0419f60dcb9bef5314706ad4938"
Sep 10 03:02:40.213941 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:02:40.213913    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:02:41.483343 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:41.483299    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:02:41.483343 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:41.483342    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:02:41.483343 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:41.483353    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:02:41.483836 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:41.483361    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766"
Sep 10 03:02:41.483836 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:41.483710    2564 scope.go:117] "RemoveContainer" containerID="ad370d9934da3e6ac41f293e7c546aa5df62b0419f60dcb9bef5314706ad4938"
Sep 10 03:02:41.483907 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:02:41.483888    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:02:47.721464 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:47.721432    2564 scope.go:117] "RemoveContainer" containerID="a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806"
Sep 10 03:02:47.721900 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:02:47.721641    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:02:53.725802 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:02:53.722322    2564 scope.go:117] "RemoveContainer" containerID="ad370d9934da3e6ac41f293e7c546aa5df62b0419f60dcb9bef5314706ad4938"
Sep 10 03:02:53.725802 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:02:53.722666    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:03:01.721941 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:01.721908    2564 scope.go:117] "RemoveContainer" containerID="a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806"
Sep 10 03:03:01.722319 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:03:01.722083    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:03:07.727587 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:07.727561    2564 scope.go:117] "RemoveContainer" containerID="ad370d9934da3e6ac41f293e7c546aa5df62b0419f60dcb9bef5314706ad4938"
Sep 10 03:03:07.728049 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:03:07.727816    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:03:12.721368 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:12.721336    2564 scope.go:117] "RemoveContainer" containerID="a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806"
Sep 10 03:03:12.723777 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:03:12.721522    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:03:20.721155 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:20.721123    2564 scope.go:117] "RemoveContainer" containerID="ad370d9934da3e6ac41f293e7c546aa5df62b0419f60dcb9bef5314706ad4938"
Sep 10 03:03:20.721545 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:03:20.721309    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:03:23.836652 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:23.836601    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-sflqv_ad0be7d7-e22e-4d61-8a91-5a8bca3ff167/manager/0.log"
Sep 10 03:03:23.955163 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:23.955127    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-55cgr_2f1c8ad7-d2a4-434b-93d4-def1c7ef8812/manager/0.log"
Sep 10 03:03:24.190641 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:24.190603    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-98rpl_19b58033-3f3d-4ac0-a133-0729effd783c/server/0.log"
Sep 10 03:03:24.315352 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:24.315321    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4gkkc_42cc036a-0516-417e-9180-dbd9bfc55c82/manager/0.log"
Sep 10 03:03:24.671770 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:24.671746    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f567c59b-rmnc7_41c75544-6630-404c-99b4-e8b7566edae0/copy-manifests/0.log"
Sep 10 03:03:24.683522 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:24.683493    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f567c59b-rmnc7_41c75544-6630-404c-99b4-e8b7566edae0/manager/0.log"
Sep 10 03:03:25.045373 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:25.045296    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-dc6944fb9-l686r_5a656a5f-315e-4d7a-952f-81c3b032da70/maas-api/0.log"
Sep 10 03:03:26.218443 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:26.218412    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-4dhc2_4f327683-c873-42f2-8905-1888f775d882/manager/0.log"
Sep 10 03:03:26.334143 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:26.334106    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-8rm5w_6df5c1cf-6fb8-4143-b43a-a087da381f5f/manager/0.log"
Sep 10 03:03:26.451222 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:26.451196    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-kxtzv_1c2b7278-6896-4c9c-893b-f3bc4273e3ba/kuadrant-console-plugin/0.log"
Sep 10 03:03:26.698019 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:26.697993    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-lfcf2_006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc/limitador/0.log"
Sep 10 03:03:26.721765 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:26.721737    2564 scope.go:117] "RemoveContainer" containerID="a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806"
Sep 10 03:03:26.721937 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:03:26.721916    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:03:26.820449 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:26.820416    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-df8rf_be27aefe-a8ed-4f2c-a92d-4c08753593de/manager/0.log"
Sep 10 03:03:27.468878 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:27.468853    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-846bd484f-4qxsz_b96e4700-2203-4a26-b9d4-2611f29f0064/kube-auth-proxy/0.log"
Sep 10 03:03:27.706760 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:27.706728    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s7n4k_24a0331e-2321-4c75-8f8f-67f168e2d160/istio-proxy/1.log"
Sep 10 03:03:28.432638 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:28.432585    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-bp2tg_f0f11f64-544f-4e49-8d82-7e47ed9fb4b8/main/5.log"
Sep 10 03:03:28.893599 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:28.893525    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8mf8j_853fe7ed-4dc2-42ce-a730-233befdce497/main/0.log"
Sep 10 03:03:29.119689 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:29.119663    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-rt766_f8889941-9ee9-45ec-a508-dd2e125e62d6/main/5.log"
Sep 10 03:03:32.721584 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:32.721552    2564 scope.go:117] "RemoveContainer" containerID="ad370d9934da3e6ac41f293e7c546aa5df62b0419f60dcb9bef5314706ad4938"
Sep 10 03:03:32.721980 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:03:32.721743    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:03:34.539731 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:34.539694    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p4lv7/must-gather-gphwz"]
Sep 10 03:03:34.543240 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:34.543218    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4lv7/must-gather-gphwz"
Sep 10 03:03:34.546310 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:34.546286    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p4lv7\"/\"openshift-service-ca.crt\""
Sep 10 03:03:34.547270 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:34.547252    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p4lv7\"/\"default-dockercfg-lqv22\""
Sep 10 03:03:34.547346 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:34.547283    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p4lv7\"/\"kube-root-ca.crt\""
Sep 10 03:03:34.551258 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:34.551235    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4lv7/must-gather-gphwz"]
Sep 10 03:03:34.676355 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:34.676317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a64f0c00-3d22-495c-b019-9f9d9b9b2009-must-gather-output\") pod \"must-gather-gphwz\" (UID: \"a64f0c00-3d22-495c-b019-9f9d9b9b2009\") " pod="openshift-must-gather-p4lv7/must-gather-gphwz"
Sep 10 03:03:34.676529 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:34.676430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsc96\" (UniqueName: \"kubernetes.io/projected/a64f0c00-3d22-495c-b019-9f9d9b9b2009-kube-api-access-vsc96\") pod \"must-gather-gphwz\" (UID: \"a64f0c00-3d22-495c-b019-9f9d9b9b2009\") " pod="openshift-must-gather-p4lv7/must-gather-gphwz"
Sep 10 03:03:34.777217 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:34.777180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a64f0c00-3d22-495c-b019-9f9d9b9b2009-must-gather-output\") pod \"must-gather-gphwz\" (UID: \"a64f0c00-3d22-495c-b019-9f9d9b9b2009\") " pod="openshift-must-gather-p4lv7/must-gather-gphwz"
Sep 10 03:03:34.777391 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:34.777268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsc96\" (UniqueName: \"kubernetes.io/projected/a64f0c00-3d22-495c-b019-9f9d9b9b2009-kube-api-access-vsc96\") pod \"must-gather-gphwz\" (UID: \"a64f0c00-3d22-495c-b019-9f9d9b9b2009\") " pod="openshift-must-gather-p4lv7/must-gather-gphwz"
Sep 10 03:03:34.777580 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:34.777560    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a64f0c00-3d22-495c-b019-9f9d9b9b2009-must-gather-output\") pod \"must-gather-gphwz\" (UID: \"a64f0c00-3d22-495c-b019-9f9d9b9b2009\") " pod="openshift-must-gather-p4lv7/must-gather-gphwz"
Sep 10 03:03:34.785236 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:34.785214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsc96\" (UniqueName: \"kubernetes.io/projected/a64f0c00-3d22-495c-b019-9f9d9b9b2009-kube-api-access-vsc96\") pod \"must-gather-gphwz\" (UID: \"a64f0c00-3d22-495c-b019-9f9d9b9b2009\") " pod="openshift-must-gather-p4lv7/must-gather-gphwz"
Sep 10 03:03:34.853671 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:34.853564    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4lv7/must-gather-gphwz"
Sep 10 03:03:35.127436 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:35.127410    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4lv7/must-gather-gphwz"]
Sep 10 03:03:35.129749 ip-10-0-143-198 kubenswrapper[2564]: W0910 03:03:35.129725    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda64f0c00_3d22_495c_b019_9f9d9b9b2009.slice/crio-c9e6fe013e72e479c5c86086246e2c0ac1c1ed4349c3c5efe1c1f79885709aed WatchSource:0}: Error finding container c9e6fe013e72e479c5c86086246e2c0ac1c1ed4349c3c5efe1c1f79885709aed: Status 404 returned error can't find the container with id c9e6fe013e72e479c5c86086246e2c0ac1c1ed4349c3c5efe1c1f79885709aed
Sep 10 03:03:35.473212 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:35.473179    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4lv7/must-gather-gphwz" event={"ID":"a64f0c00-3d22-495c-b019-9f9d9b9b2009","Type":"ContainerStarted","Data":"c9e6fe013e72e479c5c86086246e2c0ac1c1ed4349c3c5efe1c1f79885709aed"}
Sep 10 03:03:36.481934 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:36.481901    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4lv7/must-gather-gphwz" event={"ID":"a64f0c00-3d22-495c-b019-9f9d9b9b2009","Type":"ContainerStarted","Data":"8d37b4da38a59cf6a4596524118ceab97b0b93fb5559401ea66dadcff72fa9bb"}
Sep 10 03:03:36.481934 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:36.481943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4lv7/must-gather-gphwz" event={"ID":"a64f0c00-3d22-495c-b019-9f9d9b9b2009","Type":"ContainerStarted","Data":"5794c5256c35b5f7dcd236f65b54677c8793416401c9cad09376d039e44cd7fa"}
Sep 10 03:03:36.499149 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:36.498327    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p4lv7/must-gather-gphwz" podStartSLOduration=1.6844376570000001 podStartE2EDuration="2.498303862s" totalImagesPullingTime="813.866205ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:03:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:03:36.496372995 +0000 UTC m=+857.284038337" watchObservedRunningTime="2026-09-10 03:03:36.498303862 +0000 UTC m=+857.285969181"
Sep 10 03:03:37.526304 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:37.526275    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r6sxm_2c14c85f-51c6-41d3-8edd-a3a27ec01497/global-pull-secret-syncer/0.log"
Sep 10 03:03:37.635656 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:37.635604    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6wpfq_9839b155-58d3-4a56-b8ad-e08621e92f06/konnectivity-agent/0.log"
Sep 10 03:03:37.737424 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:37.737395    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-198.ec2.internal_a4f320e49a706ec4bdf8b6ebf3e895a6/haproxy/0.log"
Sep 10 03:03:40.722495 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:40.722464    2564 scope.go:117] "RemoveContainer" containerID="a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806"
Sep 10 03:03:40.723289 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:03:40.723262    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:03:42.021414 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:42.021336    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-4dhc2_4f327683-c873-42f2-8905-1888f775d882/manager/0.log"
Sep 10 03:03:42.067455 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:42.067308    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-8rm5w_6df5c1cf-6fb8-4143-b43a-a087da381f5f/manager/0.log"
Sep 10 03:03:42.096018 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:42.095932    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-kxtzv_1c2b7278-6896-4c9c-893b-f3bc4273e3ba/kuadrant-console-plugin/0.log"
Sep 10 03:03:42.160342 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:42.160243    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-lfcf2_006e1f5b-eba6-4a5a-a71d-d4f5a1f621cc/limitador/0.log"
Sep 10 03:03:42.193924 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:42.193862    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-df8rf_be27aefe-a8ed-4f2c-a92d-4c08753593de/manager/0.log"
Sep 10 03:03:44.082754 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:44.082715    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdgj6_7e845696-6a29-4b46-a3db-3ed7f8182ce7/node-exporter/0.log"
Sep 10 03:03:44.105666 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:44.105636    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdgj6_7e845696-6a29-4b46-a3db-3ed7f8182ce7/kube-rbac-proxy/0.log"
Sep 10 03:03:44.129239 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:44.129200    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdgj6_7e845696-6a29-4b46-a3db-3ed7f8182ce7/init-textfile/0.log"
Sep 10 03:03:44.165776 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:44.165748    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-7k4mr_24070250-2e5c-416c-a78f-dde3b35fa512/kube-rbac-proxy-main/0.log"
Sep 10 03:03:44.192067 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:44.192028    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-7k4mr_24070250-2e5c-416c-a78f-dde3b35fa512/kube-rbac-proxy-self/0.log"
Sep 10 03:03:44.215938 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:44.215910    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-7k4mr_24070250-2e5c-416c-a78f-dde3b35fa512/openshift-state-metrics/0.log"
Sep 10 03:03:45.722589 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:45.722564    2564 scope.go:117] "RemoveContainer" containerID="ad370d9934da3e6ac41f293e7c546aa5df62b0419f60dcb9bef5314706ad4938"
Sep 10 03:03:45.723436 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:03:45.723410    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:03:48.542257 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.542219    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"]
Sep 10 03:03:48.548348 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.548316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.557122 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.557092    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"]
Sep 10 03:03:48.626164 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.626121    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rktqz\" (UniqueName: \"kubernetes.io/projected/1460da8d-62a2-4113-8273-420eb8bd0e79-kube-api-access-rktqz\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.626356 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.626253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1460da8d-62a2-4113-8273-420eb8bd0e79-proc\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.626356 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.626320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1460da8d-62a2-4113-8273-420eb8bd0e79-sys\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.626506 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.626357    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1460da8d-62a2-4113-8273-420eb8bd0e79-lib-modules\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.626506 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.626389    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1460da8d-62a2-4113-8273-420eb8bd0e79-podres\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.728555 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.727598    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rktqz\" (UniqueName: \"kubernetes.io/projected/1460da8d-62a2-4113-8273-420eb8bd0e79-kube-api-access-rktqz\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.728555 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.727713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1460da8d-62a2-4113-8273-420eb8bd0e79-proc\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.728555 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.727762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1460da8d-62a2-4113-8273-420eb8bd0e79-sys\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.728555 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.727790    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1460da8d-62a2-4113-8273-420eb8bd0e79-lib-modules\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.728555 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.727825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1460da8d-62a2-4113-8273-420eb8bd0e79-podres\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.728555 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.727988    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1460da8d-62a2-4113-8273-420eb8bd0e79-podres\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.728555 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.728360    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1460da8d-62a2-4113-8273-420eb8bd0e79-proc\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.728555 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.728420    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1460da8d-62a2-4113-8273-420eb8bd0e79-sys\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.728555 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.728524    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1460da8d-62a2-4113-8273-420eb8bd0e79-lib-modules\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.743548 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.743479    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rktqz\" (UniqueName: \"kubernetes.io/projected/1460da8d-62a2-4113-8273-420eb8bd0e79-kube-api-access-rktqz\") pod \"perf-node-gather-daemonset-gdvh5\" (UID: \"1460da8d-62a2-4113-8273-420eb8bd0e79\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:48.863778 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:48.863442    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:49.159801 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:49.159757    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"]
Sep 10 03:03:49.163084 ip-10-0-143-198 kubenswrapper[2564]: W0910 03:03:49.163053    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1460da8d_62a2_4113_8273_420eb8bd0e79.slice/crio-399dce887bef4b51601ead6e4ecf82a1dabdf091f06ac8f0864ab94b1734eecc WatchSource:0}: Error finding container 399dce887bef4b51601ead6e4ecf82a1dabdf091f06ac8f0864ab94b1734eecc: Status 404 returned error can't find the container with id 399dce887bef4b51601ead6e4ecf82a1dabdf091f06ac8f0864ab94b1734eecc
Sep 10 03:03:49.569762 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:49.569656    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5" event={"ID":"1460da8d-62a2-4113-8273-420eb8bd0e79","Type":"ContainerStarted","Data":"455f506059da321d26f8373df299dbb8756f51ab7a08d6487a5c3a18e0d1b296"}
Sep 10 03:03:49.569762 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:49.569725    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5" event={"ID":"1460da8d-62a2-4113-8273-420eb8bd0e79","Type":"ContainerStarted","Data":"399dce887bef4b51601ead6e4ecf82a1dabdf091f06ac8f0864ab94b1734eecc"}
Sep 10 03:03:49.570219 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:49.569990    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:49.586057 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:49.586011    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5" podStartSLOduration=1.585992683 podStartE2EDuration="1.585992683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:03:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:03:49.584724088 +0000 UTC m=+870.372389408" watchObservedRunningTime="2026-09-10 03:03:49.585992683 +0000 UTC m=+870.373658000"
Sep 10 03:03:49.594827 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:49.594799    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vd7th_8378614d-48a8-45e3-8e26-54b397b143b6/dns/0.log"
Sep 10 03:03:49.618195 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:49.618165    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vd7th_8378614d-48a8-45e3-8e26-54b397b143b6/kube-rbac-proxy/0.log"
Sep 10 03:03:49.642877 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:49.642850    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9cbc9_b45d4297-516d-4031-8116-7a7ca788ad9a/dns-node-resolver/0.log"
Sep 10 03:03:50.221802 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:50.221769    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-57bbb94767-sqwfk_eb3952fd-9994-47fb-b7e9-b648f2b98913/registry/0.log"
Sep 10 03:03:50.267009 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:50.266983    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gzsdt_310b155e-c685-4b20-92c9-a640ee2a4797/node-ca/0.log"
Sep 10 03:03:51.291093 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:51.291067    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-846bd484f-4qxsz_b96e4700-2203-4a26-b9d4-2611f29f0064/kube-auth-proxy/0.log"
Sep 10 03:03:51.347014 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:51.346981    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s7n4k_24a0331e-2321-4c75-8f8f-67f168e2d160/istio-proxy/1.log"
Sep 10 03:03:51.347538 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:51.347514    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s7n4k_24a0331e-2321-4c75-8f8f-67f168e2d160/istio-proxy/0.log"
Sep 10 03:03:52.060083 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:52.060055    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gs9lm_c3ec0101-6b1d-4d75-bb6b-921fd23f0c7a/serve-healthcheck-canary/0.log"
Sep 10 03:03:52.697602 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:52.697570    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5tpwp_83df7f59-7a1c-4fec-91ca-2a48ae8380e6/kube-rbac-proxy/0.log"
Sep 10 03:03:52.719255 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:52.719221    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5tpwp_83df7f59-7a1c-4fec-91ca-2a48ae8380e6/exporter/0.log"
Sep 10 03:03:52.740874 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:52.740848    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5tpwp_83df7f59-7a1c-4fec-91ca-2a48ae8380e6/extractor/0.log"
Sep 10 03:03:54.884394 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:54.884360    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-sflqv_ad0be7d7-e22e-4d61-8a91-5a8bca3ff167/manager/0.log"
Sep 10 03:03:54.923009 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:54.922977    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-55cgr_2f1c8ad7-d2a4-434b-93d4-def1c7ef8812/manager/0.log"
Sep 10 03:03:54.992526 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:54.992501    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-98rpl_19b58033-3f3d-4ac0-a133-0729effd783c/server/0.log"
Sep 10 03:03:55.044068 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:55.044037    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4gkkc_42cc036a-0516-417e-9180-dbd9bfc55c82/manager/0.log"
Sep 10 03:03:55.196564 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:55.196535    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f567c59b-rmnc7_41c75544-6630-404c-99b4-e8b7566edae0/manager/0.log"
Sep 10 03:03:55.215003 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:55.214976    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f567c59b-rmnc7_41c75544-6630-404c-99b4-e8b7566edae0/copy-manifests/0.log"
Sep 10 03:03:55.588643 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:55.588518    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-gdvh5"
Sep 10 03:03:55.721039 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:55.721009    2564 scope.go:117] "RemoveContainer" containerID="a06c0dd25f1d34d8ccabb48dfa55c0ca4676583fa99c19153fd259eb488e0806"
Sep 10 03:03:55.721383 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:03:55.721241    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-bp2tg_llm(f0f11f64-544f-4e49-8d82-7e47ed9fb4b8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-bp2tg" podUID="f0f11f64-544f-4e49-8d82-7e47ed9fb4b8"
Sep 10 03:03:56.722791 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:56.722757    2564 scope.go:117] "RemoveContainer" containerID="ad370d9934da3e6ac41f293e7c546aa5df62b0419f60dcb9bef5314706ad4938"
Sep 10 03:03:56.723254 ip-10-0-143-198 kubenswrapper[2564]: E0910 03:03:56.723056    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-rt766_llm(f8889941-9ee9-45ec-a508-dd2e125e62d6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-rt766" podUID="f8889941-9ee9-45ec-a508-dd2e125e62d6"
Sep 10 03:03:57.984427 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:57.984400    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-846bd484f-4qxsz_b96e4700-2203-4a26-b9d4-2611f29f0064/kube-auth-proxy/0.log"
Sep 10 03:03:58.026415 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:58.026358    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s7n4k_24a0331e-2321-4c75-8f8f-67f168e2d160/istio-proxy/1.log"
Sep 10 03:03:58.026960 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:58.026935    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s7n4k_24a0331e-2321-4c75-8f8f-67f168e2d160/istio-proxy/0.log"
Sep 10 03:03:59.326190 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:59.326151    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-846bd484f-4qxsz_b96e4700-2203-4a26-b9d4-2611f29f0064/kube-auth-proxy/0.log"
Sep 10 03:03:59.360832 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:59.360804    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s7n4k_24a0331e-2321-4c75-8f8f-67f168e2d160/istio-proxy/1.log"
Sep 10 03:03:59.361219 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:03:59.361200    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s7n4k_24a0331e-2321-4c75-8f8f-67f168e2d160/istio-proxy/0.log"
Sep 10 03:04:01.862625 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:01.862590    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-r6zgf_32daf6f5-902a-41e9-be8b-61908c598ed1/migrator/0.log"
Sep 10 03:04:01.887456 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:01.887421    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-r6zgf_32daf6f5-902a-41e9-be8b-61908c598ed1/graceful-termination/0.log"
Sep 10 03:04:03.556726 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:03.556694    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkf8z_a60a33d2-a6e3-49e9-bc7f-1f8df297e823/kube-multus-additional-cni-plugins/0.log"
Sep 10 03:04:03.579200 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:03.579174    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkf8z_a60a33d2-a6e3-49e9-bc7f-1f8df297e823/egress-router-binary-copy/0.log"
Sep 10 03:04:03.600207 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:03.600173    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkf8z_a60a33d2-a6e3-49e9-bc7f-1f8df297e823/cni-plugins/0.log"
Sep 10 03:04:03.621280 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:03.621256    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkf8z_a60a33d2-a6e3-49e9-bc7f-1f8df297e823/bond-cni-plugin/0.log"
Sep 10 03:04:03.642205 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:03.642181    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkf8z_a60a33d2-a6e3-49e9-bc7f-1f8df297e823/routeoverride-cni/0.log"
Sep 10 03:04:03.663583 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:03.663555    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkf8z_a60a33d2-a6e3-49e9-bc7f-1f8df297e823/whereabouts-cni-bincopy/0.log"
Sep 10 03:04:03.686376 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:03.686355    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkf8z_a60a33d2-a6e3-49e9-bc7f-1f8df297e823/whereabouts-cni/0.log"
Sep 10 03:04:03.871461 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:03.871381    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dxf6b_fcd228a3-a91c-4ea7-b631-e2585afd54bc/kube-multus/0.log"
Sep 10 03:04:03.938262 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:03.938236    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d4br4_8466af26-10ce-4dc3-a326-d798025b8220/network-metrics-daemon/0.log"
Sep 10 03:04:03.961100 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:03.961075    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d4br4_8466af26-10ce-4dc3-a326-d798025b8220/kube-rbac-proxy/0.log"
Sep 10 03:04:05.014046 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:05.014012    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4kmx_77322166-d6bf-43cd-99c6-97e11467f96b/ovn-controller/0.log"
Sep 10 03:04:05.031349 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:05.031325    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4kmx_77322166-d6bf-43cd-99c6-97e11467f96b/ovn-acl-logging/0.log"
Sep 10 03:04:05.054319 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:05.054292    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4kmx_77322166-d6bf-43cd-99c6-97e11467f96b/kube-rbac-proxy-node/0.log"
Sep 10 03:04:05.077900 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:05.077873    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4kmx_77322166-d6bf-43cd-99c6-97e11467f96b/kube-rbac-proxy-ovn-metrics/0.log"
Sep 10 03:04:05.100087 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:05.100058    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4kmx_77322166-d6bf-43cd-99c6-97e11467f96b/northd/0.log"
Sep 10 03:04:05.120083 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:05.120057    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4kmx_77322166-d6bf-43cd-99c6-97e11467f96b/nbdb/0.log"
Sep 10 03:04:05.141318 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:05.141293    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4kmx_77322166-d6bf-43cd-99c6-97e11467f96b/sbdb/0.log"
Sep 10 03:04:05.181131 ip-10-0-143-198 kubenswrapper[2564]: I0910 03:04:05.181103    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4kmx_77322166-d6bf-43cd-99c6-97e11467f96b/ovnkube-controller/0.log"