Sep 05 06:23:18.254730 ip-10-0-137-250 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 05 06:23:18.254741 ip-10-0-137-250 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 05 06:23:18.254751 ip-10-0-137-250 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 05 06:23:18.255078 ip-10-0-137-250 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 05 06:23:29.322453 ip-10-0-137-250 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 05 06:23:29.322467 ip-10-0-137-250 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 247864011177412bb8fadb718b9d823d --
Sep 05 06:25:02.287152 ip-10-0-137-250 systemd[1]: Starting Kubernetes Kubelet...
Sep 05 06:25:02.717427 ip-10-0-137-250 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 05 06:25:02.717427 ip-10-0-137-250 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 05 06:25:02.717427 ip-10-0-137-250 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 05 06:25:02.717427 ip-10-0-137-250 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 05 06:25:02.717427 ip-10-0-137-250 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 05 06:25:02.718347 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.718263    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 05 06:25:02.723447 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723432    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 05 06:25:02.723447 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723446    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723450    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723454    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723457    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723460    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723463    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723466    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723469    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723472    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723475    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723479    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723482    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723485    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723488    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723491    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723493    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723496    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723498    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723501    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723504    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 05 06:25:02.723511 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723506    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723510    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723513    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723515    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723519    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723523    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723527    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723530    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723533    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723536    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723539    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723542    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723545    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723547    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723550    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723552    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723555    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723558    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723560    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 05 06:25:02.724099 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723563    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723565    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723568    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723570    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723573    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723576    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723578    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723581    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723583    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723586    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723588    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723591    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723593    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723596    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723600    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723603    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723605    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723608    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723612    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723616    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 05 06:25:02.724812 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723618    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723622    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723624    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723628    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723631    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723634    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723638    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723642    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723645    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723647    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723650    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723653    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723656    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723658    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723661    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723664    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723667    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723671    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723674    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 05 06:25:02.725357 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723677    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723679    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723682    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723684    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723687    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723689    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723692    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723695    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723698    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723701    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723704    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723706    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723709    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723712    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723715    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723718    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723721    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723723    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723726    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.723728    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 05 06:25:02.725820 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725743    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725754    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725760    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725765    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725769    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725772    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725775    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725778    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725780    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725783    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725786    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725788    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725791    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725794    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725797    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725799    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725802    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725804    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725807    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 05 06:25:02.726360 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725809    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725812    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725814    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725817    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725824    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725827    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725830    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725833    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725835    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725838    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725841    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725844    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725847    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725854    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725856    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725876    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725880    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725883    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725886    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 05 06:25:02.726872 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725889    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725891    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725894    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725897    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725899    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725902    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725905    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725908    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725910    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725913    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725916    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725918    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725921    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725924    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725926    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725929    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725933    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725935    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725938    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725941    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 05 06:25:02.727346 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725943    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725945    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725948    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725951    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725953    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725955    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725958    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725961    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725964    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725967    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725970    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725972    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725975    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725977    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725980    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725982    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725985    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725987    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725991    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 05 06:25:02.727837 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725994    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725996    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.725999    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726001    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726004    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726006    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726009    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726012    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726014    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726017    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726019    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726022    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726025    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726027    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726030    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726032    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726035    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726038    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726040    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726044    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 05 06:25:02.728329 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726048    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726052    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726438    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726444    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726447    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726451    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726453    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726456    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726459    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726461    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726464    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726467    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726470    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726472    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726475    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726478    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726480    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726482    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726486    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726488    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 05 06:25:02.728817 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726491    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726493    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726496    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726499    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726501    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726504    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726506    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726509    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726511    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726513    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726516    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726518    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726521    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726524    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726527    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726530    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726532    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726536    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726539    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726542    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 05 06:25:02.729308 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726545    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726547    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726552    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726555    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726558    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726561    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726564    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726566    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726569    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726571    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726574    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726578    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726581    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726584    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726586    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726589    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726591    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726596    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726599    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 05 06:25:02.729799 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726602    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726604    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726607    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726609    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726612    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726614    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726617    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726620    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726622    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726625    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726627    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726630    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726632    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726634    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726637    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726640    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726642    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726644    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726648    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726650    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 05 06:25:02.730278 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726653    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726656    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726658    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726660    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726663    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726666    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726669    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726671    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726674    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726677    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726680    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726683    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726686    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726688    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726691    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726693    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726696    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726698    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726701    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 05 06:25:02.730768 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726703    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726706    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.726708    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726783    2583 flags.go:64] FLAG: --address="0.0.0.0"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726819    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726826    2583 flags.go:64] FLAG: --anonymous-auth="true"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726831    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726835    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726838    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726842    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726846    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726850    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726853    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726856    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726872    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726876    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726879    2583 flags.go:64] FLAG: --cgroup-root=""
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726882    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726885    2583 flags.go:64] FLAG: --client-ca-file=""
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726889    2583 flags.go:64] FLAG: --cloud-provider="external"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726892    2583 flags.go:64] FLAG: --cluster-dns="[]"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726896    2583 flags.go:64] FLAG: --cluster-domain=""
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726900    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726904    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 05 06:25:02.731254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726907    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726911    2583 flags.go:64] FLAG: --container-log-max-files="5"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726915    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726918    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726921    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726924    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726927    2583 flags.go:64] FLAG: --contention-profiling="false"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726930    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726933    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726936    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726939    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726944    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726947    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726950    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726952    2583 flags.go:64] FLAG: --enable-load-reader="false"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726955    2583 flags.go:64] FLAG: --enable-server="true"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726958    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726963    2583 flags.go:64] FLAG: --event-burst="100"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726966    2583 flags.go:64] FLAG: --event-qps="50"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726969    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726972    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726975    2583 flags.go:64] FLAG: --eviction-hard=""
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726978    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726981    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726984    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 05 06:25:02.731824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726987    2583 flags.go:64] FLAG: --eviction-soft=""
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726990    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726993    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726996    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.726999    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727002    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727006    2583 flags.go:64] FLAG: --fail-swap-on="true"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727009    2583 flags.go:64] FLAG: --feature-gates=""
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727013    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727016    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727019    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727022    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727025    2583 flags.go:64] FLAG: --healthz-port="10248"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727028    2583 flags.go:64] FLAG: --help="false"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727031    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-137-250.ec2.internal"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727034    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727037    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727040    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727043    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727047    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727049    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727052    2583 flags.go:64] FLAG: --image-service-endpoint=""
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727055    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 05 06:25:02.732482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727058    2583 flags.go:64] FLAG: --kube-api-burst="100"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727061    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727064    2583 flags.go:64] FLAG: --kube-api-qps="50"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727067    2583 flags.go:64] FLAG: --kube-reserved=""
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727070    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727073    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727076    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727079    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727082    2583 flags.go:64] FLAG: --lock-file=""
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727085    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727087    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727090    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727096    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727099    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727102    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727106    2583 flags.go:64] FLAG: --logging-format="text"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727109    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727112    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727115    2583 flags.go:64] FLAG: --manifest-url=""
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727118    2583 flags.go:64] FLAG: --manifest-url-header=""
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727122    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727125    2583 flags.go:64] FLAG: --max-open-files="1000000"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727128    2583 flags.go:64] FLAG: --max-pods="110"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727131    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727134    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 05 06:25:02.733093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727137    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727140    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727143    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727146    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727149    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727156    2583 flags.go:64] FLAG: --node-status-max-images="50"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727159    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727162    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727165    2583 flags.go:64] FLAG: --pod-cidr=""
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727168    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727173    2583 flags.go:64] FLAG: --pod-manifest-path=""
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727176    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727179    2583 flags.go:64] FLAG: --pods-per-core="0"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727182    2583 flags.go:64] FLAG: --port="10250"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727186    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727189    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02b037f47f76cb606"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727192    2583 flags.go:64] FLAG: --qos-reserved=""
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727195    2583 flags.go:64] FLAG: --read-only-port="10255"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727198    2583 flags.go:64] FLAG: --register-node="true"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727201    2583 flags.go:64] FLAG: --register-with-taints=""
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727204    2583 flags.go:64] FLAG: --registry-burst="10"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727208    2583 flags.go:64] FLAG: --registry-qps="5"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727211    2583 flags.go:64] FLAG: --reserved-cpus=""
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727214    2583 flags.go:64] FLAG: --reserved-memory=""
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727218    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 05 06:25:02.733712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727221    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727224    2583 flags.go:64] FLAG: --rotate-certificates="false"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727227    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727229    2583 flags.go:64] FLAG: --runonce="false"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727232    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727235    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727238    2583 flags.go:64] FLAG: --seccomp-default="false"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727241    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727244    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727247    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727250    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727253    2583 flags.go:64] FLAG: --storage-driver-password="root"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727256    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727259    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727262    2583 flags.go:64] FLAG: --storage-driver-user="root"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727265    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727268    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727271    2583 flags.go:64] FLAG: --system-cgroups=""
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727273    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727279    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727281    2583 flags.go:64] FLAG: --tls-cert-file=""
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727284    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727288    2583 flags.go:64] FLAG: --tls-min-version=""
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727291    2583 flags.go:64] FLAG: --tls-private-key-file=""
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727294    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 05 06:25:02.734343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727296    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727299    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727302    2583 flags.go:64] FLAG: --v="2"
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727307    2583 flags.go:64] FLAG: --version="false"
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727317    2583 flags.go:64] FLAG: --vmodule=""
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727321    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.727325    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727433    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727436    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727439    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727442    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727446    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727450    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727453    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727456    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727459    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727461    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727464    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727467    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727469    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727472    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 05 06:25:02.735322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727475    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727477    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727480    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727482    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727485    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727487    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727490    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727492    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727495    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727498    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727500    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727503    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727506    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727508    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727512    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727515    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727520    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727522    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727525    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727527    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 05 06:25:02.736240 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727529    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727532    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727535    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727537    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727540    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727542    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727545    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727547    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727550    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727552    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727555    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727557    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727560    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727563    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727565    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727568    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727570    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727573    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727577    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 05 06:25:02.737168 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727580    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727583    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727586    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727589    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727591    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727594    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727596    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727600    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727602    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727608    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727611    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727613    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727615    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727618    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727620    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727623    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727626    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727628    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727630    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727633    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 05 06:25:02.738027 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727635    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727638    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727640    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727643    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727645    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727648    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727650    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727653    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727656    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727659    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727663    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727665    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727668    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727671    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727673    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727676    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727678    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727681    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727683    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727687    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 05 06:25:02.738693 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727690    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727693    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727696    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727699    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727702    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.727704    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.728419    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.736752    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.736769    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.736788    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.736796    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736895    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736902    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736907    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736913    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 05 06:25:02.739445 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736917    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736922    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736927    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736932    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736937    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736942    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736947    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736951    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736955    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736959    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736963    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736968    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736972    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736977    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736981    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736985    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736989    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736993    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.736997    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737002    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 05 06:25:02.740129 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737006    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737010    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737014    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737019    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737022    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737029    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737034    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737038    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737042    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737046    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737050    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737055    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737059    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737063    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737067    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737071    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737075    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737079    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737083    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737087    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 05 06:25:02.740772 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737090    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737095    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737099    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737103    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737107    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737111    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737115    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737119    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737124    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737128    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737132    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737137    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737141    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737145    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737150    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737154    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737158    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737163    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737177    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737181    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 05 06:25:02.741403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737185    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737189    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737193    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737196    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737201    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737204    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737208    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737213    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737217    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737221    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737225    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737229    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737233    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737240    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737246    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737250    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737255    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737259    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737264    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 05 06:25:02.741962 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737268    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737272    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737277    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737281    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737286    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737291    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737297    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737303    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737307    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737315    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737322    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737326    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737332    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737337    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737341    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 05 06:25:02.742472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737347    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.737355    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737529    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737538    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737543    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737547    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737552    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737556    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737560    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737565    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737568    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737572    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737577    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737581    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737586    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 05 06:25:02.742842 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737590    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737597    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737602    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737606    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737611    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737616    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737621    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737625    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737630    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737634    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737639    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737643    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737647    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737652    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737656    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737661    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737665    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737669    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737673    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 05 06:25:02.743257 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737677    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737681    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737686    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737690    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737694    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737698    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737702    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737706    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737710    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737714    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737718    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737722    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737727    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737731    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737735    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737740    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737745    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737749    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737753    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 05 06:25:02.743743 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737757    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737761    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737765    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737769    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737774    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737778    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737782    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737786    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737790    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737794    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737799    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737803    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737807    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737811    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737815    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737819    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737823    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737827    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737831    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737835    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 05 06:25:02.744221 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737840    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737844    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737847    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737851    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737856    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737876    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737881    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737885    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737889    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737893    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737897    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737901    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737905    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737908    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737912    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737919    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737925    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737930    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737935    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737939    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 05 06:25:02.744730 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737944    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 05 06:25:02.745391 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737948    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 05 06:25:02.745391 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737951    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 05 06:25:02.745391 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737956    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 05 06:25:02.745391 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737960    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 05 06:25:02.745391 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737965    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 05 06:25:02.745391 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737969    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 05 06:25:02.745391 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:02.737973    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 05 06:25:02.745391 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.737980    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 05 06:25:02.745391 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.738131    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 05 06:25:02.745391 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.741203    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 05 06:25:02.745391 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.742261    2583 server.go:1019] "Starting client certificate rotation"
Sep 05 06:25:02.745391 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.742356    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 05 06:25:02.745391 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.743208    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 05 06:25:02.747263 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.747247    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 05 06:25:02.748353 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.748337    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 05 06:25:02.761332 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.761315    2583 log.go:25] "Validated CRI v1 runtime API"
Sep 05 06:25:02.764971 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.764954    2583 log.go:25] "Validated CRI v1 image API"
Sep 05 06:25:02.765824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.765808    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 05 06:25:02.768404 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.768384    2583 fs.go:135] Filesystem UUIDs: map[553f1fbe-0a02-484e-9807-8e6486fc75f7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9f11b21e-d30c-4a6d-a8c1-211ee0ee9140:/dev/nvme0n1p4]
Sep 05 06:25:02.768464 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.768403    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 05 06:25:02.773253 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.773140    2583 manager.go:216] Machine: {Timestamp:2026-09-05 06:25:02.771847808 +0000 UTC m=+0.376396637 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101087 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20041b92bdfa2e4b87f149c271b4c9 SystemUUID:ec20041b-92bd-fa2e-4b87-f149c271b4c9 BootID:24786401-1177-412b-b8fa-db718b9d823d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:32:fb:18:9a:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:32:fb:18:9a:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:30:6f:75:45:2b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 05 06:25:02.773253 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.773243    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 05 06:25:02.773376 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.773314    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 05 06:25:02.776893 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.776873    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 05 06:25:02.777103 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.777072    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 05 06:25:02.777290 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.777112    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 05 06:25:02.778062 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.778048    2583 topology_manager.go:138] "Creating topology manager with none policy"
Sep 05 06:25:02.778118 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.778067    2583 container_manager_linux.go:309] "Creating device plugin manager"
Sep 05 06:25:02.778118 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.778081    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 05 06:25:02.779022 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.779010    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 05 06:25:02.780877 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.780848    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 05 06:25:02.785440 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.785426    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 05 06:25:02.785567 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.785556    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 05 06:25:02.785634 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.785594    2583 kubelet.go:486] "Attempting to sync node with API server"
Sep 05 06:25:02.785634 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.785609    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 05 06:25:02.785634 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.785630    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 05 06:25:02.785764 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.785643    2583 kubelet.go:398] "Adding apiserver pod source"
Sep 05 06:25:02.785764 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.785656    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 05 06:25:02.786032 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.786018    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 05 06:25:02.786094 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.786040    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 05 06:25:02.788342 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.788318    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 05 06:25:02.791124 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.791110    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 05 06:25:02.791193 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.791139    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 05 06:25:02.791295 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.791285    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 05 06:25:02.791326 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.791300    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 05 06:25:02.791326 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.791306    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 05 06:25:02.791326 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.791311    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 05 06:25:02.791326 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.791319    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 05 06:25:02.791326 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.791324    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 05 06:25:02.792058 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.792048    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 05 06:25:02.792058 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.792058    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 05 06:25:02.792123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.792064    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 05 06:25:02.792123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.792071    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 05 06:25:02.792123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.792080    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 05 06:25:02.792123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.792088    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 05 06:25:02.792912 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.792901    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 05 06:25:02.792912 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.792911    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 05 06:25:02.796678 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.796661    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-250.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 05 06:25:02.796816 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.796798    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 05 06:25:02.796994 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.796975    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 05 06:25:02.798218 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.798202    2583 server.go:1268] "Started kubelet"
Sep 05 06:25:02.798349 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.798319    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 05 06:25:02.798396 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.798355    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 05 06:25:02.798452 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.798414    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 05 06:25:02.799482 ip-10-0-137-250 systemd[1]: Started Kubernetes Kubelet.
Sep 05 06:25:02.801046 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.801011    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 05 06:25:02.803217 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.802184    2583 server.go:310] "Adding debug handlers to kubelet server"
Sep 05 06:25:02.805264 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.805244    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 05 06:25:02.807037 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.807021    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 05 06:25:02.807124 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.807040    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 05 06:25:02.807179 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.807130    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Sep 05 06:25:02.807572 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.806445    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-250.ec2.internal.18d258ad2b472d23  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-250.ec2.internal,UID:ip-10-0-137-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-250.ec2.internal,},FirstTimestamp:2026-09-05 06:25:02.798179619 +0000 UTC m=+0.402728449,LastTimestamp:2026-09-05 06:25:02.798179619 +0000 UTC m=+0.402728449,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-250.ec2.internal,}"
Sep 05 06:25:02.807753 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.807736    2583 factory.go:55] Registering systemd factory
Sep 05 06:25:02.807815 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.807758    2583 factory.go:223] Registration of the systemd container factory successfully
Sep 05 06:25:02.807815 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.807766    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 05 06:25:02.807815 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.807796    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 05 06:25:02.807815 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.807811    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 05 06:25:02.808017 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.807908    2583 reconstruct.go:97] "Volume reconstruction finished"
Sep 05 06:25:02.808017 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.807917    2583 reconciler.go:29] "Reconciler: start to sync state"
Sep 05 06:25:02.808017 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.807962    2583 factory.go:153] Registering CRI-O factory
Sep 05 06:25:02.808017 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.807975    2583 factory.go:223] Registration of the crio container factory successfully
Sep 05 06:25:02.808174 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.808024    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 05 06:25:02.808174 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.808042    2583 factory.go:103] Registering Raw factory
Sep 05 06:25:02.808174 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.808056    2583 manager.go:1196] Started watching for new ooms in manager
Sep 05 06:25:02.808453 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.808441    2583 manager.go:349] Starting recovery of all containers
Sep 05 06:25:02.819221 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.819089    2583 manager.go:354] Recovery completed
Sep 05 06:25:02.819541 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.819517    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 05 06:25:02.819627 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.819558    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 05 06:25:02.824385 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.824372    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:02.826416 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.826396    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:02.826490 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.826432    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:02.826490 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.826448    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:02.826984 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.826969    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 05 06:25:02.826984 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.826978    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:02.826984 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.826981    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 05 06:25:02.827136 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.827000    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 05 06:25:02.827638 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.827624    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:02.827710 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.827652    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:02.827710 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.827672    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:02.829237 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.829219    2583 policy_none.go:49] "None policy: Start"
Sep 05 06:25:02.829321 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.829245    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 05 06:25:02.829321 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.829260    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 05 06:25:02.831326 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.831313    2583 policy_none.go:47] "Start"
Sep 05 06:25:02.832559 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.832539    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-577mm"
Sep 05 06:25:02.834438 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.834361    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-250.ec2.internal.18d258ad2cf606aa  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-250.ec2.internal,UID:ip-10-0-137-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-250.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-250.ec2.internal,},FirstTimestamp:2026-09-05 06:25:02.826415786 +0000 UTC m=+0.430964615,LastTimestamp:2026-09-05 06:25:02.826415786 +0000 UTC m=+0.430964615,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-250.ec2.internal,}"
Sep 05 06:25:02.840175 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.840113    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-250.ec2.internal.18d258ad2cf66101  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-250.ec2.internal,UID:ip-10-0-137-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-250.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-250.ec2.internal,},FirstTimestamp:2026-09-05 06:25:02.826438913 +0000 UTC m=+0.430987742,LastTimestamp:2026-09-05 06:25:02.826438913 +0000 UTC m=+0.430987742,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-250.ec2.internal,}"
Sep 05 06:25:02.841313 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.841295    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-577mm"
Sep 05 06:25:02.843960 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.843903    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-250.ec2.internal.18d258ad2cf6992d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-250.ec2.internal,UID:ip-10-0-137-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-250.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-250.ec2.internal,},FirstTimestamp:2026-09-05 06:25:02.826453293 +0000 UTC m=+0.431002125,LastTimestamp:2026-09-05 06:25:02.826453293 +0000 UTC m=+0.431002125,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-250.ec2.internal,}"
Sep 05 06:25:02.866391 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.866376    2583 manager.go:337] "Starting Device Plugin manager"
Sep 05 06:25:02.884828 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.866410    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 05 06:25:02.884828 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.866419    2583 server.go:87] "Starting device plugin registration server"
Sep 05 06:25:02.884828 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.866701    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 05 06:25:02.884828 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.866713    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 05 06:25:02.884828 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.866804    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 05 06:25:02.884828 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.866926    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 05 06:25:02.884828 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.866936    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 05 06:25:02.884828 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.867411    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 05 06:25:02.884828 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.867460    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-250.ec2.internal\" not found"
Sep 05 06:25:02.906490 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.906463    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 05 06:25:02.907670 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.907649    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 05 06:25:02.907753 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.907710    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 05 06:25:02.907753 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.907737    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 05 06:25:02.907854 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.907835    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 05 06:25:02.910223 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.910205    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 05 06:25:02.967963 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.967819    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:02.968937 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.968919    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:02.969044 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.968955    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:02.969044 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.968970    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:02.969044 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.969001    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-250.ec2.internal"
Sep 05 06:25:02.978591 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:02.978563    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-250.ec2.internal"
Sep 05 06:25:02.978707 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.978596    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-250.ec2.internal\": node \"ip-10-0-137-250.ec2.internal\" not found"
Sep 05 06:25:02.989987 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:02.989967    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Sep 05 06:25:03.008709 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.008679    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal"]
Sep 05 06:25:03.008788 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.008754    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:03.010439 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.010415    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:03.010549 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.010447    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:03.010549 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.010456    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:03.012831 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.012818    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:03.012959 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.012943    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.013017 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.012979    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:03.013642 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.013625    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:03.013725 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.013625    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:03.013725 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.013686    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:03.013725 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.013699    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:03.013824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.013653    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:03.013824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.013745    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:03.016046 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.016029    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.016128 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.016061    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:03.016783 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.016769    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:03.016827 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.016802    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:03.016827 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.016815    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:03.040611 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:03.040583    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-250.ec2.internal\" not found" node="ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.045073 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:03.045052    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-250.ec2.internal\" not found" node="ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.090427 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:03.090405    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Sep 05 06:25:03.108789 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.108766    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99986e247acbe53f812ba082518d7238-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal\" (UID: \"99986e247acbe53f812ba082518d7238\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.108898 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.108795    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99986e247acbe53f812ba082518d7238-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal\" (UID: \"99986e247acbe53f812ba082518d7238\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.108898 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.108820    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/315d8cbf3b078d65e6cd2c542ab86aac-config\") pod \"kube-apiserver-proxy-ip-10-0-137-250.ec2.internal\" (UID: \"315d8cbf3b078d65e6cd2c542ab86aac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.190930 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:03.190897    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Sep 05 06:25:03.209171 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.209144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99986e247acbe53f812ba082518d7238-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal\" (UID: \"99986e247acbe53f812ba082518d7238\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.209171 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.209163    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99986e247acbe53f812ba082518d7238-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal\" (UID: \"99986e247acbe53f812ba082518d7238\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.209299 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.209186    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/315d8cbf3b078d65e6cd2c542ab86aac-config\") pod \"kube-apiserver-proxy-ip-10-0-137-250.ec2.internal\" (UID: \"315d8cbf3b078d65e6cd2c542ab86aac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.209299 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.209202    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99986e247acbe53f812ba082518d7238-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal\" (UID: \"99986e247acbe53f812ba082518d7238\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.209299 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.209236    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99986e247acbe53f812ba082518d7238-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal\" (UID: \"99986e247acbe53f812ba082518d7238\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.209299 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.209237    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/315d8cbf3b078d65e6cd2c542ab86aac-config\") pod \"kube-apiserver-proxy-ip-10-0-137-250.ec2.internal\" (UID: \"315d8cbf3b078d65e6cd2c542ab86aac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.291639 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:03.291574    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Sep 05 06:25:03.344023 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.343998    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.347696 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.347670    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.392544 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:03.392518    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Sep 05 06:25:03.493371 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:03.493343    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Sep 05 06:25:03.595165 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:03.595082    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Sep 05 06:25:03.701653 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:03.701620    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Sep 05 06:25:03.743023 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.742995    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 05 06:25:03.743441 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.743143    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 05 06:25:03.802663 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:03.802638    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Sep 05 06:25:03.844903 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.844563    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-04 06:20:03 +0000 UTC" deadline="2028-04-19 19:58:42.0518438 +0000 UTC"
Sep 05 06:25:03.844903 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.844900    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14221h33m38.206951251s"
Sep 05 06:25:03.861400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.861380    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 05 06:25:03.907647 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.907600    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.923034 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.923010    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 05 06:25:03.924597 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.924580    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal"
Sep 05 06:25:03.934580 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.934564    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 05 06:25:03.952798 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.952777    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 05 06:25:03.980086 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:03.980056    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99986e247acbe53f812ba082518d7238.slice/crio-26b41e0f1eacb01a413e9b70ceff6d2d625091121cf90fc2bd90ca66457de696 WatchSource:0}: Error finding container 26b41e0f1eacb01a413e9b70ceff6d2d625091121cf90fc2bd90ca66457de696: Status 404 returned error can't find the container with id 26b41e0f1eacb01a413e9b70ceff6d2d625091121cf90fc2bd90ca66457de696
Sep 05 06:25:03.984853 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:03.984838    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 05 06:25:03.989701 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:03.989679    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315d8cbf3b078d65e6cd2c542ab86aac.slice/crio-1e992ba17d94e960bd87809e8c3db41489d1d332ddf42a7ad7c9dccac48e7f8e WatchSource:0}: Error finding container 1e992ba17d94e960bd87809e8c3db41489d1d332ddf42a7ad7c9dccac48e7f8e: Status 404 returned error can't find the container with id 1e992ba17d94e960bd87809e8c3db41489d1d332ddf42a7ad7c9dccac48e7f8e
Sep 05 06:25:04.003963 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.003940    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 05 06:25:04.787285 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.787248    2583 apiserver.go:52] "Watching apiserver"
Sep 05 06:25:04.796066 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.796046    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 05 06:25:04.797798 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.797294    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-9v682","kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal","openshift-multus/network-metrics-daemon-fdjjs","openshift-network-diagnostics/network-check-target-kjm8w","openshift-network-operator/iptables-alerter-ccql6","openshift-ovn-kubernetes/ovnkube-node-r5tkv","kube-system/global-pull-secret-syncer-82mp8","openshift-cluster-node-tuning-operator/tuned-m8wjr","openshift-dns/node-resolver-c5gst","openshift-image-registry/node-ca-24cbm","openshift-multus/multus-additional-cni-plugins-qvr8h","openshift-multus/multus-r9qv4"]
Sep 05 06:25:04.800013 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.799990    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.802325 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.802301    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.803034 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.802999    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 05 06:25:04.803173 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.803155    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w2jl5\""
Sep 05 06:25:04.803228 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.803197    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 05 06:25:04.804595 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.804568    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.805269 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.805249    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 05 06:25:04.805353 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.805280    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 05 06:25:04.805554 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.805533    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 05 06:25:04.805712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.805566    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 05 06:25:04.805906 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.805886    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7l6lj\""
Sep 05 06:25:04.806059 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.806043    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 05 06:25:04.806836 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.806812    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.807286 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.807265    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 05 06:25:04.807286 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.807276    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wvcj9\""
Sep 05 06:25:04.807445 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.807268    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 05 06:25:04.807535 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.807517    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 05 06:25:04.807634 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.807552    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 05 06:25:04.809135 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.809113    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:04.809232 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:04.809193    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:04.809502 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.809470    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 05 06:25:04.809611 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.809515    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ct5dn\""
Sep 05 06:25:04.811650 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.811594    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:04.811735 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:04.811669    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:04.814149 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.814130    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:04.814251 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:04.814183    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:04.816653 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.816634    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ccql6"
Sep 05 06:25:04.819216 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819193    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/665494d6-d2e1-4a6b-b101-d26c750878ab-multus-daemon-config\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.819318 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819257    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.819318 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819292    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:04.819445 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819363    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-sysconfig\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.819445 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819404    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-multus-conf-dir\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.819445 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819432    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m98kb\" (UniqueName: \"kubernetes.io/projected/665494d6-d2e1-4a6b-b101-d26c750878ab-kube-api-access-m98kb\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.819598 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819462    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18cf93ad-f837-4588-b868-b905984873ab-cnibin\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.819598 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819492    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18cf93ad-f837-4588-b868-b905984873ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.819598 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819520    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-socket-dir\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.819598 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819549    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-run-k8s-cni-cncf-io\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.819810 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-sys\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.819810 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819638    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-lib-modules\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.819810 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819667    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrjnr\" (UniqueName: \"kubernetes.io/projected/18cf93ad-f837-4588-b868-b905984873ab-kube-api-access-xrjnr\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.819810 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819696    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-registration-dir\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.819810 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819722    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-system-cni-dir\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.819810 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819752    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18cf93ad-f837-4588-b868-b905984873ab-system-cni-dir\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.819810 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819780    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18cf93ad-f837-4588-b868-b905984873ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.820206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819808    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.820206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-var-lib-cni-bin\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.820206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819867    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-var-lib-cni-multus\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.820206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819894    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvlz9\" (UniqueName: \"kubernetes.io/projected/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-kube-api-access-cvlz9\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:04.820206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819923    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-sysctl-conf\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.820206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.819983    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-systemd\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.820206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820023    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-host\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.820206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820051    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20e420e3-c0a1-41fe-b919-5d50f2381960-tmp\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.820206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820079    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-device-dir\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.820206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820120    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7vw7\" (UniqueName: \"kubernetes.io/projected/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-kube-api-access-m7vw7\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.820206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820153    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-multus-cni-dir\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.820206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820179    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-modprobe-d\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820207    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-var-lib-kubelet\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820267    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-tuned\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820295    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18cf93ad-f837-4588-b868-b905984873ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820321    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-sys-fs\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820349    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-cnibin\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820374    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-var-lib-kubelet\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820405    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-hostroot\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-sysctl-d\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820467    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b2q4\" (UniqueName: \"kubernetes.io/projected/20e420e3-c0a1-41fe-b919-5d50f2381960-kube-api-access-6b2q4\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18cf93ad-f837-4588-b868-b905984873ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820557    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-run-multus-certs\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820637    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-etc-kubernetes\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820690    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820735    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bn4jm\""
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820811    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-kubernetes\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.820859 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820840    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-run\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.821605 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820880    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 05 06:25:04.821605 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.821605 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.820975    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/665494d6-d2e1-4a6b-b101-d26c750878ab-cni-binary-copy\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.821605 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.821007    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-multus-socket-dir-parent\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.821605 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.821034    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-run-netns\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.821605 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.821126    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 05 06:25:04.821605 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.821313    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 05 06:25:04.821922 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.821683    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9v682"
Sep 05 06:25:04.822265 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.822246    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 05 06:25:04.822351 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.822249    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 05 06:25:04.822548 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.822531    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lk6g8\""
Sep 05 06:25:04.824151 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.823861    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 05 06:25:04.824151 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.823911    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 05 06:25:04.824151 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.823914    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 05 06:25:04.824151 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.823871    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 05 06:25:04.824525 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.824318    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c5gst"
Sep 05 06:25:04.825322 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.825297    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 05 06:25:04.825449 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.825323    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 05 06:25:04.825449 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.825376    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bqpbf\""
Sep 05 06:25:04.827128 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.827099    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 05 06:25:04.827248 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.827203    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-24cbm"
Sep 05 06:25:04.827669 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.827648    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 05 06:25:04.827801 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.827782    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g79fb\""
Sep 05 06:25:04.829780 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.829758    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 05 06:25:04.829780 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.829770    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-797lp\""
Sep 05 06:25:04.830128 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.830106    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 05 06:25:04.830313 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.830295    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 05 06:25:04.833807 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.833782    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 05 06:25:04.848124 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.848103    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b9sdf"
Sep 05 06:25:04.854813 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.854791    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b9sdf"
Sep 05 06:25:04.909678 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.909654    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 05 06:25:04.912254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.912192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal" event={"ID":"315d8cbf3b078d65e6cd2c542ab86aac","Type":"ContainerStarted","Data":"1e992ba17d94e960bd87809e8c3db41489d1d332ddf42a7ad7c9dccac48e7f8e"}
Sep 05 06:25:04.914344 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.914319    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal" event={"ID":"99986e247acbe53f812ba082518d7238","Type":"ContainerStarted","Data":"26b41e0f1eacb01a413e9b70ceff6d2d625091121cf90fc2bd90ca66457de696"}
Sep 05 06:25:04.921963 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.921933    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-multus-socket-dir-parent\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.922094 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.921986    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-kubelet\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.922094 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922015    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-cni-bin\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.922094 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922043    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-ovn-node-metrics-cert\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.922094 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922074    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4nmj\" (UniqueName: \"kubernetes.io/projected/32b062bd-e411-4997-ba7c-0ac37d425e38-kube-api-access-h4nmj\") pod \"node-ca-24cbm\" (UID: \"32b062bd-e411-4997-ba7c-0ac37d425e38\") " pod="openshift-image-registry/node-ca-24cbm"
Sep 05 06:25:04.922301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-multus-conf-dir\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.922301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922132    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m98kb\" (UniqueName: \"kubernetes.io/projected/665494d6-d2e1-4a6b-b101-d26c750878ab-kube-api-access-m98kb\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.922301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18cf93ad-f837-4588-b868-b905984873ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.922301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922191    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-socket-dir\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.922301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-run-k8s-cni-cncf-io\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.922301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922244    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/558f10f8-8ba3-4df9-b429-ccf99c2ef3a9-iptables-alerter-script\") pod \"iptables-alerter-ccql6\" (UID: \"558f10f8-8ba3-4df9-b429-ccf99c2ef3a9\") " pod="openshift-network-operator/iptables-alerter-ccql6"
Sep 05 06:25:04.922301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922271    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922301    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-ovnkube-script-lib\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922328    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-sys\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922351    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/558f10f8-8ba3-4df9-b429-ccf99c2ef3a9-host-slash\") pod \"iptables-alerter-ccql6\" (UID: \"558f10f8-8ba3-4df9-b429-ccf99c2ef3a9\") " pod="openshift-network-operator/iptables-alerter-ccql6"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922377    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-systemd-units\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922415    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-etc-openvswitch\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922436    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-cni-netd\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922457    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ae2eb04-2f07-4d37-9d15-8622b614403b-agent-certs\") pod \"konnectivity-agent-9v682\" (UID: \"6ae2eb04-2f07-4d37-9d15-8622b614403b\") " pod="kube-system/konnectivity-agent-9v682"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18cf93ad-f837-4588-b868-b905984873ab-system-cni-dir\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922513    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18cf93ad-f837-4588-b868-b905984873ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922544    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-var-lib-cni-multus\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvlz9\" (UniqueName: \"kubernetes.io/projected/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-kube-api-access-cvlz9\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922605    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-run-systemd\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922630    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922655    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7106bb4d-a09c-4d8a-af07-a349c2d464ef-hosts-file\") pod \"node-resolver-c5gst\" (UID: \"7106bb4d-a09c-4d8a-af07-a349c2d464ef\") " pod="openshift-dns/node-resolver-c5gst"
Sep 05 06:25:04.922694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922679    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-sysctl-conf\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922707    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-systemd\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922736    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7vw7\" (UniqueName: \"kubernetes.io/projected/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-kube-api-access-m7vw7\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922765    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-multus-cni-dir\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922781    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fx9s\" (UniqueName: \"kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s\") pod \"network-check-target-kjm8w\" (UID: \"a34a1345-6c29-45e4-a1a4-be9193bef176\") " pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922803    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-node-log\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922829    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922863    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5gfl\" (UniqueName: \"kubernetes.io/projected/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-kube-api-access-h5gfl\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.922892    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-var-lib-kubelet\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923016    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18cf93ad-f837-4588-b868-b905984873ab-system-cni-dir\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923060    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-sys\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923066    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-run-k8s-cni-cncf-io\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923131    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-var-lib-cni-multus\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923140    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-multus-socket-dir-parent\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923131    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923191    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-multus-conf-dir\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923348    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-sysctl-conf\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.923600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923407    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-systemd\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923645    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-multus-cni-dir\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923728    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-socket-dir\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923757    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18cf93ad-f837-4588-b868-b905984873ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923793    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-var-lib-kubelet\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-cnibin\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923849    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-hostroot\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923900    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-cnibin\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923934    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-etc-kubernetes\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923942    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-hostroot\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923980    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-log-socket\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.923983    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-etc-kubernetes\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924025    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ae2eb04-2f07-4d37-9d15-8622b614403b-konnectivity-ca\") pod \"konnectivity-agent-9v682\" (UID: \"6ae2eb04-2f07-4d37-9d15-8622b614403b\") " pod="kube-system/konnectivity-agent-9v682"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32b062bd-e411-4997-ba7c-0ac37d425e38-serviceca\") pod \"node-ca-24cbm\" (UID: \"32b062bd-e411-4997-ba7c-0ac37d425e38\") " pod="openshift-image-registry/node-ca-24cbm"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924125    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b2q4\" (UniqueName: \"kubernetes.io/projected/20e420e3-c0a1-41fe-b919-5d50f2381960-kube-api-access-6b2q4\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924151    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4f5v\" (UniqueName: \"kubernetes.io/projected/7106bb4d-a09c-4d8a-af07-a349c2d464ef-kube-api-access-g4f5v\") pod \"node-resolver-c5gst\" (UID: \"7106bb4d-a09c-4d8a-af07-a349c2d464ef\") " pod="openshift-dns/node-resolver-c5gst"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924198    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-run\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924230    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.924460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/665494d6-d2e1-4a6b-b101-d26c750878ab-cni-binary-copy\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924282    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-run-netns\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924288    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-run\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924312    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvhmk\" (UniqueName: \"kubernetes.io/projected/558f10f8-8ba3-4df9-b429-ccf99c2ef3a9-kube-api-access-nvhmk\") pod \"iptables-alerter-ccql6\" (UID: \"558f10f8-8ba3-4df9-b429-ccf99c2ef3a9\") " pod="openshift-network-operator/iptables-alerter-ccql6"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-sysconfig\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924371    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18cf93ad-f837-4588-b868-b905984873ab-cnibin\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924399    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/104a86cd-474f-4615-b7b5-94fd578c46a4-kubelet-config\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924421    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/104a86cd-474f-4615-b7b5-94fd578c46a4-dbus\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924429    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924447    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-lib-modules\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrjnr\" (UniqueName: \"kubernetes.io/projected/18cf93ad-f837-4588-b868-b905984873ab-kube-api-access-xrjnr\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924470    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-sysconfig\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924502    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-registration-dir\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924518    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18cf93ad-f837-4588-b868-b905984873ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924529    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-system-cni-dir\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-run-openvswitch\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-env-overrides\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.925400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924628    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18cf93ad-f837-4588-b868-b905984873ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924631    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18cf93ad-f837-4588-b868-b905984873ab-cnibin\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-var-lib-cni-bin\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924666    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-lib-modules\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924693    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-run-netns\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924713    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-var-lib-cni-bin\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924713    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-var-lib-openvswitch\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-host\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924754    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-registration-dir\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924760    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20e420e3-c0a1-41fe-b919-5d50f2381960-tmp\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924530    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-run-netns\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924777    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-device-dir\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924795    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-var-lib-kubelet\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924807    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-system-cni-dir\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/665494d6-d2e1-4a6b-b101-d26c750878ab-multus-daemon-config\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924837    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-var-lib-kubelet\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924966    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-host\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.924992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:04.926261 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925024    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-ovnkube-config\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-modprobe-d\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925075    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-tuned\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:04.925078    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925096    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-sys-fs\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925100    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-device-dir\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925118    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-run-multus-certs\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925148    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-modprobe-d\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925175    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-run-ovn\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925198    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32b062bd-e411-4997-ba7c-0ac37d425e38-host\") pod \"node-ca-24cbm\" (UID: \"32b062bd-e411-4997-ba7c-0ac37d425e38\") " pod="openshift-image-registry/node-ca-24cbm"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925203    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/665494d6-d2e1-4a6b-b101-d26c750878ab-host-run-multus-certs\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925051    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/665494d6-d2e1-4a6b-b101-d26c750878ab-cni-binary-copy\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925219    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18cf93ad-f837-4588-b868-b905984873ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925248    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-sysctl-d\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:04.925296    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs podName:d6d27aa9-3777-4509-9ff4-d4c47ffc3485 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:05.425273157 +0000 UTC m=+3.029821982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs") pod "network-metrics-daemon-fdjjs" (UID: "d6d27aa9-3777-4509-9ff4-d4c47ffc3485") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925302    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-sys-fs\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18cf93ad-f837-4588-b868-b905984873ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.927254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925371    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-slash\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:04.928275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925399    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7106bb4d-a09c-4d8a-af07-a349c2d464ef-tmp-dir\") pod \"node-resolver-c5gst\" (UID: \"7106bb4d-a09c-4d8a-af07-a349c2d464ef\") " pod="openshift-dns/node-resolver-c5gst"
Sep 05 06:25:04.928275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925377    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-sysctl-d\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.928275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925433    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-kubernetes\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.928275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925459    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 05 06:25:04.928275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925500    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-kubernetes\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.928275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925510    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18cf93ad-f837-4588-b868-b905984873ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.928275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.925711    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/665494d6-d2e1-4a6b-b101-d26c750878ab-multus-daemon-config\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.929466 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.929441    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20e420e3-c0a1-41fe-b919-5d50f2381960-tmp\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.929562 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.929470    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20e420e3-c0a1-41fe-b919-5d50f2381960-etc-tuned\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.935059 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.935035    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrjnr\" (UniqueName: \"kubernetes.io/projected/18cf93ad-f837-4588-b868-b905984873ab-kube-api-access-xrjnr\") pod \"multus-additional-cni-plugins-qvr8h\" (UID: \"18cf93ad-f837-4588-b868-b905984873ab\") " pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:04.935568 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.935540    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b2q4\" (UniqueName: \"kubernetes.io/projected/20e420e3-c0a1-41fe-b919-5d50f2381960-kube-api-access-6b2q4\") pod \"tuned-m8wjr\" (UID: \"20e420e3-c0a1-41fe-b919-5d50f2381960\") " pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:04.935857 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.935829    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m98kb\" (UniqueName: \"kubernetes.io/projected/665494d6-d2e1-4a6b-b101-d26c750878ab-kube-api-access-m98kb\") pod \"multus-r9qv4\" (UID: \"665494d6-d2e1-4a6b-b101-d26c750878ab\") " pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:04.936090 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.935911    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7vw7\" (UniqueName: \"kubernetes.io/projected/148ebb6a-92ba-4ef8-9315-53bdc399f7dd-kube-api-access-m7vw7\") pod \"aws-ebs-csi-driver-node-5fwrt\" (UID: \"148ebb6a-92ba-4ef8-9315-53bdc399f7dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:04.938266 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:04.938242    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvlz9\" (UniqueName: \"kubernetes.io/projected/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-kube-api-access-cvlz9\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:05.025690 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.025652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:05.025878 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.025703    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7106bb4d-a09c-4d8a-af07-a349c2d464ef-hosts-file\") pod \"node-resolver-c5gst\" (UID: \"7106bb4d-a09c-4d8a-af07-a349c2d464ef\") " pod="openshift-dns/node-resolver-c5gst"
Sep 05 06:25:05.025878 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.025736    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fx9s\" (UniqueName: \"kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s\") pod \"network-check-target-kjm8w\" (UID: \"a34a1345-6c29-45e4-a1a4-be9193bef176\") " pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:05.025878 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.025762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-node-log\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.025878 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.025787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.025878 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.025814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5gfl\" (UniqueName: \"kubernetes.io/projected/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-kube-api-access-h5gfl\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.025878 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.025843    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-log-socket\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.025878 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.025868    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ae2eb04-2f07-4d37-9d15-8622b614403b-konnectivity-ca\") pod \"konnectivity-agent-9v682\" (UID: \"6ae2eb04-2f07-4d37-9d15-8622b614403b\") " pod="kube-system/konnectivity-agent-9v682"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.025891    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32b062bd-e411-4997-ba7c-0ac37d425e38-serviceca\") pod \"node-ca-24cbm\" (UID: \"32b062bd-e411-4997-ba7c-0ac37d425e38\") " pod="openshift-image-registry/node-ca-24cbm"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.025927    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7106bb4d-a09c-4d8a-af07-a349c2d464ef-hosts-file\") pod \"node-resolver-c5gst\" (UID: \"7106bb4d-a09c-4d8a-af07-a349c2d464ef\") " pod="openshift-dns/node-resolver-c5gst"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.025936    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4f5v\" (UniqueName: \"kubernetes.io/projected/7106bb4d-a09c-4d8a-af07-a349c2d464ef-kube-api-access-g4f5v\") pod \"node-resolver-c5gst\" (UID: \"7106bb4d-a09c-4d8a-af07-a349c2d464ef\") " pod="openshift-dns/node-resolver-c5gst"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvhmk\" (UniqueName: \"kubernetes.io/projected/558f10f8-8ba3-4df9-b429-ccf99c2ef3a9-kube-api-access-nvhmk\") pod \"iptables-alerter-ccql6\" (UID: \"558f10f8-8ba3-4df9-b429-ccf99c2ef3a9\") " pod="openshift-network-operator/iptables-alerter-ccql6"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026033    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/104a86cd-474f-4615-b7b5-94fd578c46a4-kubelet-config\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026061    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/104a86cd-474f-4615-b7b5-94fd578c46a4-dbus\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-run-openvswitch\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026122    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-env-overrides\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026148    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-run-netns\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026175    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-var-lib-openvswitch\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026182    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-ovnkube-config\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-run-ovn\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026285    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32b062bd-e411-4997-ba7c-0ac37d425e38-host\") pod \"node-ca-24cbm\" (UID: \"32b062bd-e411-4997-ba7c-0ac37d425e38\") " pod="openshift-image-registry/node-ca-24cbm"
Sep 05 06:25:05.026293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026305    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-slash\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026322    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7106bb4d-a09c-4d8a-af07-a349c2d464ef-tmp-dir\") pod \"node-resolver-c5gst\" (UID: \"7106bb4d-a09c-4d8a-af07-a349c2d464ef\") " pod="openshift-dns/node-resolver-c5gst"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026348    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-kubelet\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026374    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-cni-bin\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026409    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-log-socket\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026413    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-ovn-node-metrics-cert\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026453    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4nmj\" (UniqueName: \"kubernetes.io/projected/32b062bd-e411-4997-ba7c-0ac37d425e38-kube-api-access-h4nmj\") pod \"node-ca-24cbm\" (UID: \"32b062bd-e411-4997-ba7c-0ac37d425e38\") " pod="openshift-image-registry/node-ca-24cbm"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026487    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/558f10f8-8ba3-4df9-b429-ccf99c2ef3a9-iptables-alerter-script\") pod \"iptables-alerter-ccql6\" (UID: \"558f10f8-8ba3-4df9-b429-ccf99c2ef3a9\") " pod="openshift-network-operator/iptables-alerter-ccql6"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026538    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-ovnkube-script-lib\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026564    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/558f10f8-8ba3-4df9-b429-ccf99c2ef3a9-host-slash\") pod \"iptables-alerter-ccql6\" (UID: \"558f10f8-8ba3-4df9-b429-ccf99c2ef3a9\") " pod="openshift-network-operator/iptables-alerter-ccql6"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026591    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-systemd-units\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026618    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-etc-openvswitch\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026644    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-cni-netd\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ae2eb04-2f07-4d37-9d15-8622b614403b-agent-certs\") pod \"konnectivity-agent-9v682\" (UID: \"6ae2eb04-2f07-4d37-9d15-8622b614403b\") " pod="kube-system/konnectivity-agent-9v682"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026703    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-run-systemd\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026806    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-run-systemd\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026799    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-var-lib-openvswitch\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.027097 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.025842    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:05.028087 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.026885    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret podName:104a86cd-474f-4615-b7b5-94fd578c46a4 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:05.526863703 +0000 UTC m=+3.131412541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret") pod "global-pull-secret-syncer-82mp8" (UID: "104a86cd-474f-4615-b7b5-94fd578c46a4") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:05.028087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.026924    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-node-log\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.028087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.027264    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/104a86cd-474f-4615-b7b5-94fd578c46a4-kubelet-config\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:05.028087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.027312    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/104a86cd-474f-4615-b7b5-94fd578c46a4-dbus\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:05.028087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.027338    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-run-openvswitch\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.028087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.027459    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ae2eb04-2f07-4d37-9d15-8622b614403b-konnectivity-ca\") pod \"konnectivity-agent-9v682\" (UID: \"6ae2eb04-2f07-4d37-9d15-8622b614403b\") " pod="kube-system/konnectivity-agent-9v682"
Sep 05 06:25:05.028087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.027775    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-env-overrides\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.028087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.027839    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-run-netns\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.028087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.027855    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32b062bd-e411-4997-ba7c-0ac37d425e38-serviceca\") pod \"node-ca-24cbm\" (UID: \"32b062bd-e411-4997-ba7c-0ac37d425e38\") " pod="openshift-image-registry/node-ca-24cbm"
Sep 05 06:25:05.028087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.027900    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/558f10f8-8ba3-4df9-b429-ccf99c2ef3a9-host-slash\") pod \"iptables-alerter-ccql6\" (UID: \"558f10f8-8ba3-4df9-b429-ccf99c2ef3a9\") " pod="openshift-network-operator/iptables-alerter-ccql6"
Sep 05 06:25:05.028087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.027913    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-systemd-units\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.028087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.027984    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-cni-netd\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.028698 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.028590    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/558f10f8-8ba3-4df9-b429-ccf99c2ef3a9-iptables-alerter-script\") pod \"iptables-alerter-ccql6\" (UID: \"558f10f8-8ba3-4df9-b429-ccf99c2ef3a9\") " pod="openshift-network-operator/iptables-alerter-ccql6"
Sep 05 06:25:05.028698 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.028663    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.028832 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.028772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32b062bd-e411-4997-ba7c-0ac37d425e38-host\") pod \"node-ca-24cbm\" (UID: \"32b062bd-e411-4997-ba7c-0ac37d425e38\") " pod="openshift-image-registry/node-ca-24cbm"
Sep 05 06:25:05.029141 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.028946    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-run-ovn\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.029141 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.029002    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-etc-openvswitch\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.029141 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.029012    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-slash\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.029141 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.029072    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-cni-bin\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.029141 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.029074    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-host-kubelet\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.029487 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.029159    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-ovnkube-script-lib\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.029487 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.029243    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7106bb4d-a09c-4d8a-af07-a349c2d464ef-tmp-dir\") pod \"node-resolver-c5gst\" (UID: \"7106bb4d-a09c-4d8a-af07-a349c2d464ef\") " pod="openshift-dns/node-resolver-c5gst"
Sep 05 06:25:05.029487 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.029328    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-ovnkube-config\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.030886 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.030849    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ae2eb04-2f07-4d37-9d15-8622b614403b-agent-certs\") pod \"konnectivity-agent-9v682\" (UID: \"6ae2eb04-2f07-4d37-9d15-8622b614403b\") " pod="kube-system/konnectivity-agent-9v682"
Sep 05 06:25:05.031432 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.031412    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-ovn-node-metrics-cert\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.034012 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.033881    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:25:05.034012 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.033926    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:25:05.034012 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.033942    2583 projected.go:196] Error preparing data for projected volume kube-api-access-9fx9s for pod openshift-network-diagnostics/network-check-target-kjm8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:05.034012 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.034012    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s podName:a34a1345-6c29-45e4-a1a4-be9193bef176 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:05.533994162 +0000 UTC m=+3.138543002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9fx9s" (UniqueName: "kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s") pod "network-check-target-kjm8w" (UID: "a34a1345-6c29-45e4-a1a4-be9193bef176") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:05.035569 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.035542    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4f5v\" (UniqueName: \"kubernetes.io/projected/7106bb4d-a09c-4d8a-af07-a349c2d464ef-kube-api-access-g4f5v\") pod \"node-resolver-c5gst\" (UID: \"7106bb4d-a09c-4d8a-af07-a349c2d464ef\") " pod="openshift-dns/node-resolver-c5gst"
Sep 05 06:25:05.037585 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.037386    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5gfl\" (UniqueName: \"kubernetes.io/projected/7d0d8164-177c-4ca9-bc74-bd74e82fb4a6-kube-api-access-h5gfl\") pod \"ovnkube-node-r5tkv\" (UID: \"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.039090 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.039064    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvhmk\" (UniqueName: \"kubernetes.io/projected/558f10f8-8ba3-4df9-b429-ccf99c2ef3a9-kube-api-access-nvhmk\") pod \"iptables-alerter-ccql6\" (UID: \"558f10f8-8ba3-4df9-b429-ccf99c2ef3a9\") " pod="openshift-network-operator/iptables-alerter-ccql6"
Sep 05 06:25:05.040161 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.040147    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4nmj\" (UniqueName: \"kubernetes.io/projected/32b062bd-e411-4997-ba7c-0ac37d425e38-kube-api-access-h4nmj\") pod \"node-ca-24cbm\" (UID: \"32b062bd-e411-4997-ba7c-0ac37d425e38\") " pod="openshift-image-registry/node-ca-24cbm"
Sep 05 06:25:05.111286 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.111248    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m8wjr"
Sep 05 06:25:05.129154 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.129127    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qvr8h"
Sep 05 06:25:05.138898 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.138858    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt"
Sep 05 06:25:05.144982 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.144956    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r9qv4"
Sep 05 06:25:05.152251 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.152230    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ccql6"
Sep 05 06:25:05.160131 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.160114    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:05.167255 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.167228    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9v682"
Sep 05 06:25:05.175165 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.175144    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c5gst"
Sep 05 06:25:05.180655 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.180637    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-24cbm"
Sep 05 06:25:05.430003 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.429918    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:05.430141 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.430054    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:05.430141 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.430122    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs podName:d6d27aa9-3777-4509-9ff4-d4c47ffc3485 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:06.43010729 +0000 UTC m=+4.034656107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs") pod "network-metrics-daemon-fdjjs" (UID: "d6d27aa9-3777-4509-9ff4-d4c47ffc3485") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:05.530774 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.530740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:05.530964 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.530907    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:05.531026 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.530966    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret podName:104a86cd-474f-4615-b7b5-94fd578c46a4 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:06.530950788 +0000 UTC m=+4.135499605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret") pod "global-pull-secret-syncer-82mp8" (UID: "104a86cd-474f-4615-b7b5-94fd578c46a4") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:05.631553 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.631516    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fx9s\" (UniqueName: \"kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s\") pod \"network-check-target-kjm8w\" (UID: \"a34a1345-6c29-45e4-a1a4-be9193bef176\") " pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:05.631739 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.631723    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:25:05.631791 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.631751    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:25:05.631791 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.631763    2583 projected.go:196] Error preparing data for projected volume kube-api-access-9fx9s for pod openshift-network-diagnostics/network-check-target-kjm8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:05.631905 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.631840    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s podName:a34a1345-6c29-45e4-a1a4-be9193bef176 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:06.631821626 +0000 UTC m=+4.236370445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fx9s" (UniqueName: "kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s") pod "network-check-target-kjm8w" (UID: "a34a1345-6c29-45e4-a1a4-be9193bef176") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:05.858543 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.858444    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-04 06:20:05 +0000 UTC" deadline="2028-04-21 17:50:49.472210016 +0000 UTC"
Sep 05 06:25:05.858543 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.858478    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14267h25m43.613735082s"
Sep 05 06:25:05.909704 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:05.909669    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:05.909859 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:05.909791    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:06.179047 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:06.178796    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665494d6_d2e1_4a6b_b101_d26c750878ab.slice/crio-aef5cf05d5ebe34f1eca99dd555352d0417b1d39d6f5a7d2ddc7e9fb376feaa6 WatchSource:0}: Error finding container aef5cf05d5ebe34f1eca99dd555352d0417b1d39d6f5a7d2ddc7e9fb376feaa6: Status 404 returned error can't find the container with id aef5cf05d5ebe34f1eca99dd555352d0417b1d39d6f5a7d2ddc7e9fb376feaa6
Sep 05 06:25:06.181302 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:06.181269    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b062bd_e411_4997_ba7c_0ac37d425e38.slice/crio-cadd4f928d2bc94ccbb6a1c9c874a288dc8e712e999b07361607f252f92e7a93 WatchSource:0}: Error finding container cadd4f928d2bc94ccbb6a1c9c874a288dc8e712e999b07361607f252f92e7a93: Status 404 returned error can't find the container with id cadd4f928d2bc94ccbb6a1c9c874a288dc8e712e999b07361607f252f92e7a93
Sep 05 06:25:06.181574 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:06.181496    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7106bb4d_a09c_4d8a_af07_a349c2d464ef.slice/crio-21ffaf39b6d52960f2d7a822b3f5674bc1cf4f4fc2c428eff25f95617be5b181 WatchSource:0}: Error finding container 21ffaf39b6d52960f2d7a822b3f5674bc1cf4f4fc2c428eff25f95617be5b181: Status 404 returned error can't find the container with id 21ffaf39b6d52960f2d7a822b3f5674bc1cf4f4fc2c428eff25f95617be5b181
Sep 05 06:25:06.182255 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:06.182235    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e420e3_c0a1_41fe_b919_5d50f2381960.slice/crio-00260f2c948ae8ef280ab9a38960eb124da081c8fd90ccb94ed7d575e1a363a6 WatchSource:0}: Error finding container 00260f2c948ae8ef280ab9a38960eb124da081c8fd90ccb94ed7d575e1a363a6: Status 404 returned error can't find the container with id 00260f2c948ae8ef280ab9a38960eb124da081c8fd90ccb94ed7d575e1a363a6
Sep 05 06:25:06.206851 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:06.206831    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18cf93ad_f837_4588_b868_b905984873ab.slice/crio-43d4b6b82418fde53069c4ae95959c4667416600da49a941f5f8919e48720283 WatchSource:0}: Error finding container 43d4b6b82418fde53069c4ae95959c4667416600da49a941f5f8919e48720283: Status 404 returned error can't find the container with id 43d4b6b82418fde53069c4ae95959c4667416600da49a941f5f8919e48720283
Sep 05 06:25:06.207491 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:06.207466    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558f10f8_8ba3_4df9_b429_ccf99c2ef3a9.slice/crio-1e13b0c94a1e6dfb8c126b610e445bc8898acf6e0c6f1b6663fcd94521076ee2 WatchSource:0}: Error finding container 1e13b0c94a1e6dfb8c126b610e445bc8898acf6e0c6f1b6663fcd94521076ee2: Status 404 returned error can't find the container with id 1e13b0c94a1e6dfb8c126b610e445bc8898acf6e0c6f1b6663fcd94521076ee2
Sep 05 06:25:06.208647 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:06.208492    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae2eb04_2f07_4d37_9d15_8622b614403b.slice/crio-26224772b63af3694c69de1300d04472df8c6ca1f086bddada2332999a972aea WatchSource:0}: Error finding container 26224772b63af3694c69de1300d04472df8c6ca1f086bddada2332999a972aea: Status 404 returned error can't find the container with id 26224772b63af3694c69de1300d04472df8c6ca1f086bddada2332999a972aea
Sep 05 06:25:06.209292 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:06.209262    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d0d8164_177c_4ca9_bc74_bd74e82fb4a6.slice/crio-9342ecda395c79a14a5454aaac5e4575a27c0130e72e31be4d9a25f9a47feda7 WatchSource:0}: Error finding container 9342ecda395c79a14a5454aaac5e4575a27c0130e72e31be4d9a25f9a47feda7: Status 404 returned error can't find the container with id 9342ecda395c79a14a5454aaac5e4575a27c0130e72e31be4d9a25f9a47feda7
Sep 05 06:25:06.210284 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:06.210205    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod148ebb6a_92ba_4ef8_9315_53bdc399f7dd.slice/crio-79f9ead4923f67a9933f2e94d21daa2e5b2079bc699445985aa2f5b1e6557479 WatchSource:0}: Error finding container 79f9ead4923f67a9933f2e94d21daa2e5b2079bc699445985aa2f5b1e6557479: Status 404 returned error can't find the container with id 79f9ead4923f67a9933f2e94d21daa2e5b2079bc699445985aa2f5b1e6557479
Sep 05 06:25:06.438404 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:06.438326    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:06.438541 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:06.438450    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:06.438541 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:06.438507    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs podName:d6d27aa9-3777-4509-9ff4-d4c47ffc3485 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:08.438493781 +0000 UTC m=+6.043042598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs") pod "network-metrics-daemon-fdjjs" (UID: "d6d27aa9-3777-4509-9ff4-d4c47ffc3485") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:06.539504 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:06.539470    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:06.539645 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:06.539625    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:06.539719 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:06.539709    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret podName:104a86cd-474f-4615-b7b5-94fd578c46a4 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:08.539687153 +0000 UTC m=+6.144235974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret") pod "global-pull-secret-syncer-82mp8" (UID: "104a86cd-474f-4615-b7b5-94fd578c46a4") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:06.640201 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:06.640148    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fx9s\" (UniqueName: \"kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s\") pod \"network-check-target-kjm8w\" (UID: \"a34a1345-6c29-45e4-a1a4-be9193bef176\") " pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:06.640377 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:06.640323    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:25:06.640377 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:06.640348    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:25:06.640377 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:06.640361    2583 projected.go:196] Error preparing data for projected volume kube-api-access-9fx9s for pod openshift-network-diagnostics/network-check-target-kjm8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:06.640504 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:06.640419    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s podName:a34a1345-6c29-45e4-a1a4-be9193bef176 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:08.640404688 +0000 UTC m=+6.244953505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fx9s" (UniqueName: "kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s") pod "network-check-target-kjm8w" (UID: "a34a1345-6c29-45e4-a1a4-be9193bef176") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:06.859777 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:06.859675    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-04 06:20:05 +0000 UTC" deadline="2028-04-06 22:14:23.031031506 +0000 UTC"
Sep 05 06:25:06.859777 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:06.859720    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13911h49m16.171316999s"
Sep 05 06:25:06.909986 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:06.909200    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:06.909986 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:06.909357    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:06.909986 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:06.909804    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:06.909986 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:06.909944    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:06.939918 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:06.936840    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ccql6" event={"ID":"558f10f8-8ba3-4df9-b429-ccf99c2ef3a9","Type":"ContainerStarted","Data":"1e13b0c94a1e6dfb8c126b610e445bc8898acf6e0c6f1b6663fcd94521076ee2"}
Sep 05 06:25:06.945858 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:06.945780    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m8wjr" event={"ID":"20e420e3-c0a1-41fe-b919-5d50f2381960","Type":"ContainerStarted","Data":"00260f2c948ae8ef280ab9a38960eb124da081c8fd90ccb94ed7d575e1a363a6"}
Sep 05 06:25:06.955099 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:06.955067    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c5gst" event={"ID":"7106bb4d-a09c-4d8a-af07-a349c2d464ef","Type":"ContainerStarted","Data":"21ffaf39b6d52960f2d7a822b3f5674bc1cf4f4fc2c428eff25f95617be5b181"}
Sep 05 06:25:06.968638 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:06.968610    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r9qv4" event={"ID":"665494d6-d2e1-4a6b-b101-d26c750878ab","Type":"ContainerStarted","Data":"aef5cf05d5ebe34f1eca99dd555352d0417b1d39d6f5a7d2ddc7e9fb376feaa6"}
Sep 05 06:25:06.989871 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:06.989837    2583 generic.go:356] "Generic (PLEG): container finished" podID="99986e247acbe53f812ba082518d7238" containerID="58acb37cf88065b32be45b196984d1b07ed3c310d6770c48b28e51f9627ebfd7" exitCode=0
Sep 05 06:25:06.990008 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:06.989930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal" event={"ID":"99986e247acbe53f812ba082518d7238","Type":"ContainerDied","Data":"58acb37cf88065b32be45b196984d1b07ed3c310d6770c48b28e51f9627ebfd7"}
Sep 05 06:25:07.000541 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:07.000458    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvr8h" event={"ID":"18cf93ad-f837-4588-b868-b905984873ab","Type":"ContainerStarted","Data":"43d4b6b82418fde53069c4ae95959c4667416600da49a941f5f8919e48720283"}
Sep 05 06:25:07.003410 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:07.003338    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-24cbm" event={"ID":"32b062bd-e411-4997-ba7c-0ac37d425e38","Type":"ContainerStarted","Data":"cadd4f928d2bc94ccbb6a1c9c874a288dc8e712e999b07361607f252f92e7a93"}
Sep 05 06:25:07.010952 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:07.010922    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal" event={"ID":"315d8cbf3b078d65e6cd2c542ab86aac","Type":"ContainerStarted","Data":"a274734d5030440821ca66e8be86ab4e49f959495edf4f011e4a512747b964da"}
Sep 05 06:25:07.014764 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:07.014740    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt" event={"ID":"148ebb6a-92ba-4ef8-9315-53bdc399f7dd","Type":"ContainerStarted","Data":"79f9ead4923f67a9933f2e94d21daa2e5b2079bc699445985aa2f5b1e6557479"}
Sep 05 06:25:07.018301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:07.018206    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv" event={"ID":"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6","Type":"ContainerStarted","Data":"9342ecda395c79a14a5454aaac5e4575a27c0130e72e31be4d9a25f9a47feda7"}
Sep 05 06:25:07.024490 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:07.024432    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9v682" event={"ID":"6ae2eb04-2f07-4d37-9d15-8622b614403b","Type":"ContainerStarted","Data":"26224772b63af3694c69de1300d04472df8c6ca1f086bddada2332999a972aea"}
Sep 05 06:25:07.908484 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:07.908406    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:07.909097 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:07.908556    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:08.032248 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:08.032213    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal" event={"ID":"99986e247acbe53f812ba082518d7238","Type":"ContainerStarted","Data":"c85c589d50edfabf572894a73c14f61674a6bc5fb1c33d2c5f2358424f53b86f"}
Sep 05 06:25:08.047611 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:08.046845    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal" podStartSLOduration=4.046823777 podStartE2EDuration="4.046823777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:07.026185334 +0000 UTC m=+4.630734174" watchObservedRunningTime="2026-09-05 06:25:08.046823777 +0000 UTC m=+5.651372619"
Sep 05 06:25:08.047611 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:08.047100    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal" podStartSLOduration=4.047092333 podStartE2EDuration="4.047092333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:08.04632127 +0000 UTC m=+5.650870110" watchObservedRunningTime="2026-09-05 06:25:08.047092333 +0000 UTC m=+5.651641164"
Sep 05 06:25:08.458842 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:08.458804    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:08.459043 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:08.459010    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:08.459124 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:08.459077    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs podName:d6d27aa9-3777-4509-9ff4-d4c47ffc3485 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:12.459060973 +0000 UTC m=+10.063609790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs") pod "network-metrics-daemon-fdjjs" (UID: "d6d27aa9-3777-4509-9ff4-d4c47ffc3485") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:08.563700 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:08.563076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:08.563700 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:08.563287    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:08.563700 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:08.563351    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret podName:104a86cd-474f-4615-b7b5-94fd578c46a4 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:12.563331906 +0000 UTC m=+10.167880724 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret") pod "global-pull-secret-syncer-82mp8" (UID: "104a86cd-474f-4615-b7b5-94fd578c46a4") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:08.664034 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:08.663968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fx9s\" (UniqueName: \"kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s\") pod \"network-check-target-kjm8w\" (UID: \"a34a1345-6c29-45e4-a1a4-be9193bef176\") " pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:08.664259 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:08.664171    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:25:08.664259 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:08.664203    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:25:08.664259 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:08.664217    2583 projected.go:196] Error preparing data for projected volume kube-api-access-9fx9s for pod openshift-network-diagnostics/network-check-target-kjm8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:08.664488 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:08.664281    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s podName:a34a1345-6c29-45e4-a1a4-be9193bef176 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:12.664261579 +0000 UTC m=+10.268810411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fx9s" (UniqueName: "kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s") pod "network-check-target-kjm8w" (UID: "a34a1345-6c29-45e4-a1a4-be9193bef176") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:08.911361 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:08.911277    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:08.911824 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:08.911414    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:08.911824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:08.911796    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:08.911964 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:08.911908    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:09.908717 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:09.908684    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:09.908933 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:09.908837    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:10.909191 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:10.908775    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:10.909191 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:10.908926    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:10.909191 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:10.909038    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:10.909191 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:10.909153    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:11.907979 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:11.907945    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:11.908150 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:11.908097    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:12.496618 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:12.496579    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:12.497069 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:12.496703    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:12.497069 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:12.496769    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs podName:d6d27aa9-3777-4509-9ff4-d4c47ffc3485 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:20.496751329 +0000 UTC m=+18.101300159 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs") pod "network-metrics-daemon-fdjjs" (UID: "d6d27aa9-3777-4509-9ff4-d4c47ffc3485") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:12.597108 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:12.597072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:12.597282 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:12.597267    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:12.597337 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:12.597328    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret podName:104a86cd-474f-4615-b7b5-94fd578c46a4 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:20.59731101 +0000 UTC m=+18.201859831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret") pod "global-pull-secret-syncer-82mp8" (UID: "104a86cd-474f-4615-b7b5-94fd578c46a4") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:12.697564 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:12.697486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fx9s\" (UniqueName: \"kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s\") pod \"network-check-target-kjm8w\" (UID: \"a34a1345-6c29-45e4-a1a4-be9193bef176\") " pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:12.697744 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:12.697661    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:25:12.697744 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:12.697679    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:25:12.697744 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:12.697689    2583 projected.go:196] Error preparing data for projected volume kube-api-access-9fx9s for pod openshift-network-diagnostics/network-check-target-kjm8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:12.697911 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:12.697748    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s podName:a34a1345-6c29-45e4-a1a4-be9193bef176 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:20.697729161 +0000 UTC m=+18.302277980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fx9s" (UniqueName: "kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s") pod "network-check-target-kjm8w" (UID: "a34a1345-6c29-45e4-a1a4-be9193bef176") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:12.909740 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:12.909125    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:12.909740 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:12.909221    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:12.909740 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:12.909551    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:12.909740 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:12.909641    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:13.908715 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:13.908677    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:13.909174 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:13.908833    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:14.909017 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:14.908928    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:14.909460 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:14.909070    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:14.909460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:14.909147    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:14.909460 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:14.909273    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:15.908199 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:15.908160    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:15.908387 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:15.908309    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:16.908827 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:16.908745    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:16.909259 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:16.908887    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:16.909259 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:16.908925    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:16.909259 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:16.909027    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:17.908511 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:17.908482    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:17.908690 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:17.908602    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:18.908313 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:18.908276    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:18.908768 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:18.908276    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:18.908768 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:18.908424    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:18.908768 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:18.908495    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:19.908753 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:19.908586    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:19.909046 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:19.908840    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:20.556776 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:20.556744    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:20.556981 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:20.556960    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:20.557062 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:20.557050    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs podName:d6d27aa9-3777-4509-9ff4-d4c47ffc3485 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:36.557021094 +0000 UTC m=+34.161569911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs") pod "network-metrics-daemon-fdjjs" (UID: "d6d27aa9-3777-4509-9ff4-d4c47ffc3485") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:20.657435 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:20.657400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:20.657602 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:20.657581    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:20.657687 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:20.657676    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret podName:104a86cd-474f-4615-b7b5-94fd578c46a4 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:36.657658706 +0000 UTC m=+34.262207534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret") pod "global-pull-secret-syncer-82mp8" (UID: "104a86cd-474f-4615-b7b5-94fd578c46a4") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:20.758420 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:20.758385    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fx9s\" (UniqueName: \"kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s\") pod \"network-check-target-kjm8w\" (UID: \"a34a1345-6c29-45e4-a1a4-be9193bef176\") " pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:20.758592 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:20.758550    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:25:20.758592 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:20.758567    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:25:20.758592 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:20.758579    2583 projected.go:196] Error preparing data for projected volume kube-api-access-9fx9s for pod openshift-network-diagnostics/network-check-target-kjm8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:20.758755 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:20.758651    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s podName:a34a1345-6c29-45e4-a1a4-be9193bef176 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:36.758632324 +0000 UTC m=+34.363181140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fx9s" (UniqueName: "kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s") pod "network-check-target-kjm8w" (UID: "a34a1345-6c29-45e4-a1a4-be9193bef176") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:20.908101 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:20.908003    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:20.908246 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:20.908117    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:20.908246 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:20.908174    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:20.908341 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:20.908257    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:21.908639 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:21.908606    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:21.909069 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:21.908745    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:22.909081 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:22.909049    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:22.909544 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:22.909140    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:22.909544 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:22.909170    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:22.909544 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:22.909216    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:23.908795 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:23.908770    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:23.908924 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:23.908880    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:24.908824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:24.908745    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:24.909536 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:24.908893    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:24.909536 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:24.908918    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:24.909536 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:24.909007    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:25.078202 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.078166    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt" event={"ID":"148ebb6a-92ba-4ef8-9315-53bdc399f7dd","Type":"ContainerStarted","Data":"b28b53263ea6005c40bdef6f691b0d9e74352ab2b0767fd0793b77fa55f6da9c"}
Sep 05 06:25:25.081159 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.081133    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv" event={"ID":"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6","Type":"ContainerStarted","Data":"4def14e46fd07ee1f89df106d38fc6bb6afcb2663dfa0e337432752a245d1e1b"}
Sep 05 06:25:25.081297 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.081208    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv" event={"ID":"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6","Type":"ContainerStarted","Data":"128ee2d8b3e983a23ce22250adb0af5b6d2790d6919a0737a87b3f7e86d291fb"}
Sep 05 06:25:25.081297 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.081256    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv" event={"ID":"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6","Type":"ContainerStarted","Data":"0567e4e587ae99b3b52888f8d0721620510b32defd1e3a333056a5fd11420761"}
Sep 05 06:25:25.081416 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.081299    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv" event={"ID":"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6","Type":"ContainerStarted","Data":"45e5576d33d92c7a853c75b2ae419d0acbdf39e224de836fb06c59be1e7924cb"}
Sep 05 06:25:25.081416 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.081346    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv" event={"ID":"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6","Type":"ContainerStarted","Data":"ec6e374a91821956f0ff6b055ffeabf2fd4a68bfffc8c076ab7b17141c3bee7f"}
Sep 05 06:25:25.081416 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.081393    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv" event={"ID":"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6","Type":"ContainerStarted","Data":"32974fac97f7636370293c15719cf2fa45a91c8fd61e42f156bb7332349e51d6"}
Sep 05 06:25:25.082417 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.082392    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9v682" event={"ID":"6ae2eb04-2f07-4d37-9d15-8622b614403b","Type":"ContainerStarted","Data":"09eed1d2a98dfa4e62e225b77b4ac3dc63bdcb262f6bf756a09cea2acb686877"}
Sep 05 06:25:25.083888 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.083853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m8wjr" event={"ID":"20e420e3-c0a1-41fe-b919-5d50f2381960","Type":"ContainerStarted","Data":"8e6536538f4ede466230d6ec6f74cfd9d9d381ad342b261a8b9f4132a7965f97"}
Sep 05 06:25:25.085265 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.085245    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c5gst" event={"ID":"7106bb4d-a09c-4d8a-af07-a349c2d464ef","Type":"ContainerStarted","Data":"0663933966b017aa7c7e13af76497b01b39bd90f723733334b886aaab8dfb08f"}
Sep 05 06:25:25.086801 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.086779    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r9qv4" event={"ID":"665494d6-d2e1-4a6b-b101-d26c750878ab","Type":"ContainerStarted","Data":"1009a2f2bb1e8e81e874fe70adb9309ab983d23666e8683a72df97efdaa060b3"}
Sep 05 06:25:25.088124 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.088101    2583 generic.go:356] "Generic (PLEG): container finished" podID="18cf93ad-f837-4588-b868-b905984873ab" containerID="a070fbcd0734ebf8163b40d9504bd6a2a5373e9e9abeca01f6ab81e4437c7889" exitCode=0
Sep 05 06:25:25.088197 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.088176    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvr8h" event={"ID":"18cf93ad-f837-4588-b868-b905984873ab","Type":"ContainerDied","Data":"a070fbcd0734ebf8163b40d9504bd6a2a5373e9e9abeca01f6ab81e4437c7889"}
Sep 05 06:25:25.093498 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.093477    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-24cbm" event={"ID":"32b062bd-e411-4997-ba7c-0ac37d425e38","Type":"ContainerStarted","Data":"d329cf31369039d4cb6c8be2f43343e6987fe19700685546696f33e14e0fc04d"}
Sep 05 06:25:25.108406 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.108370    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9v682" podStartSLOduration=8.418562336 podStartE2EDuration="22.108358374s" totalImagesPullingTime="13.689796038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:25.108191255 +0000 UTC m=+22.712740083" watchObservedRunningTime="2026-09-05 06:25:25.108358374 +0000 UTC m=+22.712907213"
Sep 05 06:25:25.124769 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.124737    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c5gst" podStartSLOduration=4.350591156 podStartE2EDuration="22.124725621s" totalImagesPullingTime="17.774134465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:25.124292349 +0000 UTC m=+22.728841181" watchObservedRunningTime="2026-09-05 06:25:25.124725621 +0000 UTC m=+22.729274456"
Sep 05 06:25:25.140123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.140091    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-24cbm" podStartSLOduration=4.367051662 podStartE2EDuration="22.140081221s" totalImagesPullingTime="17.773029559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:25.139609918 +0000 UTC m=+22.744158750" watchObservedRunningTime="2026-09-05 06:25:25.140081221 +0000 UTC m=+22.744630049"
Sep 05 06:25:25.179238 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.179175    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m8wjr" podStartSLOduration=4.405339544 podStartE2EDuration="22.179163038s" totalImagesPullingTime="17.773823494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:25.156976619 +0000 UTC m=+22.761525454" watchObservedRunningTime="2026-09-05 06:25:25.179163038 +0000 UTC m=+22.783711877"
Sep 05 06:25:25.201778 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.201743    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-r9qv4" podStartSLOduration=4.35291359 podStartE2EDuration="22.201732827s" totalImagesPullingTime="17.848819237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:25.201660337 +0000 UTC m=+22.806209176" watchObservedRunningTime="2026-09-05 06:25:25.201732827 +0000 UTC m=+22.806281664"
Sep 05 06:25:25.461181 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.461008    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 05 06:25:25.879614 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.879361    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-05T06:25:25.461178515Z","UUID":"4fa77019-4ca8-4d3c-acd0-71f59ef7a42f","Handler":null,"Name":"","Endpoint":""}
Sep 05 06:25:25.881131 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.881111    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 05 06:25:25.881266 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.881145    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 05 06:25:25.908305 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:25.908277    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:25.908452 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:25.908425    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:26.098818 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:26.098782    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt" event={"ID":"148ebb6a-92ba-4ef8-9315-53bdc399f7dd","Type":"ContainerStarted","Data":"1bf994e31a064644eb8f763781e231d1bec96a635075cf303dea933b2014bc8a"}
Sep 05 06:25:26.100741 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:26.100711    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ccql6" event={"ID":"558f10f8-8ba3-4df9-b429-ccf99c2ef3a9","Type":"ContainerStarted","Data":"6510f5a6fca70a3d46026942b06956c09db7af00ad145e4e757168e55594a502"}
Sep 05 06:25:26.908547 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:26.908456    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:26.908705 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:26.908570    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:26.908705 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:26.908633    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:26.908821 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:26.908744    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:27.105475 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:27.105431    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt" event={"ID":"148ebb6a-92ba-4ef8-9315-53bdc399f7dd","Type":"ContainerStarted","Data":"d7361f6037c380c440417a65efcb7798da5c66da6f89688a2425c4ef47f734f1"}
Sep 05 06:25:27.109269 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:27.109244    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv" event={"ID":"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6","Type":"ContainerStarted","Data":"d9ece56927484bd3c67fb554660880fb06c556a0e2e77b6298aa49d98d34f247"}
Sep 05 06:25:27.148065 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:27.148015    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ccql6" podStartSLOduration=6.38238109 podStartE2EDuration="24.147998347s" totalImagesPullingTime="17.765617257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:26.116687786 +0000 UTC m=+23.721236624" watchObservedRunningTime="2026-09-05 06:25:27.147998347 +0000 UTC m=+24.752547184"
Sep 05 06:25:27.908726 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:27.908697    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:27.908885 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:27.908815    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:28.588528 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:28.588498    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9v682"
Sep 05 06:25:28.589195 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:28.589175    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9v682"
Sep 05 06:25:28.609042 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:28.608997    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fwrt" podStartSLOduration=5.690661739 podStartE2EDuration="25.60898029s" totalImagesPullingTime="19.918318551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:27.148797071 +0000 UTC m=+24.753345906" watchObservedRunningTime="2026-09-05 06:25:28.60898029 +0000 UTC m=+26.213529162"
Sep 05 06:25:28.908956 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:28.908879    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:28.908956 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:28.908912    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:28.909169 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:28.909010    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:28.909169 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:28.909108    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:29.119166 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:29.119018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv" event={"ID":"7d0d8164-177c-4ca9-bc74-bd74e82fb4a6","Type":"ContainerStarted","Data":"4b3ccfcf020515d89ae417eb333321001acaab79c1eb2a754a4c146694424ff6"}
Sep 05 06:25:29.119608 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:29.119486    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9v682"
Sep 05 06:25:29.119608 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:29.119518    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:29.119608 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:29.119548    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:29.120727 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:29.120079    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9v682"
Sep 05 06:25:29.134894 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:29.134873    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:29.152109 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:29.152068    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv" podStartSLOduration=8.364678255 podStartE2EDuration="26.152052681s" totalImagesPullingTime="17.787374426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:29.150290798 +0000 UTC m=+26.754839636" watchObservedRunningTime="2026-09-05 06:25:29.152052681 +0000 UTC m=+26.756601516"
Sep 05 06:25:29.908134 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:29.907943    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:29.908675 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:29.908637    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:30.123235 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:30.123205    2583 generic.go:356] "Generic (PLEG): container finished" podID="18cf93ad-f837-4588-b868-b905984873ab" containerID="b6f4e20e2e4221c0d77baa47d001cc477a6f41fdc4031a2316b45be11da22893" exitCode=0
Sep 05 06:25:30.123414 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:30.123290    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvr8h" event={"ID":"18cf93ad-f837-4588-b868-b905984873ab","Type":"ContainerDied","Data":"b6f4e20e2e4221c0d77baa47d001cc477a6f41fdc4031a2316b45be11da22893"}
Sep 05 06:25:30.124465 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:30.123835    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:30.138631 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:30.138613    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:25:30.908070 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:30.908041    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:30.908300 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:30.908041    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:30.908300 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:30.908163    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:30.908300 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:30.908196    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:30.942163 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:30.942130    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-82mp8"]
Sep 05 06:25:30.944659 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:30.944632    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdjjs"]
Sep 05 06:25:30.944777 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:30.944759    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:30.944908 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:30.944882    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:30.947957 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:30.947935    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kjm8w"]
Sep 05 06:25:31.125741 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:31.125714    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:31.125881 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:31.125804    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:31.126149 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:31.126119    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:31.126205 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:31.126164    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:32.129906 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:32.129614    2583 generic.go:356] "Generic (PLEG): container finished" podID="18cf93ad-f837-4588-b868-b905984873ab" containerID="26d4e097ca1bd5cbd40f221434629115541af55faa2ae8f73acceb9d75eb1428" exitCode=0
Sep 05 06:25:32.129906 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:32.129691    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvr8h" event={"ID":"18cf93ad-f837-4588-b868-b905984873ab","Type":"ContainerDied","Data":"26d4e097ca1bd5cbd40f221434629115541af55faa2ae8f73acceb9d75eb1428"}
Sep 05 06:25:32.908605 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:32.908577    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:32.908828 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:32.908676    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:32.908828 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:32.908717    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:32.909011 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:32.908835    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:32.909011 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:32.908852    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:32.912486 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:32.909400    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:33.135178 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:33.135148    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvr8h" event={"ID":"18cf93ad-f837-4588-b868-b905984873ab","Type":"ContainerStarted","Data":"51374f797cf71f79f533b83f0f14eefff16b3e146f2366f2b814b4c9c552e8d8"}
Sep 05 06:25:34.140463 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:34.140376    2583 generic.go:356] "Generic (PLEG): container finished" podID="18cf93ad-f837-4588-b868-b905984873ab" containerID="51374f797cf71f79f533b83f0f14eefff16b3e146f2366f2b814b4c9c552e8d8" exitCode=0
Sep 05 06:25:34.140463 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:34.140417    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvr8h" event={"ID":"18cf93ad-f837-4588-b868-b905984873ab","Type":"ContainerDied","Data":"51374f797cf71f79f533b83f0f14eefff16b3e146f2366f2b814b4c9c552e8d8"}
Sep 05 06:25:34.908331 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:34.908293    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:34.908331 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:34.908338    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:34.908571 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:34.908311    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:34.908571 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:34.908445    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:34.908571 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:34.908491    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:34.908741 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:34.908571    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:36.568528 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:36.568486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:36.569024 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:36.568628    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:36.569024 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:36.568689    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs podName:d6d27aa9-3777-4509-9ff4-d4c47ffc3485 nodeName:}" failed. No retries permitted until 2026-09-05 06:26:08.568673814 +0000 UTC m=+66.173222644 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs") pod "network-metrics-daemon-fdjjs" (UID: "d6d27aa9-3777-4509-9ff4-d4c47ffc3485") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:36.669626 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:36.669589    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:36.669814 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:36.669743    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:36.669814 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:36.669805    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret podName:104a86cd-474f-4615-b7b5-94fd578c46a4 nodeName:}" failed. No retries permitted until 2026-09-05 06:26:08.669790886 +0000 UTC m=+66.274339702 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret") pod "global-pull-secret-syncer-82mp8" (UID: "104a86cd-474f-4615-b7b5-94fd578c46a4") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:36.770287 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:36.770251    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fx9s\" (UniqueName: \"kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s\") pod \"network-check-target-kjm8w\" (UID: \"a34a1345-6c29-45e4-a1a4-be9193bef176\") " pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:36.770473 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:36.770387    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:25:36.770473 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:36.770403    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:25:36.770473 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:36.770412    2583 projected.go:196] Error preparing data for projected volume kube-api-access-9fx9s for pod openshift-network-diagnostics/network-check-target-kjm8w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:36.770473 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:36.770466    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s podName:a34a1345-6c29-45e4-a1a4-be9193bef176 nodeName:}" failed. No retries permitted until 2026-09-05 06:26:08.770450013 +0000 UTC m=+66.374998841 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fx9s" (UniqueName: "kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s") pod "network-check-target-kjm8w" (UID: "a34a1345-6c29-45e4-a1a4-be9193bef176") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:36.909009 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:36.908960    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:36.909195 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:36.908961    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:36.909195 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:36.909079    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjm8w" podUID="a34a1345-6c29-45e4-a1a4-be9193bef176"
Sep 05 06:25:36.909195 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:36.909164    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82mp8" podUID="104a86cd-474f-4615-b7b5-94fd578c46a4"
Sep 05 06:25:36.909195 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:36.908972    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:36.909420 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:36.909283    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:25:37.713355 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.713329    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeReady"
Sep 05 06:25:37.713798 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.713488    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 05 06:25:37.754399 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.754319    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"]
Sep 05 06:25:37.759278 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.759252    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r"]
Sep 05 06:25:37.759433 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.759384    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.762462 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.762293    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 05 06:25:37.762462 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.762340    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 05 06:25:37.762462 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.762359    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 05 06:25:37.762462 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.762379    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 05 06:25:37.762462 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.762423    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 05 06:25:37.762775 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.762666    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 05 06:25:37.762775 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.762674    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 05 06:25:37.764042 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.764021    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-686bc4f67f-wt598"]
Sep 05 06:25:37.764176 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.764154    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r"
Sep 05 06:25:37.766923 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.766886    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nqhcp\""
Sep 05 06:25:37.767473 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.767451    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"]
Sep 05 06:25:37.768806 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.767855    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.768806 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.768614    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 05 06:25:37.771395 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.770930    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lvk4p\""
Sep 05 06:25:37.771494 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.771427    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 05 06:25:37.772143 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.771945    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 05 06:25:37.772400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.772380    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 05 06:25:37.772779 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.772744    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rmx67"]
Sep 05 06:25:37.774080 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.773408    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:25:37.777910 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.777217    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r"]
Sep 05 06:25:37.777910 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.777250    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"]
Sep 05 06:25:37.777910 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.777271    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"]
Sep 05 06:25:37.777910 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.777291    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hvbvv"]
Sep 05 06:25:37.778226 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.778170    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:37.778907 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.778885    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 05 06:25:37.779810 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.779791    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 05 06:25:37.780581 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.780562    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 05 06:25:37.780778 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.780759    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-686bc4f67f-wt598"]
Sep 05 06:25:37.780881 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.780791    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 05 06:25:37.780881 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.780846    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hvbvv"
Sep 05 06:25:37.781349 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.781333    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bxnqj\""
Sep 05 06:25:37.783555 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.783535    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rmx67"]
Sep 05 06:25:37.783919 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.783891    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 05 06:25:37.784008 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.783940    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 05 06:25:37.784008 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.783966    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ms7q2\""
Sep 05 06:25:37.784119 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.784023    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 05 06:25:37.786723 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.786574    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hvbvv"]
Sep 05 06:25:37.879978 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.879941    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6cb24078-2fb2-4bc5-abf8-94529f460c3c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.879978 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.879978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7kz8\" (UniqueName: \"kubernetes.io/projected/6cb24078-2fb2-4bc5-abf8-94529f460c3c-kube-api-access-l7kz8\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.880229 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880003    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c673e82f-02b6-4d9c-8a49-7e62c100b1ea-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-597c478b6-mnk2r\" (UID: \"c673e82f-02b6-4d9c-8a49-7e62c100b1ea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r"
Sep 05 06:25:37.880229 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880064    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-certificates\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.880229 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880134    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58e763ef-9dc5-4c76-a96a-bad31d20af55-trusted-ca\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.880352 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880268    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cb24078-2fb2-4bc5-abf8-94529f460c3c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.880352 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880305    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-config-volume\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:37.880352 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880338    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjfbz\" (UniqueName: \"kubernetes.io/projected/a24e846a-7c8e-472f-a6ba-410f2a191c1d-kube-api-access-jjfbz\") pod \"ingress-canary-hvbvv\" (UID: \"a24e846a-7c8e-472f-a6ba-410f2a191c1d\") " pod="openshift-ingress-canary/ingress-canary-hvbvv"
Sep 05 06:25:37.880479 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880353    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.880479 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgfbl\" (UniqueName: \"kubernetes.io/projected/42ff8b76-ba23-40b4-bc06-c93da5e1a08a-kube-api-access-qgfbl\") pod \"klusterlet-addon-workmgr-5456b45589-4jf76\" (UID: \"42ff8b76-ba23-40b4-bc06-c93da5e1a08a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:25:37.880479 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880451    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmrqw\" (UniqueName: \"kubernetes.io/projected/c673e82f-02b6-4d9c-8a49-7e62c100b1ea-kube-api-access-lmrqw\") pod \"managed-serviceaccount-addon-agent-597c478b6-mnk2r\" (UID: \"c673e82f-02b6-4d9c-8a49-7e62c100b1ea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r"
Sep 05 06:25:37.880634 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880476    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:37.880634 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880517    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58e763ef-9dc5-4c76-a96a-bad31d20af55-ca-trust-extracted\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.880634 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880549    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/42ff8b76-ba23-40b4-bc06-c93da5e1a08a-klusterlet-config\") pod \"klusterlet-addon-workmgr-5456b45589-4jf76\" (UID: \"42ff8b76-ba23-40b4-bc06-c93da5e1a08a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:25:37.880634 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880580    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58e763ef-9dc5-4c76-a96a-bad31d20af55-image-registry-private-configuration\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.880634 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880606    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6cb24078-2fb2-4bc5-abf8-94529f460c3c-ca\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.880843 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880632    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6cb24078-2fb2-4bc5-abf8-94529f460c3c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.880843 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a24e846a-7c8e-472f-a6ba-410f2a191c1d-cert\") pod \"ingress-canary-hvbvv\" (UID: \"a24e846a-7c8e-472f-a6ba-410f2a191c1d\") " pod="openshift-ingress-canary/ingress-canary-hvbvv"
Sep 05 06:25:37.880843 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880684    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-tmp-dir\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:37.880843 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880708    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdfzn\" (UniqueName: \"kubernetes.io/projected/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-kube-api-access-bdfzn\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:37.880843 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880749    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42ff8b76-ba23-40b4-bc06-c93da5e1a08a-tmp\") pod \"klusterlet-addon-workmgr-5456b45589-4jf76\" (UID: \"42ff8b76-ba23-40b4-bc06-c93da5e1a08a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:25:37.880843 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880786    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6cb24078-2fb2-4bc5-abf8-94529f460c3c-hub\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.880843 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58e763ef-9dc5-4c76-a96a-bad31d20af55-installation-pull-secrets\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.881164 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-bound-sa-token\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.881164 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.880896    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n588z\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-kube-api-access-n588z\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.936368 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.936332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:37.981617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.981585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmrqw\" (UniqueName: \"kubernetes.io/projected/c673e82f-02b6-4d9c-8a49-7e62c100b1ea-kube-api-access-lmrqw\") pod \"managed-serviceaccount-addon-agent-597c478b6-mnk2r\" (UID: \"c673e82f-02b6-4d9c-8a49-7e62c100b1ea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r"
Sep 05 06:25:37.981617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.981620    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:37.981845 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.981645    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58e763ef-9dc5-4c76-a96a-bad31d20af55-ca-trust-extracted\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.981845 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.981667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/42ff8b76-ba23-40b4-bc06-c93da5e1a08a-klusterlet-config\") pod \"klusterlet-addon-workmgr-5456b45589-4jf76\" (UID: \"42ff8b76-ba23-40b4-bc06-c93da5e1a08a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:25:37.981845 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.981701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58e763ef-9dc5-4c76-a96a-bad31d20af55-image-registry-private-configuration\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.981845 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.981725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6cb24078-2fb2-4bc5-abf8-94529f460c3c-ca\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.981845 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:37.981747    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:25:37.981845 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:37.981819    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls podName:a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:38.481799318 +0000 UTC m=+36.086348151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls") pod "dns-default-rmx67" (UID: "a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77") : secret "dns-default-metrics-tls" not found
Sep 05 06:25:37.982153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.981749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6cb24078-2fb2-4bc5-abf8-94529f460c3c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.982153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.981963    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a24e846a-7c8e-472f-a6ba-410f2a191c1d-cert\") pod \"ingress-canary-hvbvv\" (UID: \"a24e846a-7c8e-472f-a6ba-410f2a191c1d\") " pod="openshift-ingress-canary/ingress-canary-hvbvv"
Sep 05 06:25:37.982153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.981993    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-tmp-dir\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:37.982153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982016    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdfzn\" (UniqueName: \"kubernetes.io/projected/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-kube-api-access-bdfzn\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:37.982153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42ff8b76-ba23-40b4-bc06-c93da5e1a08a-tmp\") pod \"klusterlet-addon-workmgr-5456b45589-4jf76\" (UID: \"42ff8b76-ba23-40b4-bc06-c93da5e1a08a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:25:37.982153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982067    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58e763ef-9dc5-4c76-a96a-bad31d20af55-ca-trust-extracted\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.982153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6cb24078-2fb2-4bc5-abf8-94529f460c3c-hub\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.982153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982110    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58e763ef-9dc5-4c76-a96a-bad31d20af55-installation-pull-secrets\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.982153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-bound-sa-token\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.982541 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n588z\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-kube-api-access-n588z\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.982541 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6cb24078-2fb2-4bc5-abf8-94529f460c3c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.982541 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7kz8\" (UniqueName: \"kubernetes.io/projected/6cb24078-2fb2-4bc5-abf8-94529f460c3c-kube-api-access-l7kz8\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.982541 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982239    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c673e82f-02b6-4d9c-8a49-7e62c100b1ea-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-597c478b6-mnk2r\" (UID: \"c673e82f-02b6-4d9c-8a49-7e62c100b1ea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r"
Sep 05 06:25:37.982541 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982260    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-certificates\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.982541 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982279    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58e763ef-9dc5-4c76-a96a-bad31d20af55-trusted-ca\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.982541 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982294    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-tmp-dir\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:37.982541 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982327    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cb24078-2fb2-4bc5-abf8-94529f460c3c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.982988 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.982967    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cb24078-2fb2-4bc5-abf8-94529f460c3c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.984034 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.983604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-config-volume\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:37.984034 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.983673    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfbz\" (UniqueName: \"kubernetes.io/projected/a24e846a-7c8e-472f-a6ba-410f2a191c1d-kube-api-access-jjfbz\") pod \"ingress-canary-hvbvv\" (UID: \"a24e846a-7c8e-472f-a6ba-410f2a191c1d\") " pod="openshift-ingress-canary/ingress-canary-hvbvv"
Sep 05 06:25:37.984034 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.983701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.984034 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.983734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgfbl\" (UniqueName: \"kubernetes.io/projected/42ff8b76-ba23-40b4-bc06-c93da5e1a08a-kube-api-access-qgfbl\") pod \"klusterlet-addon-workmgr-5456b45589-4jf76\" (UID: \"42ff8b76-ba23-40b4-bc06-c93da5e1a08a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:25:37.984619 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.984296    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42ff8b76-ba23-40b4-bc06-c93da5e1a08a-tmp\") pod \"klusterlet-addon-workmgr-5456b45589-4jf76\" (UID: \"42ff8b76-ba23-40b4-bc06-c93da5e1a08a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:25:37.984619 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.984382    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-certificates\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.984619 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.984582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-config-volume\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:37.984810 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:37.984696    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 05 06:25:37.984810 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:37.984713    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-686bc4f67f-wt598: secret "image-registry-tls" not found
Sep 05 06:25:37.984949 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:37.984889    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls podName:58e763ef-9dc5-4c76-a96a-bad31d20af55 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:38.484852705 +0000 UTC m=+36.089401523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls") pod "image-registry-686bc4f67f-wt598" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55") : secret "image-registry-tls" not found
Sep 05 06:25:37.985204 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.985180    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58e763ef-9dc5-4c76-a96a-bad31d20af55-trusted-ca\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.987118 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.987059    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6cb24078-2fb2-4bc5-abf8-94529f460c3c-ca\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.987732 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.987487    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a24e846a-7c8e-472f-a6ba-410f2a191c1d-cert\") pod \"ingress-canary-hvbvv\" (UID: \"a24e846a-7c8e-472f-a6ba-410f2a191c1d\") " pod="openshift-ingress-canary/ingress-canary-hvbvv"
Sep 05 06:25:37.987732 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.987568    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6cb24078-2fb2-4bc5-abf8-94529f460c3c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.987732 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.987595    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/42ff8b76-ba23-40b4-bc06-c93da5e1a08a-klusterlet-config\") pod \"klusterlet-addon-workmgr-5456b45589-4jf76\" (UID: \"42ff8b76-ba23-40b4-bc06-c93da5e1a08a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:25:37.987732 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.987603    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58e763ef-9dc5-4c76-a96a-bad31d20af55-installation-pull-secrets\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.987732 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.987685    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6cb24078-2fb2-4bc5-abf8-94529f460c3c-hub\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.988041 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.987775    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c673e82f-02b6-4d9c-8a49-7e62c100b1ea-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-597c478b6-mnk2r\" (UID: \"c673e82f-02b6-4d9c-8a49-7e62c100b1ea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r"
Sep 05 06:25:37.988041 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.987911    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58e763ef-9dc5-4c76-a96a-bad31d20af55-image-registry-private-configuration\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.988567 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.988548    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6cb24078-2fb2-4bc5-abf8-94529f460c3c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.991197 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.991173    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmrqw\" (UniqueName: \"kubernetes.io/projected/c673e82f-02b6-4d9c-8a49-7e62c100b1ea-kube-api-access-lmrqw\") pod \"managed-serviceaccount-addon-agent-597c478b6-mnk2r\" (UID: \"c673e82f-02b6-4d9c-8a49-7e62c100b1ea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r"
Sep 05 06:25:37.992489 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.992466    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgfbl\" (UniqueName: \"kubernetes.io/projected/42ff8b76-ba23-40b4-bc06-c93da5e1a08a-kube-api-access-qgfbl\") pod \"klusterlet-addon-workmgr-5456b45589-4jf76\" (UID: \"42ff8b76-ba23-40b4-bc06-c93da5e1a08a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:25:37.992736 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.992715    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n588z\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-kube-api-access-n588z\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.992796 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.992782    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdfzn\" (UniqueName: \"kubernetes.io/projected/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-kube-api-access-bdfzn\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:37.992851 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.992832    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-bound-sa-token\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:37.993270 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.993248    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7kz8\" (UniqueName: \"kubernetes.io/projected/6cb24078-2fb2-4bc5-abf8-94529f460c3c-kube-api-access-l7kz8\") pod \"cluster-proxy-proxy-agent-65b8875894-m9fgd\" (UID: \"6cb24078-2fb2-4bc5-abf8-94529f460c3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:37.993617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:37.993602    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjfbz\" (UniqueName: \"kubernetes.io/projected/a24e846a-7c8e-472f-a6ba-410f2a191c1d-kube-api-access-jjfbz\") pod \"ingress-canary-hvbvv\" (UID: \"a24e846a-7c8e-472f-a6ba-410f2a191c1d\") " pod="openshift-ingress-canary/ingress-canary-hvbvv"
Sep 05 06:25:38.027383 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.027326    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:38.085051 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.084825    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:25:38.093956 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.093935    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r"
Sep 05 06:25:38.115033 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.114353    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:25:38.127836 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.127810    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hvbvv"
Sep 05 06:25:38.155452 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.155422    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvr8h" event={"ID":"18cf93ad-f837-4588-b868-b905984873ab","Type":"ContainerStarted","Data":"d3e5d33a967891edbeff0460861191c4bca2129b437e765d65b8b97e9f9e03a5"}
Sep 05 06:25:38.233751 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.233720    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:38.334088 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.334006    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:38.381329 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.381309    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"]
Sep 05 06:25:38.391275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.391254    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r"]
Sep 05 06:25:38.427139 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.427088    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"]
Sep 05 06:25:38.429765 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.429738    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hvbvv"]
Sep 05 06:25:38.432429 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:38.432402    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc673e82f_02b6_4d9c_8a49_7e62c100b1ea.slice/crio-bd961267786749366ac4dc8181c193a6bf4d79610d9db8898175735e50adefe4 WatchSource:0}: Error finding container bd961267786749366ac4dc8181c193a6bf4d79610d9db8898175735e50adefe4: Status 404 returned error can't find the container with id bd961267786749366ac4dc8181c193a6bf4d79610d9db8898175735e50adefe4
Sep 05 06:25:38.433189 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:38.433127    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24e846a_7c8e_472f_a6ba_410f2a191c1d.slice/crio-5328d78f40180fe12cdd1e28530631cc1834bfce134d9e3cb86c779d4b2aebd8 WatchSource:0}: Error finding container 5328d78f40180fe12cdd1e28530631cc1834bfce134d9e3cb86c779d4b2aebd8: Status 404 returned error can't find the container with id 5328d78f40180fe12cdd1e28530631cc1834bfce134d9e3cb86c779d4b2aebd8
Sep 05 06:25:38.433791 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:38.433769    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cb24078_2fb2_4bc5_abf8_94529f460c3c.slice/crio-711d15a9b9a8512abc5cfe07d46c386843f8b9c22fff7ce1eb4edbac713e4ce5 WatchSource:0}: Error finding container 711d15a9b9a8512abc5cfe07d46c386843f8b9c22fff7ce1eb4edbac713e4ce5: Status 404 returned error can't find the container with id 711d15a9b9a8512abc5cfe07d46c386843f8b9c22fff7ce1eb4edbac713e4ce5
Sep 05 06:25:38.434751 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:25:38.434624    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ff8b76_ba23_40b4_bc06_c93da5e1a08a.slice/crio-99abe1c63e117e61b98601c3966d645566d5e1ed762ba77f107ef7e9dca5b663 WatchSource:0}: Error finding container 99abe1c63e117e61b98601c3966d645566d5e1ed762ba77f107ef7e9dca5b663: Status 404 returned error can't find the container with id 99abe1c63e117e61b98601c3966d645566d5e1ed762ba77f107ef7e9dca5b663
Sep 05 06:25:38.488510 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.488486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:38.488591 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.488553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:38.488653 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:38.488634    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:25:38.488653 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:38.488649    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 05 06:25:38.488717 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:38.488660    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-686bc4f67f-wt598: secret "image-registry-tls" not found
Sep 05 06:25:38.488801 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:38.488699    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls podName:a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:39.488683234 +0000 UTC m=+37.093232051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls") pod "dns-default-rmx67" (UID: "a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77") : secret "dns-default-metrics-tls" not found
Sep 05 06:25:38.488801 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:38.488732    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls podName:58e763ef-9dc5-4c76-a96a-bad31d20af55 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:39.488726096 +0000 UTC m=+37.093274912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls") pod "image-registry-686bc4f67f-wt598" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55") : secret "image-registry-tls" not found
Sep 05 06:25:38.846191 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.846157    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:38.908660 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.908625    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:25:38.908660 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.908640    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:25:38.909288 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.908950    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:25:38.914374 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.914214    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gt2zc\""
Sep 05 06:25:38.914374 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.914232    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 05 06:25:38.914374 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.914253    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 05 06:25:38.914573 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.914557    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 05 06:25:38.914631 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.914607    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6v7qh\""
Sep 05 06:25:38.914774 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.914736    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 05 06:25:38.947672 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:38.947645    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:39.173600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:39.173324    2583 generic.go:356] "Generic (PLEG): container finished" podID="18cf93ad-f837-4588-b868-b905984873ab" containerID="d3e5d33a967891edbeff0460861191c4bca2129b437e765d65b8b97e9f9e03a5" exitCode=0
Sep 05 06:25:39.173600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:39.173408    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvr8h" event={"ID":"18cf93ad-f837-4588-b868-b905984873ab","Type":"ContainerDied","Data":"d3e5d33a967891edbeff0460861191c4bca2129b437e765d65b8b97e9f9e03a5"}
Sep 05 06:25:39.175708 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:39.175677    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:39.179108 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:39.177215    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r" event={"ID":"c673e82f-02b6-4d9c-8a49-7e62c100b1ea","Type":"ContainerStarted","Data":"bd961267786749366ac4dc8181c193a6bf4d79610d9db8898175735e50adefe4"}
Sep 05 06:25:39.184195 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:39.184094    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd" event={"ID":"6cb24078-2fb2-4bc5-abf8-94529f460c3c","Type":"ContainerStarted","Data":"711d15a9b9a8512abc5cfe07d46c386843f8b9c22fff7ce1eb4edbac713e4ce5"}
Sep 05 06:25:39.188841 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:39.188770    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hvbvv" event={"ID":"a24e846a-7c8e-472f-a6ba-410f2a191c1d","Type":"ContainerStarted","Data":"5328d78f40180fe12cdd1e28530631cc1834bfce134d9e3cb86c779d4b2aebd8"}
Sep 05 06:25:39.194383 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:39.194325    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76" event={"ID":"42ff8b76-ba23-40b4-bc06-c93da5e1a08a","Type":"ContainerStarted","Data":"99abe1c63e117e61b98601c3966d645566d5e1ed762ba77f107ef7e9dca5b663"}
Sep 05 06:25:39.244368 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:39.244237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:39.496988 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:39.496943    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:39.497114 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:39.497059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:39.497258 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:39.497241    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 05 06:25:39.497320 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:39.497263    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-686bc4f67f-wt598: secret "image-registry-tls" not found
Sep 05 06:25:39.497376 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:39.497323    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls podName:58e763ef-9dc5-4c76-a96a-bad31d20af55 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:41.49730512 +0000 UTC m=+39.101853941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls") pod "image-registry-686bc4f67f-wt598" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55") : secret "image-registry-tls" not found
Sep 05 06:25:39.497907 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:39.497732    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:25:39.497907 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:39.497787    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls podName:a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:41.497770207 +0000 UTC m=+39.102319025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls") pod "dns-default-rmx67" (UID: "a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77") : secret "dns-default-metrics-tls" not found
Sep 05 06:25:40.206014 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:40.205928    2583 generic.go:356] "Generic (PLEG): container finished" podID="18cf93ad-f837-4588-b868-b905984873ab" containerID="111f9d74c92e406d021b6f66ed66115a95c521192088bca81d0a9e65a418ea4d" exitCode=0
Sep 05 06:25:40.206014 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:40.206000    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvr8h" event={"ID":"18cf93ad-f837-4588-b868-b905984873ab","Type":"ContainerDied","Data":"111f9d74c92e406d021b6f66ed66115a95c521192088bca81d0a9e65a418ea4d"}
Sep 05 06:25:41.213359 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:41.213098    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvr8h" event={"ID":"18cf93ad-f837-4588-b868-b905984873ab","Type":"ContainerStarted","Data":"ff0145d662ef40e4b4389fc69910d683d6c0b8b94a207a5cfdd9456b96465b38"}
Sep 05 06:25:41.237323 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:41.237268    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qvr8h" podStartSLOduration=10.610233253 podStartE2EDuration="38.237250281s" totalImagesPullingTime="27.627017028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:41.235732895 +0000 UTC m=+38.840281733" watchObservedRunningTime="2026-09-05 06:25:41.237250281 +0000 UTC m=+38.841799118"
Sep 05 06:25:41.360307 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:41.360272    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:41.459592 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:41.459553    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:41.513815 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:41.513730    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:41.513815 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:41.513796    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:41.514055 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:41.513921    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:25:41.514055 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:41.513923    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 05 06:25:41.514055 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:41.513947    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-686bc4f67f-wt598: secret "image-registry-tls" not found
Sep 05 06:25:41.514055 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:41.513984    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls podName:a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:45.513966935 +0000 UTC m=+43.118515765 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls") pod "dns-default-rmx67" (UID: "a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77") : secret "dns-default-metrics-tls" not found
Sep 05 06:25:41.514055 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:41.514001    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls podName:58e763ef-9dc5-4c76-a96a-bad31d20af55 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:45.513992438 +0000 UTC m=+43.118541254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls") pod "image-registry-686bc4f67f-wt598" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55") : secret "image-registry-tls" not found
Sep 05 06:25:42.069314 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:42.069235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:42.146524 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:42.146488    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:42.825743 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:42.825708    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:45.546947 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:45.546914    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:45.547369 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:45.546992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:45.547369 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:45.547085    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:25:45.547369 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:45.547116    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 05 06:25:45.547369 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:45.547128    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-686bc4f67f-wt598: secret "image-registry-tls" not found
Sep 05 06:25:45.547369 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:45.547154    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls podName:a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:53.5471367 +0000 UTC m=+51.151685540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls") pod "dns-default-rmx67" (UID: "a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77") : secret "dns-default-metrics-tls" not found
Sep 05 06:25:45.547369 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:45.547170    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls podName:58e763ef-9dc5-4c76-a96a-bad31d20af55 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:53.547163414 +0000 UTC m=+51.151712229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls") pod "image-registry-686bc4f67f-wt598" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55") : secret "image-registry-tls" not found
Sep 05 06:25:47.231465 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:47.231400    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r" event={"ID":"c673e82f-02b6-4d9c-8a49-7e62c100b1ea","Type":"ContainerStarted","Data":"8eda333463066637a1296539c50da491a13c1f505ef19e18c407880037628db2"}
Sep 05 06:25:47.233682 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:47.233596    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd" event={"ID":"6cb24078-2fb2-4bc5-abf8-94529f460c3c","Type":"ContainerStarted","Data":"480a93fd3121d17ef9eb2f0cb139398149661bb0cd09a5cb5330820e74632099"}
Sep 05 06:25:47.235888 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:47.235644    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hvbvv" event={"ID":"a24e846a-7c8e-472f-a6ba-410f2a191c1d","Type":"ContainerStarted","Data":"a7199a7b579fd304a4d82dd9f687bc8479671c60a80270e11bc8572fe6c2ae71"}
Sep 05 06:25:47.237832 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:47.237693    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76" event={"ID":"42ff8b76-ba23-40b4-bc06-c93da5e1a08a","Type":"ContainerStarted","Data":"98ef97df0aa50c54ffa08143dc434d423fc6eb34803893312ade8e7cbd5ef9c9"}
Sep 05 06:25:47.238023 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:47.237987    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:25:47.239629 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:47.239588    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:25:47.257015 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:47.256973    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r" podStartSLOduration=3.653041256 podStartE2EDuration="12.256960209s" totalImagesPullingTime="8.603918953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:47.256192682 +0000 UTC m=+44.860741520" watchObservedRunningTime="2026-09-05 06:25:47.256960209 +0000 UTC m=+44.861509048"
Sep 05 06:25:47.278331 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:47.278284    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76" podStartSLOduration=3.657622031 podStartE2EDuration="12.278270002s" totalImagesPullingTime="8.620647971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:47.277484971 +0000 UTC m=+44.882033811" watchObservedRunningTime="2026-09-05 06:25:47.278270002 +0000 UTC m=+44.882818839"
Sep 05 06:25:47.304017 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:47.303969    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hvbvv" podStartSLOduration=1.700197959 podStartE2EDuration="10.303953416s" totalImagesPullingTime="8.603755457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:47.300953342 +0000 UTC m=+44.905502180" watchObservedRunningTime="2026-09-05 06:25:47.303953416 +0000 UTC m=+44.908502253"
Sep 05 06:25:48.242613 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:48.242571    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd" event={"ID":"6cb24078-2fb2-4bc5-abf8-94529f460c3c","Type":"ContainerStarted","Data":"a9559a02ef2b6e0281f5547e6c947c28a5acbcd35c45b6b9059203334bffeeed"}
Sep 05 06:25:48.243096 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:48.242624    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd" event={"ID":"6cb24078-2fb2-4bc5-abf8-94529f460c3c","Type":"ContainerStarted","Data":"dff06fc809c873db22f66a11489fe07fa47d61d6206791ed5f2fcf4391260505"}
Sep 05 06:25:48.264633 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:48.264590    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd" podStartSLOduration=4.653662601 podStartE2EDuration="13.264575227s" totalImagesPullingTime="8.610912626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:48.263294579 +0000 UTC m=+45.867843421" watchObservedRunningTime="2026-09-05 06:25:48.264575227 +0000 UTC m=+45.869124064"
Sep 05 06:25:53.607417 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:53.607379    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:25:53.607925 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:53.607444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:25:53.607925 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:53.607540    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 05 06:25:53.607925 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:53.607567    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-686bc4f67f-wt598: secret "image-registry-tls" not found
Sep 05 06:25:53.607925 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:53.607552    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:25:53.607925 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:53.607634    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls podName:58e763ef-9dc5-4c76-a96a-bad31d20af55 nodeName:}" failed. No retries permitted until 2026-09-05 06:26:09.607617845 +0000 UTC m=+67.212166681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls") pod "image-registry-686bc4f67f-wt598" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55") : secret "image-registry-tls" not found
Sep 05 06:25:53.607925 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:25:53.607649    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls podName:a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77 nodeName:}" failed. No retries permitted until 2026-09-05 06:26:09.607642455 +0000 UTC m=+67.212191271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls") pod "dns-default-rmx67" (UID: "a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77") : secret "dns-default-metrics-tls" not found
Sep 05 06:25:56.914246 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:56.914215    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:56.998536 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:56.998492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:58.968564 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:58.968530    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:25:59.051287 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:25:59.051257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:01.914722 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:01.914678    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:02.148210 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:02.148182    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r5tkv"
Sep 05 06:26:02.305192 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:02.305163    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:02.384607 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:02.384576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:04.173184 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:04.173130    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:04.233124 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:04.233092    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:08.615188 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:08.615144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:26:08.618152 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:08.618133    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 05 06:26:08.626392 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:26:08.626373    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 05 06:26:08.626449 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:26:08.626430    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs podName:d6d27aa9-3777-4509-9ff4-d4c47ffc3485 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:12.626413239 +0000 UTC m=+130.230962056 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs") pod "network-metrics-daemon-fdjjs" (UID: "d6d27aa9-3777-4509-9ff4-d4c47ffc3485") : secret "metrics-daemon-secret" not found
Sep 05 06:26:08.716010 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:08.715978    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:26:08.719100 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:08.719073    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 05 06:26:08.729427 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:08.729399    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104a86cd-474f-4615-b7b5-94fd578c46a4-original-pull-secret\") pod \"global-pull-secret-syncer-82mp8\" (UID: \"104a86cd-474f-4615-b7b5-94fd578c46a4\") " pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:26:08.817111 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:08.817073    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fx9s\" (UniqueName: \"kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s\") pod \"network-check-target-kjm8w\" (UID: \"a34a1345-6c29-45e4-a1a4-be9193bef176\") " pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:26:08.820283 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:08.820266    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 05 06:26:08.830058 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:08.830036    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 05 06:26:08.840749 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:08.840718    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fx9s\" (UniqueName: \"kubernetes.io/projected/a34a1345-6c29-45e4-a1a4-be9193bef176-kube-api-access-9fx9s\") pod \"network-check-target-kjm8w\" (UID: \"a34a1345-6c29-45e4-a1a4-be9193bef176\") " pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:26:08.924009 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:08.923935    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gt2zc\""
Sep 05 06:26:08.931298 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:08.931278    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:26:08.935551 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:08.935536    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82mp8"
Sep 05 06:26:09.233378 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:09.233351    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kjm8w"]
Sep 05 06:26:09.235961 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:26:09.235932    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34a1345_6c29_45e4_a1a4_be9193bef176.slice/crio-df17018fb2607a11ff322a7281d6cd4783f7a520aa600657de92ea6467fadab3 WatchSource:0}: Error finding container df17018fb2607a11ff322a7281d6cd4783f7a520aa600657de92ea6467fadab3: Status 404 returned error can't find the container with id df17018fb2607a11ff322a7281d6cd4783f7a520aa600657de92ea6467fadab3
Sep 05 06:26:09.259828 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:09.259807    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-82mp8"]
Sep 05 06:26:09.262225 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:26:09.262203    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod104a86cd_474f_4615_b7b5_94fd578c46a4.slice/crio-a796017061264cb74c5e33cabc88972f0997bee77855de9a429d4d11fcacb0e3 WatchSource:0}: Error finding container a796017061264cb74c5e33cabc88972f0997bee77855de9a429d4d11fcacb0e3: Status 404 returned error can't find the container with id a796017061264cb74c5e33cabc88972f0997bee77855de9a429d4d11fcacb0e3
Sep 05 06:26:09.312492 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:09.312460    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-82mp8" event={"ID":"104a86cd-474f-4615-b7b5-94fd578c46a4","Type":"ContainerStarted","Data":"a796017061264cb74c5e33cabc88972f0997bee77855de9a429d4d11fcacb0e3"}
Sep 05 06:26:09.313518 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:09.313501    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kjm8w" event={"ID":"a34a1345-6c29-45e4-a1a4-be9193bef176","Type":"ContainerStarted","Data":"df17018fb2607a11ff322a7281d6cd4783f7a520aa600657de92ea6467fadab3"}
Sep 05 06:26:09.445393 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:09.445359    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:09.546497 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:09.546406    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:09.624123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:09.624082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:26:09.624123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:09.624131    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:26:09.624593 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:26:09.624221    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:26:09.624593 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:26:09.624247    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 05 06:26:09.624593 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:26:09.624271    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls podName:a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77 nodeName:}" failed. No retries permitted until 2026-09-05 06:26:41.624258878 +0000 UTC m=+99.228807694 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls") pod "dns-default-rmx67" (UID: "a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77") : secret "dns-default-metrics-tls" not found
Sep 05 06:26:09.624593 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:26:09.624272    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-686bc4f67f-wt598: secret "image-registry-tls" not found
Sep 05 06:26:09.624593 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:26:09.624329    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls podName:58e763ef-9dc5-4c76-a96a-bad31d20af55 nodeName:}" failed. No retries permitted until 2026-09-05 06:26:41.624312685 +0000 UTC m=+99.228861514 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls") pod "image-registry-686bc4f67f-wt598" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55") : secret "image-registry-tls" not found
Sep 05 06:26:11.007048 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:11.006990    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:11.108530 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:11.108491    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:11.170308 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:11.170257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:13.330522 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:13.330480    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kjm8w" event={"ID":"a34a1345-6c29-45e4-a1a4-be9193bef176","Type":"ContainerStarted","Data":"7f2972ae7343736a29a32b4e7d5e8534c1f19dbc5a1dfc387721318335a9b1ca"}
Sep 05 06:26:13.330959 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:13.330592    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:26:13.349248 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:13.349200    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kjm8w" podStartSLOduration=67.224379793 podStartE2EDuration="1m10.349178888s" totalImagesPullingTime="3.124799095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:26:13.348676361 +0000 UTC m=+70.953225200" watchObservedRunningTime="2026-09-05 06:26:13.349178888 +0000 UTC m=+70.953727728"
Sep 05 06:26:14.335619 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:14.335580    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-82mp8" event={"ID":"104a86cd-474f-4615-b7b5-94fd578c46a4","Type":"ContainerStarted","Data":"8ec783a79ea7aba2cf4ac8b2e5316213f81f7104c320e44991e5fcc90f97f219"}
Sep 05 06:26:14.352590 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:14.352544    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-82mp8" podStartSLOduration=66.732560211 podStartE2EDuration="1m11.352530171s" totalImagesPullingTime="4.61996996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:26:14.351954864 +0000 UTC m=+71.956503703" watchObservedRunningTime="2026-09-05 06:26:14.352530171 +0000 UTC m=+71.957079048"
Sep 05 06:26:14.762895 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:14.762850    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:34.942581 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:34.942454    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:35.006569 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:35.006530    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:26:41.650267 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:41.650219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:26:41.650649 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:41.650290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:26:41.650649 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:26:41.650379    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 05 06:26:41.650649 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:26:41.650383    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:26:41.650649 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:26:41.650456    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls podName:a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:45.650440459 +0000 UTC m=+163.254989275 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls") pod "dns-default-rmx67" (UID: "a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77") : secret "dns-default-metrics-tls" not found
Sep 05 06:26:41.650649 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:26:41.650390    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-686bc4f67f-wt598: secret "image-registry-tls" not found
Sep 05 06:26:41.650649 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:26:41.650522    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls podName:58e763ef-9dc5-4c76-a96a-bad31d20af55 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:45.650511151 +0000 UTC m=+163.255059967 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls") pod "image-registry-686bc4f67f-wt598" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55") : secret "image-registry-tls" not found
Sep 05 06:26:44.338326 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:26:44.338296    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kjm8w"
Sep 05 06:27:12.667818 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:12.667780    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:27:12.668410 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:12.667987    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 05 06:27:12.668410 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:12.668080    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs podName:d6d27aa9-3777-4509-9ff4-d4c47ffc3485 nodeName:}" failed. No retries permitted until 2026-09-05 06:29:14.668057054 +0000 UTC m=+252.272605884 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs") pod "network-metrics-daemon-fdjjs" (UID: "d6d27aa9-3777-4509-9ff4-d4c47ffc3485") : secret "metrics-daemon-secret" not found
Sep 05 06:27:15.806036 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:15.805998    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:16.983345 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:16.983311    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:18.387944 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:18.387910    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:20.320121 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.320086    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:20.386481 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.386445    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:20.466441 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.466404    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-67tb2"]
Sep 05 06:27:20.469652 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.469629    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.472194 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.472171    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 05 06:27:20.472350 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.472211    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 05 06:27:20.472350 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.472217    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 05 06:27:20.472560 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.472433    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 05 06:27:20.473492 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.473468    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qtk85\""
Sep 05 06:27:20.483026 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.483004    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-67tb2"]
Sep 05 06:27:20.489317 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.489298    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:20.554797 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.554747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:20.622909 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.622831    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzqkp\" (UniqueName: \"kubernetes.io/projected/0540b4cf-969a-4239-b079-3936895f2958-kube-api-access-rzqkp\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.622909 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.622891    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0540b4cf-969a-4239-b079-3936895f2958-data-volume\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.623055 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.622955    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0540b4cf-969a-4239-b079-3936895f2958-crio-socket\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.623055 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.623038    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.623126 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.623062    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.723431 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.723404    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0540b4cf-969a-4239-b079-3936895f2958-data-volume\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.723494 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.723437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0540b4cf-969a-4239-b079-3936895f2958-crio-socket\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.723527 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.723492    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.723527 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.723513    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.723596 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.723531    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzqkp\" (UniqueName: \"kubernetes.io/projected/0540b4cf-969a-4239-b079-3936895f2958-kube-api-access-rzqkp\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.723634 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:20.723602    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 05 06:27:20.723666 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.723635    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0540b4cf-969a-4239-b079-3936895f2958-crio-socket\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.723700 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:20.723640    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:20.723700 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:20.723691    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm podName:0540b4cf-969a-4239-b079-3936895f2958 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:21.223669427 +0000 UTC m=+138.828218263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67tb2" (UID: "0540b4cf-969a-4239-b079-3936895f2958") : configmap "kube-rbac-proxy" not found
Sep 05 06:27:20.723787 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:20.723722    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls podName:0540b4cf-969a-4239-b079-3936895f2958 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:21.223705138 +0000 UTC m=+138.828253957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67tb2" (UID: "0540b4cf-969a-4239-b079-3936895f2958") : secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:20.723787 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.723766    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0540b4cf-969a-4239-b079-3936895f2958-data-volume\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.735189 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.735162    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzqkp\" (UniqueName: \"kubernetes.io/projected/0540b4cf-969a-4239-b079-3936895f2958-kube-api-access-rzqkp\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:20.757264 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.757240    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:20.857035 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:20.857009    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:21.012313 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:21.012284    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:21.112877 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:21.112827    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:21.227825 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:21.227800    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:21.227986 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:21.227832    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:21.227986 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:21.227928    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 05 06:27:21.228054 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:21.227988    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm podName:0540b4cf-969a-4239-b079-3936895f2958 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:22.227973689 +0000 UTC m=+139.832522539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67tb2" (UID: "0540b4cf-969a-4239-b079-3936895f2958") : configmap "kube-rbac-proxy" not found
Sep 05 06:27:21.228054 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:21.228006    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:21.228127 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:21.228059    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls podName:0540b4cf-969a-4239-b079-3936895f2958 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:22.22804354 +0000 UTC m=+139.832592376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67tb2" (UID: "0540b4cf-969a-4239-b079-3936895f2958") : secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:21.695475 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:21.695445    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:21.773872 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:21.773832    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:22.230937 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:22.230911    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c5gst_7106bb4d-a09c-4d8a-af07-a349c2d464ef/dns-node-resolver/0.log"
Sep 05 06:27:22.235226 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:22.235207    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:22.235293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:22.235237    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:22.235348 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:22.235334    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 05 06:27:22.235384 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:22.235345    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:22.235428 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:22.235412    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls podName:0540b4cf-969a-4239-b079-3936895f2958 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:24.235398347 +0000 UTC m=+141.839947166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67tb2" (UID: "0540b4cf-969a-4239-b079-3936895f2958") : secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:22.235476 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:22.235428    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm podName:0540b4cf-969a-4239-b079-3936895f2958 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:24.235420886 +0000 UTC m=+141.839969702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67tb2" (UID: "0540b4cf-969a-4239-b079-3936895f2958") : configmap "kube-rbac-proxy" not found
Sep 05 06:27:22.652756 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:22.652687    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:22.754818 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:22.754765    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:23.231179 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:23.231150    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-24cbm_32b062bd-e411-4997-ba7c-0ac37d425e38/node-ca/0.log"
Sep 05 06:27:24.037838 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:24.037806    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hvbvv_a24e846a-7c8e-472f-a6ba-410f2a191c1d/serve-healthcheck-canary/0.log"
Sep 05 06:27:24.137770 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:24.137740    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:24.250401 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:24.250368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:24.250401 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:24.250402    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:24.250640 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:24.250503    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 05 06:27:24.250640 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:24.250516    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:24.250640 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:24.250570    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls podName:0540b4cf-969a-4239-b079-3936895f2958 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:28.250556804 +0000 UTC m=+145.855105620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67tb2" (UID: "0540b4cf-969a-4239-b079-3936895f2958") : secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:24.250640 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:24.250582    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm podName:0540b4cf-969a-4239-b079-3936895f2958 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:28.250575487 +0000 UTC m=+145.855124303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67tb2" (UID: "0540b4cf-969a-4239-b079-3936895f2958") : configmap "kube-rbac-proxy" not found
Sep 05 06:27:24.490654 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:24.490623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:24.750944 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:24.750843    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:24.946146 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:24.946119    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:25.048133 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:25.048044    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:25.148680 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:25.148647    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:25.249404 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:25.249371    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:25.966144 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:25.966115    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:26.580427 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:26.580399    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:26.785030 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:26.785004    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:26.956933 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:26.956909    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:27.171532 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:27.171498    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:27.369189 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:27.369113    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:27.974320 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:27.974280    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:28.280967 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:28.280831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:28.280967 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:28.280899    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:28.281198 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:28.281013    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:28.281198 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:28.281067    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls podName:0540b4cf-969a-4239-b079-3936895f2958 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:36.281054497 +0000 UTC m=+153.885603314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67tb2" (UID: "0540b4cf-969a-4239-b079-3936895f2958") : secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:28.281198 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:28.281130    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 05 06:27:28.281317 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:28.281205    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm podName:0540b4cf-969a-4239-b079-3936895f2958 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:36.281186965 +0000 UTC m=+153.885735796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67tb2" (UID: "0540b4cf-969a-4239-b079-3936895f2958") : configmap "kube-rbac-proxy" not found
Sep 05 06:27:28.291168 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:28.291143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:28.394732 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:28.394704    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:28.484804 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:28.484778    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:28.573938 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:28.573857    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:28.970771 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:28.970745    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:29.032285 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:29.032260    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:29.381286 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:29.381211    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:29.971208 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:29.971175    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:30.365508 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:30.365416    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:30.561138 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:30.561111    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:30.981136 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:30.981101    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:31.168372 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:31.168343    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:31.566452 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:31.566421    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:31.973026 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:31.973001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:32.167298 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:32.167265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:32.569629 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:32.569598    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:33.181272 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:33.181235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:33.681241 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:33.681213    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:33.782521 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:33.782491    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:33.887624 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:33.887595    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:33.984326 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:33.984301    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:34.054258 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:34.054229    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:34.171654 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:34.171623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:34.571707 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:34.571676    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:35.168945 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:35.168918    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:35.231077 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:35.231052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:35.369393 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:35.369367    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:35.587952 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:35.587923    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:36.340316 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:36.340271    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:36.340316 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:36.340319    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:36.340831 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:36.340804    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0540b4cf-969a-4239-b079-3936895f2958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:36.342532 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:36.342515    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0540b4cf-969a-4239-b079-3936895f2958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67tb2\" (UID: \"0540b4cf-969a-4239-b079-3936895f2958\") " pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:36.378528 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:36.378503    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-67tb2"
Sep 05 06:27:36.647116 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:36.647089    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-67tb2"]
Sep 05 06:27:36.649350 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:27:36.649321    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0540b4cf_969a_4239_b079_3936895f2958.slice/crio-624a8267e2fae0d75c229b6f7462f37da318ee17a84bbece0e992a73fa37c7bb WatchSource:0}: Error finding container 624a8267e2fae0d75c229b6f7462f37da318ee17a84bbece0e992a73fa37c7bb: Status 404 returned error can't find the container with id 624a8267e2fae0d75c229b6f7462f37da318ee17a84bbece0e992a73fa37c7bb
Sep 05 06:27:37.582534 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:37.582500    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67tb2" event={"ID":"0540b4cf-969a-4239-b079-3936895f2958","Type":"ContainerStarted","Data":"9c573b11ae59c8f6a08b5222925e030683ca87ebf9c6b6511edc611bf7c52b52"}
Sep 05 06:27:37.582941 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:37.582558    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67tb2" event={"ID":"0540b4cf-969a-4239-b079-3936895f2958","Type":"ContainerStarted","Data":"baf6525d4950cac537194632d335b62afc1db67a51400028d10818c39b5ebef2"}
Sep 05 06:27:37.582941 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:37.582578    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67tb2" event={"ID":"0540b4cf-969a-4239-b079-3936895f2958","Type":"ContainerStarted","Data":"624a8267e2fae0d75c229b6f7462f37da318ee17a84bbece0e992a73fa37c7bb"}
Sep 05 06:27:38.848625 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:38.848603    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:38.947907 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:38.947880    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:39.591334 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:39.591304    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67tb2" event={"ID":"0540b4cf-969a-4239-b079-3936895f2958","Type":"ContainerStarted","Data":"f9a485469c013df6e6e5f51d0d0ea0c657b35542241bc76ff0c275e58451c427"}
Sep 05 06:27:39.613438 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:39.613393    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-67tb2" podStartSLOduration=17.590892422 podStartE2EDuration="19.613377459s" totalImagesPullingTime="2.022485037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:27:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:39.613077144 +0000 UTC m=+157.217625983" watchObservedRunningTime="2026-09-05 06:27:39.613377459 +0000 UTC m=+157.217926296"
Sep 05 06:27:40.807476 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:40.807392    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-686bc4f67f-wt598" podUID="58e763ef-9dc5-4c76-a96a-bad31d20af55"
Sep 05 06:27:40.821564 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:40.821526    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rmx67" podUID="a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77"
Sep 05 06:27:41.597240 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:41.597209    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:27:41.597240 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:41.597251    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rmx67"
Sep 05 06:27:41.929616 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:41.929510    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fdjjs" podUID="d6d27aa9-3777-4509-9ff4-d4c47ffc3485"
Sep 05 06:27:44.780247 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:44.780216    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:44.882727 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:44.882695    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:45.701682 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:45.701631    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:27:45.701682 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:45.701686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:27:45.704020 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:45.704001    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77-metrics-tls\") pod \"dns-default-rmx67\" (UID: \"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77\") " pod="openshift-dns/dns-default-rmx67"
Sep 05 06:27:45.704144 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:45.704125    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls\") pod \"image-registry-686bc4f67f-wt598\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") " pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:27:45.801484 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:45.801454    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bxnqj\""
Sep 05 06:27:45.801484 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:45.801451    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lvk4p\""
Sep 05 06:27:45.808697 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:45.808676    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:27:45.808763 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:45.808749    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rmx67"
Sep 05 06:27:46.100320 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:46.100298    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rmx67"]
Sep 05 06:27:46.102503 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:27:46.102466    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0bafcde_e6b9_4dc6_b05e_9a7bbac52f77.slice/crio-67d96721ba23217230a062b74bfb12fbaa73a999a59f8b4a5b036b8b448e5d40 WatchSource:0}: Error finding container 67d96721ba23217230a062b74bfb12fbaa73a999a59f8b4a5b036b8b448e5d40: Status 404 returned error can't find the container with id 67d96721ba23217230a062b74bfb12fbaa73a999a59f8b4a5b036b8b448e5d40
Sep 05 06:27:46.104319 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:46.104198    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-686bc4f67f-wt598"]
Sep 05 06:27:46.106993 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:27:46.106969    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e763ef_9dc5_4c76_a96a_bad31d20af55.slice/crio-84392883c3a20ae5feb1a0749af29eb7c19b60a0ce06dd09f5b5eaf350559962 WatchSource:0}: Error finding container 84392883c3a20ae5feb1a0749af29eb7c19b60a0ce06dd09f5b5eaf350559962: Status 404 returned error can't find the container with id 84392883c3a20ae5feb1a0749af29eb7c19b60a0ce06dd09f5b5eaf350559962
Sep 05 06:27:46.612569 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:46.612534    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-686bc4f67f-wt598" event={"ID":"58e763ef-9dc5-4c76-a96a-bad31d20af55","Type":"ContainerStarted","Data":"897624b88ae4523d152af05b0ae0c62a74d49128f13adff139baa6942d5f6267"}
Sep 05 06:27:46.612740 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:46.612698    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:27:46.612818 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:46.612743    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-686bc4f67f-wt598" event={"ID":"58e763ef-9dc5-4c76-a96a-bad31d20af55","Type":"ContainerStarted","Data":"84392883c3a20ae5feb1a0749af29eb7c19b60a0ce06dd09f5b5eaf350559962"}
Sep 05 06:27:46.613679 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:46.613658    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rmx67" event={"ID":"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77","Type":"ContainerStarted","Data":"67d96721ba23217230a062b74bfb12fbaa73a999a59f8b4a5b036b8b448e5d40"}
Sep 05 06:27:46.636276 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:46.636234    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-686bc4f67f-wt598" podStartSLOduration=141.636222254 podStartE2EDuration="2m21.636222254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:46.634605805 +0000 UTC m=+164.239154644" watchObservedRunningTime="2026-09-05 06:27:46.636222254 +0000 UTC m=+164.240771092"
Sep 05 06:27:47.238894 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:47.238811    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76" podUID="42ff8b76-ba23-40b4-bc06-c93da5e1a08a" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
Sep 05 06:27:47.280040 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:47.280009    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:47.382396 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:47.382363    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:47.618581 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:47.618499    2583 generic.go:356] "Generic (PLEG): container finished" podID="c673e82f-02b6-4d9c-8a49-7e62c100b1ea" containerID="8eda333463066637a1296539c50da491a13c1f505ef19e18c407880037628db2" exitCode=255
Sep 05 06:27:47.618751 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:47.618581    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r" event={"ID":"c673e82f-02b6-4d9c-8a49-7e62c100b1ea","Type":"ContainerDied","Data":"8eda333463066637a1296539c50da491a13c1f505ef19e18c407880037628db2"}
Sep 05 06:27:47.619013 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:47.618988    2583 scope.go:117] "RemoveContainer" containerID="8eda333463066637a1296539c50da491a13c1f505ef19e18c407880037628db2"
Sep 05 06:27:47.620312 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:47.620286    2583 generic.go:356] "Generic (PLEG): container finished" podID="42ff8b76-ba23-40b4-bc06-c93da5e1a08a" containerID="98ef97df0aa50c54ffa08143dc434d423fc6eb34803893312ade8e7cbd5ef9c9" exitCode=1
Sep 05 06:27:47.620401 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:47.620362    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76" event={"ID":"42ff8b76-ba23-40b4-bc06-c93da5e1a08a","Type":"ContainerDied","Data":"98ef97df0aa50c54ffa08143dc434d423fc6eb34803893312ade8e7cbd5ef9c9"}
Sep 05 06:27:47.620735 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:47.620717    2583 scope.go:117] "RemoveContainer" containerID="98ef97df0aa50c54ffa08143dc434d423fc6eb34803893312ade8e7cbd5ef9c9"
Sep 05 06:27:47.625904 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:47.625879    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:47.725510 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:47.725471    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:47.999241 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:47.999215    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:48.094778 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:48.094748    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r"
Sep 05 06:27:48.097463 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:48.097429    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:48.115551 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:48.115533    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:27:48.309167 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:48.309139    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:48.625565 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:48.625477    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597c478b6-mnk2r" event={"ID":"c673e82f-02b6-4d9c-8a49-7e62c100b1ea","Type":"ContainerStarted","Data":"b81e42db83442530fa2abc8a80b20d9eafe690ab157deef3f025c0aaac944d0b"}
Sep 05 06:27:48.627088 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:48.627066    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rmx67" event={"ID":"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77","Type":"ContainerStarted","Data":"1125eb20288a25f40b4ba1c0cdc6a189b84d952b86bb30c689ee166d9c0282f2"}
Sep 05 06:27:48.627250 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:48.627105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rmx67" event={"ID":"a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77","Type":"ContainerStarted","Data":"640a35a0086bdf700fd95deb696e7508bb8dcbdcde97157039e69e6d88c6ee3c"}
Sep 05 06:27:48.627250 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:48.627131    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rmx67"
Sep 05 06:27:48.628629 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:48.628608    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76" event={"ID":"42ff8b76-ba23-40b4-bc06-c93da5e1a08a","Type":"ContainerStarted","Data":"8e3d06f6957a4e9fe11486edee74956f8b39e4fe8c5b55fc4fce288d1f4f4ee4"}
Sep 05 06:27:48.628816 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:48.628800    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:27:48.629684 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:48.629663    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456b45589-4jf76"
Sep 05 06:27:48.681868 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:48.681827    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rmx67" podStartSLOduration=129.984031609 podStartE2EDuration="2m11.681814181s" totalImagesPullingTime="1.697782572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:48.680952441 +0000 UTC m=+166.285501280" watchObservedRunningTime="2026-09-05 06:27:48.681814181 +0000 UTC m=+166.286363018"
Sep 05 06:27:50.109945 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:50.109900    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:52.161209 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.161147    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:52.419977 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.419855    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:52.548996 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.548962    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bg4kj"]
Sep 05 06:27:52.555107 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.555085    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.559485 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.559462    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 05 06:27:52.561536 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.561514    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 05 06:27:52.561680 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.561654    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sgg5g\""
Sep 05 06:27:52.561803 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.561679    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 05 06:27:52.561803 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.561575    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 05 06:27:52.561803 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.561697    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 05 06:27:52.562743 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.562729    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 05 06:27:52.584692 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.584668    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:52.651073 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.651049    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-textfile\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.651183 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.651079    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-wtmp\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.651183 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.651100    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.651183 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.651126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-sys\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.651285 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.651234    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-metrics-client-ca\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.651285 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.651262    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-root\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.651346 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.651282    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.651346 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.651303    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-tls\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.651346 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.651336    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx2rz\" (UniqueName: \"kubernetes.io/projected/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-kube-api-access-wx2rz\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.735657 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.735634    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:52.751758 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.751735    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx2rz\" (UniqueName: \"kubernetes.io/projected/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-kube-api-access-wx2rz\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.751882 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.751766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-textfile\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.751882 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.751789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-wtmp\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.751882 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.751816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.752034 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.752002    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-sys\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.752034 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.752011    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-wtmp\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.752155 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.752117    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-sys\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.752155 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.752142    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-metrics-client-ca\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.752260 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.752159    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-textfile\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.752260 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.752204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-root\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.752260 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.752243    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.752412 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.752268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-tls\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.752412 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.752304    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-root\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.752412 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:52.752377    2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 05 06:27:52.752564 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:27:52.752429    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-tls podName:d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee nodeName:}" failed. No retries permitted until 2026-09-05 06:27:53.25241198 +0000 UTC m=+170.856960818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-tls") pod "node-exporter-bg4kj" (UID: "d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee") : secret "node-exporter-tls" not found
Sep 05 06:27:52.752564 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.752437    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.752798 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.752766    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-metrics-client-ca\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.755352 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.754734    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.765935 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.765917    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx2rz\" (UniqueName: \"kubernetes.io/projected/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-kube-api-access-wx2rz\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:52.839649 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.839606    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:52.901336 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.901306    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:52.964984 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:52.964953    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:53.089916 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:53.089834    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:53.254489 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:53.254459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-tls\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:53.256781 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:53.256756    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee-node-exporter-tls\") pod \"node-exporter-bg4kj\" (UID: \"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee\") " pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:53.399956 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:53.399843    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:53.463742 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:53.463718    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bg4kj"
Sep 05 06:27:53.475773 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:27:53.475747    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a11c81_b8a2_48fa_bd2a_a9623d1fc1ee.slice/crio-7e0226729c64074d076f66ba6db8e3460d69ec0477926e93b43c467e92a63218 WatchSource:0}: Error finding container 7e0226729c64074d076f66ba6db8e3460d69ec0477926e93b43c467e92a63218: Status 404 returned error can't find the container with id 7e0226729c64074d076f66ba6db8e3460d69ec0477926e93b43c467e92a63218
Sep 05 06:27:53.496899 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:53.496832    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:53.649626 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:53.649593    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bg4kj" event={"ID":"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee","Type":"ContainerStarted","Data":"7e0226729c64074d076f66ba6db8e3460d69ec0477926e93b43c467e92a63218"}
Sep 05 06:27:53.860043 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:53.860003    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:53.908067 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:53.908046    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:27:54.654476 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:54.654444    2583 generic.go:356] "Generic (PLEG): container finished" podID="d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee" containerID="1ce8715b5012cd799327bc8d9688f5f25db32e475dfe633b52a4e82de0f2106a" exitCode=0
Sep 05 06:27:54.654969 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:54.654497    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bg4kj" event={"ID":"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee","Type":"ContainerDied","Data":"1ce8715b5012cd799327bc8d9688f5f25db32e475dfe633b52a4e82de0f2106a"}
Sep 05 06:27:55.361911 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:55.361801    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:55.450166 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:55.450134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:55.659718 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:55.659632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bg4kj" event={"ID":"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee","Type":"ContainerStarted","Data":"1659aa66f7f1afc7def569bb13cb5a03e5d48f752572a61ee82fe7a56420b6ca"}
Sep 05 06:27:55.659718 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:55.659682    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bg4kj" event={"ID":"d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee","Type":"ContainerStarted","Data":"af0e3634e2754bd63354c86834204caffa7a484675d04a53e9dc251680b38fc5"}
Sep 05 06:27:55.681188 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:55.681130    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bg4kj" podStartSLOduration=2.671510054 podStartE2EDuration="3.681116102s" totalImagesPullingTime="949.746254ms" totalInitContainerRuntime="59.859794ms" isStatefulPod=true podCreationTimestamp="2026-09-05 06:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:55.679524029 +0000 UTC m=+173.284072866" watchObservedRunningTime="2026-09-05 06:27:55.681116102 +0000 UTC m=+173.285664940"
Sep 05 06:27:55.699430 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:55.699394    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:56.146482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:56.146437    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:57.214694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:57.214658    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:57.306611 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:57.306583    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:58.634041 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:58.634009    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rmx67"
Sep 05 06:27:58.677350 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:58.677314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:59.739889 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:59.739844    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:27:59.835921 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:27:59.835895    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:00.033358 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:00.033284    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:00.413879 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:00.413767    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:00.514615 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:00.514586    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:00.614375 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:00.614346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:01.616030 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:01.615997    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:01.825058 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:01.825029    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:02.234904 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:02.234856    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:02.335989 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:02.335963    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:02.657254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:02.657174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:03.133151 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:03.133118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:03.203298 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:03.203266    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:05.813107 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:05.813074    2583 patch_prober.go:28] interesting pod/image-registry-686bc4f67f-wt598 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 05 06:28:05.813507 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:05.813125    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-686bc4f67f-wt598" podUID="58e763ef-9dc5-4c76-a96a-bad31d20af55" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 05 06:28:06.307672 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:06.307638    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:06.408770 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:06.408736    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:07.208317 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:07.208280    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-686bc4f67f-wt598"]
Sep 05 06:28:07.212515 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:07.212492    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:28:07.307541 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:07.307510    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:07.404193 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:07.404165    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:07.504926 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:07.504830    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:07.779104 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:07.779006    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:07.835226 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:07.835183    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:12.837986 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:12.837954    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:15.648395 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:15.648362    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:15.704199 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:15.704169    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:16.832528 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:16.832498    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:16.896654 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:16.896629    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:17.044959 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:17.044926    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:17.145780 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:17.145694    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:18.257320 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:18.257287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:23.871315 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:23.871275    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:23.968517 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:23.968486    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:25.782925 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:25.782891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:25.882602 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:25.882576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:26.182722 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:26.182636    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:26.283796 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:26.283765    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:26.873555 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:26.873517    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:26.976722 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:26.976692    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:27.075135 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:27.075098    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:28.086023 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:28.085988    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd" podUID="6cb24078-2fb2-4bc5-abf8-94529f460c3c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 05 06:28:29.301776 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:29.301742    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:29.477911 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:29.477878    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:29.598239 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:29.598167    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:29.964344 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:29.964319    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bg4kj_d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee/init-textfile/0.log"
Sep 05 06:28:30.172295 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:30.172269    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bg4kj_d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee/node-exporter/0.log"
Sep 05 06:28:30.371533 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:30.371463    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bg4kj_d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee/kube-rbac-proxy/0.log"
Sep 05 06:28:32.226986 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.226950    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-686bc4f67f-wt598" podUID="58e763ef-9dc5-4c76-a96a-bad31d20af55" containerName="registry" containerID="cri-o://897624b88ae4523d152af05b0ae0c62a74d49128f13adff139baa6942d5f6267" gracePeriod=30
Sep 05 06:28:32.466647 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.466619    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:28:32.551239 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.551145    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-certificates\") pod \"58e763ef-9dc5-4c76-a96a-bad31d20af55\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") "
Sep 05 06:28:32.551239 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.551188    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58e763ef-9dc5-4c76-a96a-bad31d20af55-trusted-ca\") pod \"58e763ef-9dc5-4c76-a96a-bad31d20af55\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") "
Sep 05 06:28:32.551239 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.551207    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls\") pod \"58e763ef-9dc5-4c76-a96a-bad31d20af55\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") "
Sep 05 06:28:32.551239 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.551236    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58e763ef-9dc5-4c76-a96a-bad31d20af55-ca-trust-extracted\") pod \"58e763ef-9dc5-4c76-a96a-bad31d20af55\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") "
Sep 05 06:28:32.551542 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.551364    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58e763ef-9dc5-4c76-a96a-bad31d20af55-image-registry-private-configuration\") pod \"58e763ef-9dc5-4c76-a96a-bad31d20af55\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") "
Sep 05 06:28:32.551542 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.551424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-bound-sa-token\") pod \"58e763ef-9dc5-4c76-a96a-bad31d20af55\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") "
Sep 05 06:28:32.551542 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.551457    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n588z\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-kube-api-access-n588z\") pod \"58e763ef-9dc5-4c76-a96a-bad31d20af55\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") "
Sep 05 06:28:32.551698 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.551548    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58e763ef-9dc5-4c76-a96a-bad31d20af55-installation-pull-secrets\") pod \"58e763ef-9dc5-4c76-a96a-bad31d20af55\" (UID: \"58e763ef-9dc5-4c76-a96a-bad31d20af55\") "
Sep 05 06:28:32.551698 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.551620    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "58e763ef-9dc5-4c76-a96a-bad31d20af55" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:28:32.551812 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.551721    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e763ef-9dc5-4c76-a96a-bad31d20af55-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "58e763ef-9dc5-4c76-a96a-bad31d20af55" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:28:32.551812 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.551763    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-certificates\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:28:32.553827 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.553793    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e763ef-9dc5-4c76-a96a-bad31d20af55-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "58e763ef-9dc5-4c76-a96a-bad31d20af55" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:28:32.553969 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.553825    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-kube-api-access-n588z" (OuterVolumeSpecName: "kube-api-access-n588z") pod "58e763ef-9dc5-4c76-a96a-bad31d20af55" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55"). InnerVolumeSpecName "kube-api-access-n588z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:28:32.553969 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.553928    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "58e763ef-9dc5-4c76-a96a-bad31d20af55" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:28:32.554062 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.554016    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "58e763ef-9dc5-4c76-a96a-bad31d20af55" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:28:32.554099 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.554070    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e763ef-9dc5-4c76-a96a-bad31d20af55-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "58e763ef-9dc5-4c76-a96a-bad31d20af55" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:28:32.563401 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.563372    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e763ef-9dc5-4c76-a96a-bad31d20af55-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "58e763ef-9dc5-4c76-a96a-bad31d20af55" (UID: "58e763ef-9dc5-4c76-a96a-bad31d20af55"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:28:32.652115 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.652082    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58e763ef-9dc5-4c76-a96a-bad31d20af55-trusted-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:28:32.652115 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.652109    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-registry-tls\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:28:32.652115 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.652118    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58e763ef-9dc5-4c76-a96a-bad31d20af55-ca-trust-extracted\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:28:32.652308 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.652128    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58e763ef-9dc5-4c76-a96a-bad31d20af55-image-registry-private-configuration\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:28:32.652308 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.652137    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-bound-sa-token\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:28:32.652308 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.652150    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n588z\" (UniqueName: \"kubernetes.io/projected/58e763ef-9dc5-4c76-a96a-bad31d20af55-kube-api-access-n588z\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:28:32.652308 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.652160    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58e763ef-9dc5-4c76-a96a-bad31d20af55-installation-pull-secrets\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:28:32.780533 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.780501    2583 generic.go:356] "Generic (PLEG): container finished" podID="58e763ef-9dc5-4c76-a96a-bad31d20af55" containerID="897624b88ae4523d152af05b0ae0c62a74d49128f13adff139baa6942d5f6267" exitCode=0
Sep 05 06:28:32.780661 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.780548    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-686bc4f67f-wt598"
Sep 05 06:28:32.780661 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.780579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-686bc4f67f-wt598" event={"ID":"58e763ef-9dc5-4c76-a96a-bad31d20af55","Type":"ContainerDied","Data":"897624b88ae4523d152af05b0ae0c62a74d49128f13adff139baa6942d5f6267"}
Sep 05 06:28:32.780661 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.780627    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-686bc4f67f-wt598" event={"ID":"58e763ef-9dc5-4c76-a96a-bad31d20af55","Type":"ContainerDied","Data":"84392883c3a20ae5feb1a0749af29eb7c19b60a0ce06dd09f5b5eaf350559962"}
Sep 05 06:28:32.780661 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.780647    2583 scope.go:117] "RemoveContainer" containerID="897624b88ae4523d152af05b0ae0c62a74d49128f13adff139baa6942d5f6267"
Sep 05 06:28:32.789519 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.789498    2583 scope.go:117] "RemoveContainer" containerID="897624b88ae4523d152af05b0ae0c62a74d49128f13adff139baa6942d5f6267"
Sep 05 06:28:32.789805 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:28:32.789786    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"897624b88ae4523d152af05b0ae0c62a74d49128f13adff139baa6942d5f6267\": container with ID starting with 897624b88ae4523d152af05b0ae0c62a74d49128f13adff139baa6942d5f6267 not found: ID does not exist" containerID="897624b88ae4523d152af05b0ae0c62a74d49128f13adff139baa6942d5f6267"
Sep 05 06:28:32.789905 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.789812    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897624b88ae4523d152af05b0ae0c62a74d49128f13adff139baa6942d5f6267"} err="failed to get container status \"897624b88ae4523d152af05b0ae0c62a74d49128f13adff139baa6942d5f6267\": rpc error: code = NotFound desc = could not find container \"897624b88ae4523d152af05b0ae0c62a74d49128f13adff139baa6942d5f6267\": container with ID starting with 897624b88ae4523d152af05b0ae0c62a74d49128f13adff139baa6942d5f6267 not found: ID does not exist"
Sep 05 06:28:32.807727 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.807677    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-686bc4f67f-wt598"]
Sep 05 06:28:32.810965 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.810945    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-686bc4f67f-wt598"]
Sep 05 06:28:32.912637 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:32.912607    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58e763ef-9dc5-4c76-a96a-bad31d20af55" path="/var/lib/kubelet/pods/58e763ef-9dc5-4c76-a96a-bad31d20af55/volumes"
Sep 05 06:28:36.964978 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:36.964938    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hvbvv_a24e846a-7c8e-472f-a6ba-410f2a191c1d/serve-healthcheck-canary/0.log"
Sep 05 06:28:38.085824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:38.085790    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd" podUID="6cb24078-2fb2-4bc5-abf8-94529f460c3c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 05 06:28:38.853336 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:38.853289    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:38.928323 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:38.928289    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:39.481202 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:39.481112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:39.580931 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:39.580904    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:28:48.086821 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:48.086780    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd" podUID="6cb24078-2fb2-4bc5-abf8-94529f460c3c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 05 06:28:48.087249 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:48.086845    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd"
Sep 05 06:28:48.087293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:48.087279    2583 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"a9559a02ef2b6e0281f5547e6c947c28a5acbcd35c45b6b9059203334bffeeed"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 05 06:28:48.087326 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:48.087317    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd" podUID="6cb24078-2fb2-4bc5-abf8-94529f460c3c" containerName="service-proxy" containerID="cri-o://a9559a02ef2b6e0281f5547e6c947c28a5acbcd35c45b6b9059203334bffeeed" gracePeriod=30
Sep 05 06:28:48.840627 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:48.840594    2583 generic.go:356] "Generic (PLEG): container finished" podID="6cb24078-2fb2-4bc5-abf8-94529f460c3c" containerID="a9559a02ef2b6e0281f5547e6c947c28a5acbcd35c45b6b9059203334bffeeed" exitCode=2
Sep 05 06:28:48.840816 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:48.840667    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd" event={"ID":"6cb24078-2fb2-4bc5-abf8-94529f460c3c","Type":"ContainerDied","Data":"a9559a02ef2b6e0281f5547e6c947c28a5acbcd35c45b6b9059203334bffeeed"}
Sep 05 06:28:48.840816 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:28:48.840726    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b8875894-m9fgd" event={"ID":"6cb24078-2fb2-4bc5-abf8-94529f460c3c","Type":"ContainerStarted","Data":"21fd2d5ceae67cb19287ab8d6242627ffbb81d36940795001bdf060257ac6e29"}
Sep 05 06:29:11.654802 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:11.654769    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:12.128518 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:12.128489    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:14.739698 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:14.739657    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:29:14.741941 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:14.741919    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d27aa9-3777-4509-9ff4-d4c47ffc3485-metrics-certs\") pod \"network-metrics-daemon-fdjjs\" (UID: \"d6d27aa9-3777-4509-9ff4-d4c47ffc3485\") " pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:29:14.911089 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:14.911064    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6v7qh\""
Sep 05 06:29:14.919309 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:14.919282    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdjjs"
Sep 05 06:29:15.188686 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:15.188556    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdjjs"]
Sep 05 06:29:15.191069 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:29:15.191041    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d27aa9_3777_4509_9ff4_d4c47ffc3485.slice/crio-70d3896e9dcd017565dee4be034385cff4cfce682705a2b82b5060b27b39442d WatchSource:0}: Error finding container 70d3896e9dcd017565dee4be034385cff4cfce682705a2b82b5060b27b39442d: Status 404 returned error can't find the container with id 70d3896e9dcd017565dee4be034385cff4cfce682705a2b82b5060b27b39442d
Sep 05 06:29:15.927604 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:15.927564    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdjjs" event={"ID":"d6d27aa9-3777-4509-9ff4-d4c47ffc3485","Type":"ContainerStarted","Data":"70d3896e9dcd017565dee4be034385cff4cfce682705a2b82b5060b27b39442d"}
Sep 05 06:29:16.932748 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:16.932712    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdjjs" event={"ID":"d6d27aa9-3777-4509-9ff4-d4c47ffc3485","Type":"ContainerStarted","Data":"c31cc96f35880a446329a0ea047ab57f5d8a37d926e1305ecd4b92b9c2a03bd7"}
Sep 05 06:29:16.933141 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:16.932760    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdjjs" event={"ID":"d6d27aa9-3777-4509-9ff4-d4c47ffc3485","Type":"ContainerStarted","Data":"f4765a47cc62f16620a0c027200ffb3511c79fa893fc3bb60636808a1b0b2fb2"}
Sep 05 06:29:16.951848 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:16.951798    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fdjjs" podStartSLOduration=253.026014621 podStartE2EDuration="4m13.951780809s" totalImagesPullingTime="925.766188ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:29:16.951308611 +0000 UTC m=+254.555857453" watchObservedRunningTime="2026-09-05 06:29:16.951780809 +0000 UTC m=+254.556329646"
Sep 05 06:29:17.068798 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:17.068765    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:17.166689 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:17.166659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:18.030017 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:18.029981    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:18.087027 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:18.086995    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:20.109316 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:20.109282    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:20.165144 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:20.165114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:26.785950 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:26.785823    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:31.220829 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:31.220785    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:31.317260 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:31.317223    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:31.393966 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:31.393939    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:55.876984 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:55.876948    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:56.182702 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:56.182611    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:29:56.240712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:29:56.240682    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:30:02.826371 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:30:02.826342    2583 kubelet.go:1648] "Image garbage collection succeeded"
Sep 05 06:30:26.905784 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:30:26.905751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:30:26.966327 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:30:26.966294    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:30:31.491050 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:30:31.491012    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:30:31.559431 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:30:31.559404    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:30:38.885594 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:30:38.885541    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:30:38.945323 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:30:38.945292    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:30:42.464150 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:30:42.464116    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:30:42.570163 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:30:42.570131    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:30:42.666770 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:30:42.666736    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:30:53.871283 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:30:53.871249    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:30:53.971562 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:30:53.971527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:31:59.492318 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:31:59.492280    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:31:59.611046 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:31:59.611011    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:21.418150 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:21.418112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:22.934488 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:22.934445    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:23.389405 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.389371    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft"]
Sep 05 06:32:23.389624 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.389590    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e763ef-9dc5-4c76-a96a-bad31d20af55" containerName="registry"
Sep 05 06:32:23.389624 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.389600    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e763ef-9dc5-4c76-a96a-bad31d20af55" containerName="registry"
Sep 05 06:32:23.389704 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.389647    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e763ef-9dc5-4c76-a96a-bad31d20af55" containerName="registry"
Sep 05 06:32:23.392414 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.392396    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft"
Sep 05 06:32:23.395494 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.395475    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mlqvx\""
Sep 05 06:32:23.395913 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.395897    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 05 06:32:23.402628 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.402610    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 05 06:32:23.414006 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.413977    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft"]
Sep 05 06:32:23.472576 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.472551    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ec2a018-3818-422e-9f3e-eee90c6ab912-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dptft\" (UID: \"1ec2a018-3818-422e-9f3e-eee90c6ab912\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft"
Sep 05 06:32:23.472676 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.472605    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89w22\" (UniqueName: \"kubernetes.io/projected/1ec2a018-3818-422e-9f3e-eee90c6ab912-kube-api-access-89w22\") pod \"cert-manager-operator-controller-manager-55c444bf86-dptft\" (UID: \"1ec2a018-3818-422e-9f3e-eee90c6ab912\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft"
Sep 05 06:32:23.573370 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.573341    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89w22\" (UniqueName: \"kubernetes.io/projected/1ec2a018-3818-422e-9f3e-eee90c6ab912-kube-api-access-89w22\") pod \"cert-manager-operator-controller-manager-55c444bf86-dptft\" (UID: \"1ec2a018-3818-422e-9f3e-eee90c6ab912\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft"
Sep 05 06:32:23.573534 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.573377    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ec2a018-3818-422e-9f3e-eee90c6ab912-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dptft\" (UID: \"1ec2a018-3818-422e-9f3e-eee90c6ab912\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft"
Sep 05 06:32:23.573687 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.573670    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ec2a018-3818-422e-9f3e-eee90c6ab912-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dptft\" (UID: \"1ec2a018-3818-422e-9f3e-eee90c6ab912\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft"
Sep 05 06:32:23.583329 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.583306    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89w22\" (UniqueName: \"kubernetes.io/projected/1ec2a018-3818-422e-9f3e-eee90c6ab912-kube-api-access-89w22\") pod \"cert-manager-operator-controller-manager-55c444bf86-dptft\" (UID: \"1ec2a018-3818-422e-9f3e-eee90c6ab912\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft"
Sep 05 06:32:23.701400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.701375    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft"
Sep 05 06:32:23.973997 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.973896    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft"]
Sep 05 06:32:23.977117 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:32:23.977093    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec2a018_3818_422e_9f3e_eee90c6ab912.slice/crio-d3c514db59a7e66f98c1382c26ee453e6e52a0420c9669a0cc32c0978e5a1879 WatchSource:0}: Error finding container d3c514db59a7e66f98c1382c26ee453e6e52a0420c9669a0cc32c0978e5a1879: Status 404 returned error can't find the container with id d3c514db59a7e66f98c1382c26ee453e6e52a0420c9669a0cc32c0978e5a1879
Sep 05 06:32:23.979717 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:23.979698    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 05 06:32:24.538763 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:24.538732    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft" event={"ID":"1ec2a018-3818-422e-9f3e-eee90c6ab912","Type":"ContainerStarted","Data":"d3c514db59a7e66f98c1382c26ee453e6e52a0420c9669a0cc32c0978e5a1879"}
Sep 05 06:32:25.032576 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:25.032517    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:25.133312 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:25.133202    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:26.549436 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:26.549403    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft" event={"ID":"1ec2a018-3818-422e-9f3e-eee90c6ab912","Type":"ContainerStarted","Data":"837e272d51ceb6bd50215d92304efd4ca3a4b38e8968e67d52ab30207049bcec"}
Sep 05 06:32:26.573252 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:26.573188    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dptft" podStartSLOduration=1.078024721 podStartE2EDuration="3.573164004s" totalImagesPullingTime="2.495139283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:32:26.5709522 +0000 UTC m=+444.175501031" watchObservedRunningTime="2026-09-05 06:32:26.573164004 +0000 UTC m=+444.177712843"
Sep 05 06:32:27.023784 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:27.023745    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:27.206179 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:27.206149    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:27.407277 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:27.407194    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:29.613613 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:29.613586    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:29.866954 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:29.866881    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:31.820058 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:31.820026    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:31.879364 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:31.879333    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:37.202686 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:37.202635    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:39.925447 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:39.925416    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:40.020958 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:40.020925    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:41.737095 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:41.737058    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m"]
Sep 05 06:32:41.740232 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:41.740217    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m"
Sep 05 06:32:41.743158 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:41.743138    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 05 06:32:41.743255 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:41.743169    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 05 06:32:41.743301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:41.743289    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tlpqd\""
Sep 05 06:32:41.750551 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:41.750533    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m"]
Sep 05 06:32:41.795110 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:41.795081    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1d5d57c-a506-46d6-ba8c-3ac0f8345a95-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g2g5m\" (UID: \"a1d5d57c-a506-46d6-ba8c-3ac0f8345a95\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m"
Sep 05 06:32:41.795223 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:41.795125    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64wwb\" (UniqueName: \"kubernetes.io/projected/a1d5d57c-a506-46d6-ba8c-3ac0f8345a95-kube-api-access-64wwb\") pod \"openshift-lws-operator-fd8ccff4c-g2g5m\" (UID: \"a1d5d57c-a506-46d6-ba8c-3ac0f8345a95\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m"
Sep 05 06:32:41.895979 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:41.895942    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1d5d57c-a506-46d6-ba8c-3ac0f8345a95-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g2g5m\" (UID: \"a1d5d57c-a506-46d6-ba8c-3ac0f8345a95\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m"
Sep 05 06:32:41.896157 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:41.895994    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64wwb\" (UniqueName: \"kubernetes.io/projected/a1d5d57c-a506-46d6-ba8c-3ac0f8345a95-kube-api-access-64wwb\") pod \"openshift-lws-operator-fd8ccff4c-g2g5m\" (UID: \"a1d5d57c-a506-46d6-ba8c-3ac0f8345a95\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m"
Sep 05 06:32:41.896334 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:41.896312    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1d5d57c-a506-46d6-ba8c-3ac0f8345a95-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g2g5m\" (UID: \"a1d5d57c-a506-46d6-ba8c-3ac0f8345a95\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m"
Sep 05 06:32:41.908848 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:41.908824    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64wwb\" (UniqueName: \"kubernetes.io/projected/a1d5d57c-a506-46d6-ba8c-3ac0f8345a95-kube-api-access-64wwb\") pod \"openshift-lws-operator-fd8ccff4c-g2g5m\" (UID: \"a1d5d57c-a506-46d6-ba8c-3ac0f8345a95\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m"
Sep 05 06:32:42.048977 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:42.048895    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m"
Sep 05 06:32:42.324140 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:42.324054    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m"]
Sep 05 06:32:42.326739 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:32:42.326708    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1d5d57c_a506_46d6_ba8c_3ac0f8345a95.slice/crio-000127de0c0e9483bfa37e115aed9de498eef0ea087c22b45bcfbbb463d6853c WatchSource:0}: Error finding container 000127de0c0e9483bfa37e115aed9de498eef0ea087c22b45bcfbbb463d6853c: Status 404 returned error can't find the container with id 000127de0c0e9483bfa37e115aed9de498eef0ea087c22b45bcfbbb463d6853c
Sep 05 06:32:42.604458 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:42.604375    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m" event={"ID":"a1d5d57c-a506-46d6-ba8c-3ac0f8345a95","Type":"ContainerStarted","Data":"000127de0c0e9483bfa37e115aed9de498eef0ea087c22b45bcfbbb463d6853c"}
Sep 05 06:32:45.617997 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:45.617958    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m" event={"ID":"a1d5d57c-a506-46d6-ba8c-3ac0f8345a95","Type":"ContainerStarted","Data":"88da1dab9f02119b84eafb160f4738e8c7bb50d1bbc098f297574e51ff6e3d34"}
Sep 05 06:32:45.640755 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:45.640707    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2g5m" podStartSLOduration=2.142719377 podStartE2EDuration="4.640691957s" totalImagesPullingTime="2.49797258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:32:45.638914169 +0000 UTC m=+463.243462997" watchObservedRunningTime="2026-09-05 06:32:45.640691957 +0000 UTC m=+463.245240794"
Sep 05 06:32:46.313752 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:46.313719    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:46.412751 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:46.412720    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:48.510396 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:48.510360    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:59.864341 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:59.864304    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:32:59.964534 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:32:59.964492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:00.441358 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.441327    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:00.541138 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.541097    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:00.643614 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.643582    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:00.740046 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.740020    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:00.825218 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.825176    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"]
Sep 05 06:33:00.831080 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.831060    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:00.834362 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.834339    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 05 06:33:00.834523 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.834486    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 05 06:33:00.834624 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.834589    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 05 06:33:00.834678 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.834641    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xvm2f\""
Sep 05 06:33:00.834815 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.834799    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 05 06:33:00.843357 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.843335    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"]
Sep 05 06:33:00.930135 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.930104    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-tmp\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:00.930135 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.930144    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-manifests\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:00.930538 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.930182    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9v7g\" (UniqueName: \"kubernetes.io/projected/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-kube-api-access-h9v7g\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:00.930538 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.930208    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:00.930538 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:00.930234    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-webhook-cert\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:01.030956 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.030848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-webhook-cert\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:01.030956 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.030913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-tmp\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:01.030956 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.030941    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-manifests\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:01.031185 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.030972    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9v7g\" (UniqueName: \"kubernetes.io/projected/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-kube-api-access-h9v7g\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:01.031185 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.030995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:01.031437 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.031414    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-manifests\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:01.033298 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.033278    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-tmp\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:01.033410 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.033285    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-webhook-cert\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:01.033472 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.033421    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:01.041095 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.041071    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9v7g\" (UniqueName: \"kubernetes.io/projected/0ca8c1e7-521e-44af-8c23-04d1a7a6402f-kube-api-access-h9v7g\") pod \"opendatahub-operator-controller-manager-665f9d595b-475w2\" (UID: \"0ca8c1e7-521e-44af-8c23-04d1a7a6402f\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:01.115683 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.115654    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:01.141027 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.140988    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:01.214674 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.214619    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:01.315659 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.315580    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:01.414955 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.414934    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"]
Sep 05 06:33:01.417850 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:33:01.417820    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca8c1e7_521e_44af_8c23_04d1a7a6402f.slice/crio-7258bc0c682703e49eb65cf3e228b9acca9d79db46869c5adf514703a7f219c3 WatchSource:0}: Error finding container 7258bc0c682703e49eb65cf3e228b9acca9d79db46869c5adf514703a7f219c3: Status 404 returned error can't find the container with id 7258bc0c682703e49eb65cf3e228b9acca9d79db46869c5adf514703a7f219c3
Sep 05 06:33:01.418358 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.418335    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:01.518408 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.518379    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:01.619695 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.619611    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:01.675822 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.675784    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2" event={"ID":"0ca8c1e7-521e-44af-8c23-04d1a7a6402f","Type":"ContainerStarted","Data":"7258bc0c682703e49eb65cf3e228b9acca9d79db46869c5adf514703a7f219c3"}
Sep 05 06:33:01.716124 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:01.716095    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:04.690826 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:04.690733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2" event={"ID":"0ca8c1e7-521e-44af-8c23-04d1a7a6402f","Type":"ContainerStarted","Data":"6f26a4ef9ac9f4af010e605cd228847dad9cdaca1c67514765cd0d77d3081383"}
Sep 05 06:33:05.695982 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:05.695899    2583 generic.go:356] "Generic (PLEG): container finished" podID="0ca8c1e7-521e-44af-8c23-04d1a7a6402f" containerID="6f26a4ef9ac9f4af010e605cd228847dad9cdaca1c67514765cd0d77d3081383" exitCode=0
Sep 05 06:33:05.695982 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:05.695944    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2" event={"ID":"0ca8c1e7-521e-44af-8c23-04d1a7a6402f","Type":"ContainerDied","Data":"6f26a4ef9ac9f4af010e605cd228847dad9cdaca1c67514765cd0d77d3081383"}
Sep 05 06:33:06.703617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:06.703581    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2" event={"ID":"0ca8c1e7-521e-44af-8c23-04d1a7a6402f","Type":"ContainerStarted","Data":"ef6889c127a9f81fb4a31e274080ab37458c7d1aa430dac663710f88ffe3cf53"}
Sep 05 06:33:06.704031 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:06.703738    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:06.734690 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:06.734620    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2" podStartSLOduration=2.433754991 podStartE2EDuration="6.734602937s" totalImagesPullingTime="3.264615378s" totalInitContainerRuntime="1.036232568s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:33:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:33:06.733154563 +0000 UTC m=+484.337703402" watchObservedRunningTime="2026-09-05 06:33:06.734602937 +0000 UTC m=+484.339151776"
Sep 05 06:33:06.745687 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:06.745657    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:06.863779 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:06.863742    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:13.410443 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:13.410398    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:13.482670 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:13.482645    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:17.709751 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:17.709720    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-475w2"
Sep 05 06:33:20.183307 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.183255    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:20.279133 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.279097    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:20.594405 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.594376    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:20.728869 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.728822    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"]
Sep 05 06:33:20.738007 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.737982    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"
Sep 05 06:33:20.744854 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.744828    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 05 06:33:20.744854 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.744827    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-prkgj\""
Sep 05 06:33:20.745513 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.745491    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 05 06:33:20.745587 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.745511    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 05 06:33:20.745587 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.745528    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 05 06:33:20.765973 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.765950    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"]
Sep 05 06:33:20.802285 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.802246    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:20.866680 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.866604    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fe4de53-12d0-44c6-bf07-4131e25302ad-tmp\") pod \"kube-auth-proxy-6ff6468b6c-lxdl9\" (UID: \"3fe4de53-12d0-44c6-bf07-4131e25302ad\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"
Sep 05 06:33:20.866680 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.866646    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe4de53-12d0-44c6-bf07-4131e25302ad-tls-certs\") pod \"kube-auth-proxy-6ff6468b6c-lxdl9\" (UID: \"3fe4de53-12d0-44c6-bf07-4131e25302ad\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"
Sep 05 06:33:20.866680 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.866670    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67w7b\" (UniqueName: \"kubernetes.io/projected/3fe4de53-12d0-44c6-bf07-4131e25302ad-kube-api-access-67w7b\") pod \"kube-auth-proxy-6ff6468b6c-lxdl9\" (UID: \"3fe4de53-12d0-44c6-bf07-4131e25302ad\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"
Sep 05 06:33:20.967155 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.967120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fe4de53-12d0-44c6-bf07-4131e25302ad-tmp\") pod \"kube-auth-proxy-6ff6468b6c-lxdl9\" (UID: \"3fe4de53-12d0-44c6-bf07-4131e25302ad\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"
Sep 05 06:33:20.967319 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.967162    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe4de53-12d0-44c6-bf07-4131e25302ad-tls-certs\") pod \"kube-auth-proxy-6ff6468b6c-lxdl9\" (UID: \"3fe4de53-12d0-44c6-bf07-4131e25302ad\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"
Sep 05 06:33:20.967319 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.967299    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67w7b\" (UniqueName: \"kubernetes.io/projected/3fe4de53-12d0-44c6-bf07-4131e25302ad-kube-api-access-67w7b\") pod \"kube-auth-proxy-6ff6468b6c-lxdl9\" (UID: \"3fe4de53-12d0-44c6-bf07-4131e25302ad\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"
Sep 05 06:33:20.969440 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.969407    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fe4de53-12d0-44c6-bf07-4131e25302ad-tmp\") pod \"kube-auth-proxy-6ff6468b6c-lxdl9\" (UID: \"3fe4de53-12d0-44c6-bf07-4131e25302ad\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"
Sep 05 06:33:20.969671 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.969611    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe4de53-12d0-44c6-bf07-4131e25302ad-tls-certs\") pod \"kube-auth-proxy-6ff6468b6c-lxdl9\" (UID: \"3fe4de53-12d0-44c6-bf07-4131e25302ad\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"
Sep 05 06:33:20.981984 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:20.981962    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67w7b\" (UniqueName: \"kubernetes.io/projected/3fe4de53-12d0-44c6-bf07-4131e25302ad-kube-api-access-67w7b\") pod \"kube-auth-proxy-6ff6468b6c-lxdl9\" (UID: \"3fe4de53-12d0-44c6-bf07-4131e25302ad\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"
Sep 05 06:33:21.047547 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:21.047517    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"
Sep 05 06:33:21.318461 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:21.318427    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9"]
Sep 05 06:33:21.321243 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:33:21.321216    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fe4de53_12d0_44c6_bf07_4131e25302ad.slice/crio-0976fc66ac6d1c679cd5ba9621a7a9b852103652546cbf7d170ddd3e6d4ac6c3 WatchSource:0}: Error finding container 0976fc66ac6d1c679cd5ba9621a7a9b852103652546cbf7d170ddd3e6d4ac6c3: Status 404 returned error can't find the container with id 0976fc66ac6d1c679cd5ba9621a7a9b852103652546cbf7d170ddd3e6d4ac6c3
Sep 05 06:33:21.761470 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:21.761390    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9" event={"ID":"3fe4de53-12d0-44c6-bf07-4131e25302ad","Type":"ContainerStarted","Data":"0976fc66ac6d1c679cd5ba9621a7a9b852103652546cbf7d170ddd3e6d4ac6c3"}
Sep 05 06:33:22.557503 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.557466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:22.561335 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.561156    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"]
Sep 05 06:33:22.565559 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.565533    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.568733 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.568708    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 05 06:33:22.568846 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.568737    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wl8c2\""
Sep 05 06:33:22.568846 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.568751    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 05 06:33:22.568988 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.568911    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 05 06:33:22.569201 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.569082    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 05 06:33:22.579099 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.579035    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"]
Sep 05 06:33:22.636891 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.636821    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:22.680059 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.680018    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.680239 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.680070    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.680239 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.680150    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/654c7cec-1ecf-4cf5-b51e-44d2821a1243-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.680239 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.680225    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.680396 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.680272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zjc5\" (UniqueName: \"kubernetes.io/projected/654c7cec-1ecf-4cf5-b51e-44d2821a1243-kube-api-access-2zjc5\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.680396 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.680324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.680396 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.680354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.781420 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.781386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/654c7cec-1ecf-4cf5-b51e-44d2821a1243-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.781617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.781439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.781617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.781471    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjc5\" (UniqueName: \"kubernetes.io/projected/654c7cec-1ecf-4cf5-b51e-44d2821a1243-kube-api-access-2zjc5\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.781617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.781512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.781617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.781543    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.781617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.781595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.782005 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.781809    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.782187 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.782159    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.784505 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.784458    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.784505 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.784461    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.784776 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.784747    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.785630 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.785598    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/654c7cec-1ecf-4cf5-b51e-44d2821a1243-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.791111 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.791092    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.791544 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.791526    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zjc5\" (UniqueName: \"kubernetes.io/projected/654c7cec-1ecf-4cf5-b51e-44d2821a1243-kube-api-access-2zjc5\") pod \"istiod-openshift-gateway-7b7995d5cd-clxtk\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:22.878694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:22.878613    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:23.686093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:23.686054    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:24.209848 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:24.209825    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"]
Sep 05 06:33:24.211960 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:33:24.211933    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654c7cec_1ecf_4cf5_b51e_44d2821a1243.slice/crio-6860cd5b604cebe601e1d6dd2e3fa5b1ab025562fa4df64a9b5b83d3b8a8567d WatchSource:0}: Error finding container 6860cd5b604cebe601e1d6dd2e3fa5b1ab025562fa4df64a9b5b83d3b8a8567d: Status 404 returned error can't find the container with id 6860cd5b604cebe601e1d6dd2e3fa5b1ab025562fa4df64a9b5b83d3b8a8567d
Sep 05 06:33:24.366738 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:24.366701    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:24.471330 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:24.471256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:24.537037 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:24.537005    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:24.777611 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:24.777500    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9" event={"ID":"3fe4de53-12d0-44c6-bf07-4131e25302ad","Type":"ContainerStarted","Data":"ca6f9e67102135853fcbfaa05a8f819498eae966dcd5ebcb25b743c841a5abcb"}
Sep 05 06:33:24.778921 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:24.778894    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk" event={"ID":"654c7cec-1ecf-4cf5-b51e-44d2821a1243","Type":"ContainerStarted","Data":"6860cd5b604cebe601e1d6dd2e3fa5b1ab025562fa4df64a9b5b83d3b8a8567d"}
Sep 05 06:33:24.802009 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:24.801965    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9" podStartSLOduration=2.133449879 podStartE2EDuration="4.801950035s" totalImagesPullingTime="2.668500156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:33:24.80112041 +0000 UTC m=+502.405669305" watchObservedRunningTime="2026-09-05 06:33:24.801950035 +0000 UTC m=+502.406498891"
Sep 05 06:33:26.639579 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:26.639535    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 05 06:33:26.639821 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:26.639611    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 05 06:33:26.788930 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:26.788893    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk" event={"ID":"654c7cec-1ecf-4cf5-b51e-44d2821a1243","Type":"ContainerStarted","Data":"3e4b14659c222e7528a68d5156b2720d52c1d3f133b0e1a223563ce52f6cd3a1"}
Sep 05 06:33:26.789100 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:26.789036    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:26.812396 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:26.812349    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk" podStartSLOduration=2.387065825 podStartE2EDuration="4.812336129s" totalImagesPullingTime="2.425270304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:33:26.810648036 +0000 UTC m=+504.415196887" watchObservedRunningTime="2026-09-05 06:33:26.812336129 +0000 UTC m=+504.416884967"
Sep 05 06:33:27.190679 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:27.190636    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:27.290230 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:27.290194    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:27.599731 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:27.599698    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:27.747077 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:27.747032    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:27.794525 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:27.794500    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:27.889143 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:27.889022    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:31.363834 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:31.363792    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:31.462266 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:31.462238    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:31.567285 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:31.567257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:31.946150 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:31.946120    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:32.045906 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:32.045874    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:32.182442 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:32.182400    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:39.846773 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:39.846740    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:39.949668 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:39.949632    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:40.787857 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:40.787774    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:40.933242 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:40.933212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:40.937985 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:40.937961    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"]
Sep 05 06:33:40.947902 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:40.947847    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"
Sep 05 06:33:40.951108 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:40.951084    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 05 06:33:40.951753 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:40.951734    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-nbhjc\""
Sep 05 06:33:40.955451 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:40.955430    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"]
Sep 05 06:33:40.968885 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:40.968837    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"]
Sep 05 06:33:40.972124 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:40.972105    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"
Sep 05 06:33:40.980503 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:40.980483    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 05 06:33:40.980605 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:40.980583    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-scwsg\""
Sep 05 06:33:40.997571 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:40.997544    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"]
Sep 05 06:33:41.127264 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.127162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1cf33a6e-11c7-45d0-a745-08a419a6901f-cert\") pod \"kserve-controller-manager-d6f4b65b8-gpjp4\" (UID: \"1cf33a6e-11c7-45d0-a745-08a419a6901f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"
Sep 05 06:33:41.127264 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.127223    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/528bc1a8-43f3-46d0-8693-db879285bf29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9vks8\" (UID: \"528bc1a8-43f3-46d0-8693-db879285bf29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"
Sep 05 06:33:41.127492 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.127294    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szwbr\" (UniqueName: \"kubernetes.io/projected/528bc1a8-43f3-46d0-8693-db879285bf29-kube-api-access-szwbr\") pod \"llmisvc-controller-manager-777c6bd7d5-9vks8\" (UID: \"528bc1a8-43f3-46d0-8693-db879285bf29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"
Sep 05 06:33:41.127492 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.127350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fqtb\" (UniqueName: \"kubernetes.io/projected/1cf33a6e-11c7-45d0-a745-08a419a6901f-kube-api-access-7fqtb\") pod \"kserve-controller-manager-d6f4b65b8-gpjp4\" (UID: \"1cf33a6e-11c7-45d0-a745-08a419a6901f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"
Sep 05 06:33:41.228095 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.228054    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/528bc1a8-43f3-46d0-8693-db879285bf29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9vks8\" (UID: \"528bc1a8-43f3-46d0-8693-db879285bf29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"
Sep 05 06:33:41.228095 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.228099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szwbr\" (UniqueName: \"kubernetes.io/projected/528bc1a8-43f3-46d0-8693-db879285bf29-kube-api-access-szwbr\") pod \"llmisvc-controller-manager-777c6bd7d5-9vks8\" (UID: \"528bc1a8-43f3-46d0-8693-db879285bf29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"
Sep 05 06:33:41.228344 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.228119    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fqtb\" (UniqueName: \"kubernetes.io/projected/1cf33a6e-11c7-45d0-a745-08a419a6901f-kube-api-access-7fqtb\") pod \"kserve-controller-manager-d6f4b65b8-gpjp4\" (UID: \"1cf33a6e-11c7-45d0-a745-08a419a6901f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"
Sep 05 06:33:41.228344 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.228179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1cf33a6e-11c7-45d0-a745-08a419a6901f-cert\") pod \"kserve-controller-manager-d6f4b65b8-gpjp4\" (UID: \"1cf33a6e-11c7-45d0-a745-08a419a6901f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"
Sep 05 06:33:41.228344 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:33:41.228211    2583 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 05 06:33:41.228344 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:33:41.228277    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/528bc1a8-43f3-46d0-8693-db879285bf29-cert podName:528bc1a8-43f3-46d0-8693-db879285bf29 nodeName:}" failed. No retries permitted until 2026-09-05 06:33:41.728259527 +0000 UTC m=+519.332808343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/528bc1a8-43f3-46d0-8693-db879285bf29-cert") pod "llmisvc-controller-manager-777c6bd7d5-9vks8" (UID: "528bc1a8-43f3-46d0-8693-db879285bf29") : secret "llmisvc-webhook-server-cert" not found
Sep 05 06:33:41.228682 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:33:41.228663    2583 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 05 06:33:41.228749 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:33:41.228721    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf33a6e-11c7-45d0-a745-08a419a6901f-cert podName:1cf33a6e-11c7-45d0-a745-08a419a6901f nodeName:}" failed. No retries permitted until 2026-09-05 06:33:41.728704084 +0000 UTC m=+519.333252904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1cf33a6e-11c7-45d0-a745-08a419a6901f-cert") pod "kserve-controller-manager-d6f4b65b8-gpjp4" (UID: "1cf33a6e-11c7-45d0-a745-08a419a6901f") : secret "kserve-webhook-server-cert" not found
Sep 05 06:33:41.242989 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.242954    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szwbr\" (UniqueName: \"kubernetes.io/projected/528bc1a8-43f3-46d0-8693-db879285bf29-kube-api-access-szwbr\") pod \"llmisvc-controller-manager-777c6bd7d5-9vks8\" (UID: \"528bc1a8-43f3-46d0-8693-db879285bf29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"
Sep 05 06:33:41.242989 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.242981    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fqtb\" (UniqueName: \"kubernetes.io/projected/1cf33a6e-11c7-45d0-a745-08a419a6901f-kube-api-access-7fqtb\") pod \"kserve-controller-manager-d6f4b65b8-gpjp4\" (UID: \"1cf33a6e-11c7-45d0-a745-08a419a6901f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"
Sep 05 06:33:41.450958 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.450926    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:41.732257 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.732170    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1cf33a6e-11c7-45d0-a745-08a419a6901f-cert\") pod \"kserve-controller-manager-d6f4b65b8-gpjp4\" (UID: \"1cf33a6e-11c7-45d0-a745-08a419a6901f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"
Sep 05 06:33:41.732257 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.732234    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/528bc1a8-43f3-46d0-8693-db879285bf29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9vks8\" (UID: \"528bc1a8-43f3-46d0-8693-db879285bf29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"
Sep 05 06:33:41.732485 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:33:41.732356    2583 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 05 06:33:41.732485 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:33:41.732449    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/528bc1a8-43f3-46d0-8693-db879285bf29-cert podName:528bc1a8-43f3-46d0-8693-db879285bf29 nodeName:}" failed. No retries permitted until 2026-09-05 06:33:42.732427699 +0000 UTC m=+520.336976530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/528bc1a8-43f3-46d0-8693-db879285bf29-cert") pod "llmisvc-controller-manager-777c6bd7d5-9vks8" (UID: "528bc1a8-43f3-46d0-8693-db879285bf29") : secret "llmisvc-webhook-server-cert" not found
Sep 05 06:33:41.734444 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.734424    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1cf33a6e-11c7-45d0-a745-08a419a6901f-cert\") pod \"kserve-controller-manager-d6f4b65b8-gpjp4\" (UID: \"1cf33a6e-11c7-45d0-a745-08a419a6901f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"
Sep 05 06:33:41.848877 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.848829    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:41.860001 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:41.859980    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"
Sep 05 06:33:42.150340 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:42.150314    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"]
Sep 05 06:33:42.152247 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:33:42.152223    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf33a6e_11c7_45d0_a745_08a419a6901f.slice/crio-6390d5e34a7cb0d40e64da5f8a3fce28c0c01e4bf8032c2cbbfe13dab7d9353a WatchSource:0}: Error finding container 6390d5e34a7cb0d40e64da5f8a3fce28c0c01e4bf8032c2cbbfe13dab7d9353a: Status 404 returned error can't find the container with id 6390d5e34a7cb0d40e64da5f8a3fce28c0c01e4bf8032c2cbbfe13dab7d9353a
Sep 05 06:33:42.199643 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:42.199589    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:42.300235 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:42.300199    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:33:42.741321 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:42.741285    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/528bc1a8-43f3-46d0-8693-db879285bf29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9vks8\" (UID: \"528bc1a8-43f3-46d0-8693-db879285bf29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"
Sep 05 06:33:42.744047 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:42.744017    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/528bc1a8-43f3-46d0-8693-db879285bf29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9vks8\" (UID: \"528bc1a8-43f3-46d0-8693-db879285bf29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"
Sep 05 06:33:42.781010 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:42.780978    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"
Sep 05 06:33:42.857412 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:42.857376    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4" event={"ID":"1cf33a6e-11c7-45d0-a745-08a419a6901f","Type":"ContainerStarted","Data":"6390d5e34a7cb0d40e64da5f8a3fce28c0c01e4bf8032c2cbbfe13dab7d9353a"}
Sep 05 06:33:43.059285 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.058846    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"]
Sep 05 06:33:43.061738 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:33:43.061672    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod528bc1a8_43f3_46d0_8693_db879285bf29.slice/crio-35b58d4db459f3cb61d28cfc241a6b4c3bc115df40852e574ec5cb1e798f6787 WatchSource:0}: Error finding container 35b58d4db459f3cb61d28cfc241a6b4c3bc115df40852e574ec5cb1e798f6787: Status 404 returned error can't find the container with id 35b58d4db459f3cb61d28cfc241a6b4c3bc115df40852e574ec5cb1e798f6787
Sep 05 06:33:43.366950 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.366857    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"]
Sep 05 06:33:43.367391 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.367049    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk" podUID="654c7cec-1ecf-4cf5-b51e-44d2821a1243" containerName="discovery" containerID="cri-o://3e4b14659c222e7528a68d5156b2720d52c1d3f133b0e1a223563ce52f6cd3a1" gracePeriod=30
Sep 05 06:33:43.628575 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.628516    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:43.749383 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.749346    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-csr-dns-cert\") pod \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") "
Sep 05 06:33:43.749524 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.749395    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-token\") pod \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") "
Sep 05 06:33:43.749524 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.749425    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zjc5\" (UniqueName: \"kubernetes.io/projected/654c7cec-1ecf-4cf5-b51e-44d2821a1243-kube-api-access-2zjc5\") pod \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") "
Sep 05 06:33:43.749524 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.749445    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-csr-ca-configmap\") pod \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") "
Sep 05 06:33:43.749524 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.749514    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-cacerts\") pod \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") "
Sep 05 06:33:43.749746 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.749551    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-kubeconfig\") pod \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") "
Sep 05 06:33:43.749746 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.749579    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/654c7cec-1ecf-4cf5-b51e-44d2821a1243-local-certs\") pod \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\" (UID: \"654c7cec-1ecf-4cf5-b51e-44d2821a1243\") "
Sep 05 06:33:43.750143 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.750114    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "654c7cec-1ecf-4cf5-b51e-44d2821a1243" (UID: "654c7cec-1ecf-4cf5-b51e-44d2821a1243"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:33:43.752014 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.751964    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "654c7cec-1ecf-4cf5-b51e-44d2821a1243" (UID: "654c7cec-1ecf-4cf5-b51e-44d2821a1243"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:33:43.752180 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.752115    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "654c7cec-1ecf-4cf5-b51e-44d2821a1243" (UID: "654c7cec-1ecf-4cf5-b51e-44d2821a1243"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:33:43.752252 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.752223    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-token" (OuterVolumeSpecName: "istio-token") pod "654c7cec-1ecf-4cf5-b51e-44d2821a1243" (UID: "654c7cec-1ecf-4cf5-b51e-44d2821a1243"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:33:43.752339 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.752317    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/654c7cec-1ecf-4cf5-b51e-44d2821a1243-kube-api-access-2zjc5" (OuterVolumeSpecName: "kube-api-access-2zjc5") pod "654c7cec-1ecf-4cf5-b51e-44d2821a1243" (UID: "654c7cec-1ecf-4cf5-b51e-44d2821a1243"). InnerVolumeSpecName "kube-api-access-2zjc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:33:43.752391 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.752369    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/654c7cec-1ecf-4cf5-b51e-44d2821a1243-local-certs" (OuterVolumeSpecName: "local-certs") pod "654c7cec-1ecf-4cf5-b51e-44d2821a1243" (UID: "654c7cec-1ecf-4cf5-b51e-44d2821a1243"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:33:43.752443 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.752420    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-cacerts" (OuterVolumeSpecName: "cacerts") pod "654c7cec-1ecf-4cf5-b51e-44d2821a1243" (UID: "654c7cec-1ecf-4cf5-b51e-44d2821a1243"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:33:43.851123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.851089    2583 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-cacerts\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:33:43.851123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.851117    2583 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-kubeconfig\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:33:43.851123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.851128    2583 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/654c7cec-1ecf-4cf5-b51e-44d2821a1243-local-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:33:43.851368 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.851136    2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-csr-dns-cert\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:33:43.851368 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.851161    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-token\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:33:43.851368 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.851171    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zjc5\" (UniqueName: \"kubernetes.io/projected/654c7cec-1ecf-4cf5-b51e-44d2821a1243-kube-api-access-2zjc5\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:33:43.851368 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.851179    2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/654c7cec-1ecf-4cf5-b51e-44d2821a1243-istio-csr-ca-configmap\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:33:43.863234 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.863186    2583 generic.go:356] "Generic (PLEG): container finished" podID="654c7cec-1ecf-4cf5-b51e-44d2821a1243" containerID="3e4b14659c222e7528a68d5156b2720d52c1d3f133b0e1a223563ce52f6cd3a1" exitCode=0
Sep 05 06:33:43.863373 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.863256    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"
Sep 05 06:33:43.863373 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.863276    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk" event={"ID":"654c7cec-1ecf-4cf5-b51e-44d2821a1243","Type":"ContainerDied","Data":"3e4b14659c222e7528a68d5156b2720d52c1d3f133b0e1a223563ce52f6cd3a1"}
Sep 05 06:33:43.863373 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.863340    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk" event={"ID":"654c7cec-1ecf-4cf5-b51e-44d2821a1243","Type":"ContainerDied","Data":"6860cd5b604cebe601e1d6dd2e3fa5b1ab025562fa4df64a9b5b83d3b8a8567d"}
Sep 05 06:33:43.863373 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.863367    2583 scope.go:117] "RemoveContainer" containerID="3e4b14659c222e7528a68d5156b2720d52c1d3f133b0e1a223563ce52f6cd3a1"
Sep 05 06:33:43.864979 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.864922    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8" event={"ID":"528bc1a8-43f3-46d0-8693-db879285bf29","Type":"ContainerStarted","Data":"35b58d4db459f3cb61d28cfc241a6b4c3bc115df40852e574ec5cb1e798f6787"}
Sep 05 06:33:43.901730 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.901655    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"]
Sep 05 06:33:43.902872 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:43.902836    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk"]
Sep 05 06:33:44.245706 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:44.245535    2583 scope.go:117] "RemoveContainer" containerID="3e4b14659c222e7528a68d5156b2720d52c1d3f133b0e1a223563ce52f6cd3a1"
Sep 05 06:33:44.245957 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:33:44.245930    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e4b14659c222e7528a68d5156b2720d52c1d3f133b0e1a223563ce52f6cd3a1\": container with ID starting with 3e4b14659c222e7528a68d5156b2720d52c1d3f133b0e1a223563ce52f6cd3a1 not found: ID does not exist" containerID="3e4b14659c222e7528a68d5156b2720d52c1d3f133b0e1a223563ce52f6cd3a1"
Sep 05 06:33:44.246020 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:44.245971    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e4b14659c222e7528a68d5156b2720d52c1d3f133b0e1a223563ce52f6cd3a1"} err="failed to get container status \"3e4b14659c222e7528a68d5156b2720d52c1d3f133b0e1a223563ce52f6cd3a1\": rpc error: code = NotFound desc = could not find container \"3e4b14659c222e7528a68d5156b2720d52c1d3f133b0e1a223563ce52f6cd3a1\": container with ID starting with 3e4b14659c222e7528a68d5156b2720d52c1d3f133b0e1a223563ce52f6cd3a1 not found: ID does not exist"
Sep 05 06:33:44.914653 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:44.914621    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="654c7cec-1ecf-4cf5-b51e-44d2821a1243" path="/var/lib/kubelet/pods/654c7cec-1ecf-4cf5-b51e-44d2821a1243/volumes"
Sep 05 06:33:45.878499 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:45.878455    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4" event={"ID":"1cf33a6e-11c7-45d0-a745-08a419a6901f","Type":"ContainerStarted","Data":"82a79d88dc79c4ec177d43d5ff8165a7a7017893896802f66e102114d59e5650"}
Sep 05 06:33:45.878701 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:45.878592    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"
Sep 05 06:33:45.899258 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:45.899165    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4" podStartSLOduration=3.59255011 podStartE2EDuration="5.899145654s" totalImagesPullingTime="2.306595544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:33:45.897823919 +0000 UTC m=+523.502372757" watchObservedRunningTime="2026-09-05 06:33:45.899145654 +0000 UTC m=+523.503694493"
Sep 05 06:33:46.884041 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:46.884003    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8" event={"ID":"528bc1a8-43f3-46d0-8693-db879285bf29","Type":"ContainerStarted","Data":"4e1008ad5b9d192cb60bb5a95d01a8b6ff81563e6cd819d2bb1f4b6e05f90043"}
Sep 05 06:33:46.884540 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:46.884274    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"
Sep 05 06:33:46.904140 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:33:46.904088    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8" podStartSLOduration=3.80660372 podStartE2EDuration="6.904068333s" totalImagesPullingTime="3.097464613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:33:46.903582176 +0000 UTC m=+524.508131015" watchObservedRunningTime="2026-09-05 06:33:46.904068333 +0000 UTC m=+524.508617171"
Sep 05 06:34:16.889549 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:16.889520    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gpjp4"
Sep 05 06:34:17.889523 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:17.889489    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9vks8"
Sep 05 06:34:32.426914 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:32.426874    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:32.502259 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:32.502228    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:46.752617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:46.752581    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:48.913648 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:48.913617    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"]
Sep 05 06:34:48.914042 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:48.913857    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="654c7cec-1ecf-4cf5-b51e-44d2821a1243" containerName="discovery"
Sep 05 06:34:48.914042 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:48.913883    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="654c7cec-1ecf-4cf5-b51e-44d2821a1243" containerName="discovery"
Sep 05 06:34:48.914042 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:48.913927    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="654c7cec-1ecf-4cf5-b51e-44d2821a1243" containerName="discovery"
Sep 05 06:34:48.916721 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:48.916705    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:34:48.919427 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:48.919406    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 05 06:34:48.920663 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:48.920625    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pvp6b\""
Sep 05 06:34:48.920663 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:48.920627    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 05 06:34:48.929588 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:48.929558    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"]
Sep 05 06:34:48.994175 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:48.994144    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw8k2\" (UniqueName: \"kubernetes.io/projected/61108c4a-0157-4c03-a1ad-71840aad4ff5-kube-api-access-cw8k2\") pod \"limitador-operator-controller-manager-6c549b6d85-d7l2d\" (UID: \"61108c4a-0157-4c03-a1ad-71840aad4ff5\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:34:49.094633 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:49.094595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw8k2\" (UniqueName: \"kubernetes.io/projected/61108c4a-0157-4c03-a1ad-71840aad4ff5-kube-api-access-cw8k2\") pod \"limitador-operator-controller-manager-6c549b6d85-d7l2d\" (UID: \"61108c4a-0157-4c03-a1ad-71840aad4ff5\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:34:49.105773 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:49.105744    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw8k2\" (UniqueName: \"kubernetes.io/projected/61108c4a-0157-4c03-a1ad-71840aad4ff5-kube-api-access-cw8k2\") pod \"limitador-operator-controller-manager-6c549b6d85-d7l2d\" (UID: \"61108c4a-0157-4c03-a1ad-71840aad4ff5\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:34:49.143660 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:49.143618    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:49.225976 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:49.225947    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:34:49.501540 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:49.501513    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"]
Sep 05 06:34:49.504097 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:34:49.504064    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61108c4a_0157_4c03_a1ad_71840aad4ff5.slice/crio-799521bd04bd6082b278c8bafaa8d58af1ad5f9f9bf5c0a838e1f969dfaa4ec4 WatchSource:0}: Error finding container 799521bd04bd6082b278c8bafaa8d58af1ad5f9f9bf5c0a838e1f969dfaa4ec4: Status 404 returned error can't find the container with id 799521bd04bd6082b278c8bafaa8d58af1ad5f9f9bf5c0a838e1f969dfaa4ec4
Sep 05 06:34:49.564387 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:49.564353    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:50.127373 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:50.127339    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d" event={"ID":"61108c4a-0157-4c03-a1ad-71840aad4ff5","Type":"ContainerStarted","Data":"799521bd04bd6082b278c8bafaa8d58af1ad5f9f9bf5c0a838e1f969dfaa4ec4"}
Sep 05 06:34:51.291628 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:51.291589    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-pgb58"]
Sep 05 06:34:51.300196 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:51.300170    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-pgb58"
Sep 05 06:34:51.303477 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:51.303455    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-k26lt\""
Sep 05 06:34:51.310431 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:51.310406    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-pgb58"]
Sep 05 06:34:51.416156 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:51.416114    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckln6\" (UniqueName: \"kubernetes.io/projected/02dea07a-b6fe-4277-a4a5-04b5036ebf21-kube-api-access-ckln6\") pod \"authorino-operator-68d88948d8-pgb58\" (UID: \"02dea07a-b6fe-4277-a4a5-04b5036ebf21\") " pod="kuadrant-system/authorino-operator-68d88948d8-pgb58"
Sep 05 06:34:51.516958 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:51.516919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckln6\" (UniqueName: \"kubernetes.io/projected/02dea07a-b6fe-4277-a4a5-04b5036ebf21-kube-api-access-ckln6\") pod \"authorino-operator-68d88948d8-pgb58\" (UID: \"02dea07a-b6fe-4277-a4a5-04b5036ebf21\") " pod="kuadrant-system/authorino-operator-68d88948d8-pgb58"
Sep 05 06:34:51.531051 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:51.531023    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckln6\" (UniqueName: \"kubernetes.io/projected/02dea07a-b6fe-4277-a4a5-04b5036ebf21-kube-api-access-ckln6\") pod \"authorino-operator-68d88948d8-pgb58\" (UID: \"02dea07a-b6fe-4277-a4a5-04b5036ebf21\") " pod="kuadrant-system/authorino-operator-68d88948d8-pgb58"
Sep 05 06:34:51.612701 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:51.612624    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-pgb58"
Sep 05 06:34:51.827597 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:51.827542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:51.977431 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:51.977401    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:52.109350 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:52.109326    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-pgb58"]
Sep 05 06:34:52.111513 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:34:52.111479    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02dea07a_b6fe_4277_a4a5_04b5036ebf21.slice/crio-01b089afb2e75d81db942bb68dd84be8e44efc5b8b4dc6c557cb2367348d898f WatchSource:0}: Error finding container 01b089afb2e75d81db942bb68dd84be8e44efc5b8b4dc6c557cb2367348d898f: Status 404 returned error can't find the container with id 01b089afb2e75d81db942bb68dd84be8e44efc5b8b4dc6c557cb2367348d898f
Sep 05 06:34:52.137971 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:52.137942    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-pgb58" event={"ID":"02dea07a-b6fe-4277-a4a5-04b5036ebf21","Type":"ContainerStarted","Data":"01b089afb2e75d81db942bb68dd84be8e44efc5b8b4dc6c557cb2367348d898f"}
Sep 05 06:34:52.139457 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:52.139439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d" event={"ID":"61108c4a-0157-4c03-a1ad-71840aad4ff5","Type":"ContainerStarted","Data":"3e76b030b3a1805ee6d9b0740f1778743931f6139f2c41569cd15d6a43176d04"}
Sep 05 06:34:52.139535 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:52.139510    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:34:52.169651 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:52.169604    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d" podStartSLOduration=1.789268345 podStartE2EDuration="4.16959194s" totalImagesPullingTime="2.380323595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:34:52.168105607 +0000 UTC m=+589.772654450" watchObservedRunningTime="2026-09-05 06:34:52.16959194 +0000 UTC m=+589.774140778"
Sep 05 06:34:53.206226 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:53.206175    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:53.567225 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:53.567197    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-b6tlv"]
Sep 05 06:34:53.571382 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:53.571364    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-b6tlv"
Sep 05 06:34:53.579232 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:53.579205    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7jtbs\""
Sep 05 06:34:53.579232 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:53.579205    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 05 06:34:53.583070 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:53.583051    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-b6tlv"]
Sep 05 06:34:53.635588 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:53.635549    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm84p\" (UniqueName: \"kubernetes.io/projected/3385b045-8f4e-4d2d-b559-4cccc6647762-kube-api-access-sm84p\") pod \"dns-operator-controller-manager-5985564776-b6tlv\" (UID: \"3385b045-8f4e-4d2d-b559-4cccc6647762\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-b6tlv"
Sep 05 06:34:53.696411 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:53.696377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:53.737134 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:53.737097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm84p\" (UniqueName: \"kubernetes.io/projected/3385b045-8f4e-4d2d-b559-4cccc6647762-kube-api-access-sm84p\") pod \"dns-operator-controller-manager-5985564776-b6tlv\" (UID: \"3385b045-8f4e-4d2d-b559-4cccc6647762\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-b6tlv"
Sep 05 06:34:53.746527 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:53.746504    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm84p\" (UniqueName: \"kubernetes.io/projected/3385b045-8f4e-4d2d-b559-4cccc6647762-kube-api-access-sm84p\") pod \"dns-operator-controller-manager-5985564776-b6tlv\" (UID: \"3385b045-8f4e-4d2d-b559-4cccc6647762\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-b6tlv"
Sep 05 06:34:53.881544 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:53.881469    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-b6tlv"
Sep 05 06:34:54.150558 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:54.150463    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-pgb58" event={"ID":"02dea07a-b6fe-4277-a4a5-04b5036ebf21","Type":"ContainerStarted","Data":"ffc606098c39ec73979b970244f280c160d1de577955d38a8354bdad85ba85dd"}
Sep 05 06:34:54.150741 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:54.150562    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-pgb58"
Sep 05 06:34:54.160553 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:54.160522    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-b6tlv"]
Sep 05 06:34:54.165214 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:34:54.165178    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3385b045_8f4e_4d2d_b559_4cccc6647762.slice/crio-8966489de1d43344dad54b18f438aa1a20c63abed4304e907990f429285babdf WatchSource:0}: Error finding container 8966489de1d43344dad54b18f438aa1a20c63abed4304e907990f429285babdf: Status 404 returned error can't find the container with id 8966489de1d43344dad54b18f438aa1a20c63abed4304e907990f429285babdf
Sep 05 06:34:54.190802 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:54.190780    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:54.399714 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:54.399681    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:54.554959 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:54.554927    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:55.157567 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:55.157534    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-b6tlv" event={"ID":"3385b045-8f4e-4d2d-b559-4cccc6647762","Type":"ContainerStarted","Data":"8966489de1d43344dad54b18f438aa1a20c63abed4304e907990f429285babdf"}
Sep 05 06:34:55.174473 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:55.174428    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:55.413699 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:55.413617    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:55.550582 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:55.550548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:34:56.163174 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:56.163141    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-b6tlv" event={"ID":"3385b045-8f4e-4d2d-b559-4cccc6647762","Type":"ContainerStarted","Data":"f70bd95eac8925d7ec3ac8ce361bb334ac9a212b2b2f81db87278ec2563eb3e7"}
Sep 05 06:34:56.163337 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:56.163276    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-b6tlv"
Sep 05 06:34:56.192757 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:56.192707    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-pgb58" podStartSLOduration=3.7831246849999998 podStartE2EDuration="5.192690282s" totalImagesPullingTime="1.409565597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:34:54.181250838 +0000 UTC m=+591.785799676" watchObservedRunningTime="2026-09-05 06:34:56.192690282 +0000 UTC m=+593.797239121"
Sep 05 06:34:58.832499 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:58.832442    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-b6tlv" podStartSLOduration=4.027764213 podStartE2EDuration="5.832423511s" totalImagesPullingTime="1.804659298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:34:56.192039691 +0000 UTC m=+593.796588529" watchObservedRunningTime="2026-09-05 06:34:58.832423511 +0000 UTC m=+596.436972349"
Sep 05 06:34:58.833491 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:58.833465    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"]
Sep 05 06:34:58.836719 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:58.836704    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:34:58.840172 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:58.840153    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7q2pt\""
Sep 05 06:34:58.853993 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:58.853970    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"]
Sep 05 06:34:58.976826 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:58.976789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5be01874-8cdf-4856-8c55-ba5ce9ee0209-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" (UID: \"5be01874-8cdf-4856-8c55-ba5ce9ee0209\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:34:58.976826 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:58.976825    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krpws\" (UniqueName: \"kubernetes.io/projected/5be01874-8cdf-4856-8c55-ba5ce9ee0209-kube-api-access-krpws\") pod \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" (UID: \"5be01874-8cdf-4856-8c55-ba5ce9ee0209\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:34:59.078109 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:59.078081    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5be01874-8cdf-4856-8c55-ba5ce9ee0209-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" (UID: \"5be01874-8cdf-4856-8c55-ba5ce9ee0209\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:34:59.078247 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:59.078114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krpws\" (UniqueName: \"kubernetes.io/projected/5be01874-8cdf-4856-8c55-ba5ce9ee0209-kube-api-access-krpws\") pod \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" (UID: \"5be01874-8cdf-4856-8c55-ba5ce9ee0209\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:34:59.078466 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:59.078447    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5be01874-8cdf-4856-8c55-ba5ce9ee0209-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" (UID: \"5be01874-8cdf-4856-8c55-ba5ce9ee0209\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:34:59.087496 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:59.087444    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krpws\" (UniqueName: \"kubernetes.io/projected/5be01874-8cdf-4856-8c55-ba5ce9ee0209-kube-api-access-krpws\") pod \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" (UID: \"5be01874-8cdf-4856-8c55-ba5ce9ee0209\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:34:59.146006 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:59.145975    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:34:59.421928 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:34:59.421904    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"]
Sep 05 06:34:59.423235 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:34:59.423210    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be01874_8cdf_4856_8c55_ba5ce9ee0209.slice/crio-e93f69141c999371f3a7cf99515a1c23144581534262fbad1021cbbc27a08a7d WatchSource:0}: Error finding container e93f69141c999371f3a7cf99515a1c23144581534262fbad1021cbbc27a08a7d: Status 404 returned error can't find the container with id e93f69141c999371f3a7cf99515a1c23144581534262fbad1021cbbc27a08a7d
Sep 05 06:35:00.181601 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:00.181566    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj" event={"ID":"5be01874-8cdf-4856-8c55-ba5ce9ee0209","Type":"ContainerStarted","Data":"e93f69141c999371f3a7cf99515a1c23144581534262fbad1021cbbc27a08a7d"}
Sep 05 06:35:02.159828 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:02.159779    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:02.261139 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:02.261088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:03.147637 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:03.147603    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:35:04.203488 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:04.203453    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj" event={"ID":"5be01874-8cdf-4856-8c55-ba5ce9ee0209","Type":"ContainerStarted","Data":"4959737fee51106c081ee4489f6e6ecaa7dd36af1a59e5a16b9dd285ffd41cc8"}
Sep 05 06:35:04.203997 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:04.203597    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:35:04.234951 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:04.234903    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj" podStartSLOduration=2.236263171 podStartE2EDuration="6.234849644s" totalImagesPullingTime="3.998586473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:35:04.232155507 +0000 UTC m=+601.836704357" watchObservedRunningTime="2026-09-05 06:35:04.234849644 +0000 UTC m=+601.839398481"
Sep 05 06:35:05.160111 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:05.160079    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-pgb58"
Sep 05 06:35:06.186148 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.186115    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"]
Sep 05 06:35:06.186682 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.186273    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:06.189478 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.189463    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"
Sep 05 06:35:06.192195 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.192175    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 05 06:35:06.192295 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.192219    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 05 06:35:06.192295 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.192256    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-llklw\""
Sep 05 06:35:06.204763 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.204742    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"]
Sep 05 06:35:06.332418 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.332378    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:06.337609 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.337587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f095918-637a-40f8-a199-4ab218329468-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-7xh2f\" (UID: \"4f095918-637a-40f8-a199-4ab218329468\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"
Sep 05 06:35:06.337687 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.337620    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f095918-637a-40f8-a199-4ab218329468-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-7xh2f\" (UID: \"4f095918-637a-40f8-a199-4ab218329468\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"
Sep 05 06:35:06.337687 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.337649    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq99l\" (UniqueName: \"kubernetes.io/projected/4f095918-637a-40f8-a199-4ab218329468-kube-api-access-wq99l\") pod \"kuadrant-console-plugin-598f86468b-7xh2f\" (UID: \"4f095918-637a-40f8-a199-4ab218329468\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"
Sep 05 06:35:06.422913 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.422879    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:06.438779 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.438712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f095918-637a-40f8-a199-4ab218329468-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-7xh2f\" (UID: \"4f095918-637a-40f8-a199-4ab218329468\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"
Sep 05 06:35:06.438779 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.438748    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f095918-637a-40f8-a199-4ab218329468-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-7xh2f\" (UID: \"4f095918-637a-40f8-a199-4ab218329468\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"
Sep 05 06:35:06.438961 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.438793    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq99l\" (UniqueName: \"kubernetes.io/projected/4f095918-637a-40f8-a199-4ab218329468-kube-api-access-wq99l\") pod \"kuadrant-console-plugin-598f86468b-7xh2f\" (UID: \"4f095918-637a-40f8-a199-4ab218329468\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"
Sep 05 06:35:06.439431 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.439408    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f095918-637a-40f8-a199-4ab218329468-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-7xh2f\" (UID: \"4f095918-637a-40f8-a199-4ab218329468\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"
Sep 05 06:35:06.440991 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.440972    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f095918-637a-40f8-a199-4ab218329468-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-7xh2f\" (UID: \"4f095918-637a-40f8-a199-4ab218329468\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"
Sep 05 06:35:06.452221 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.452200    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq99l\" (UniqueName: \"kubernetes.io/projected/4f095918-637a-40f8-a199-4ab218329468-kube-api-access-wq99l\") pod \"kuadrant-console-plugin-598f86468b-7xh2f\" (UID: \"4f095918-637a-40f8-a199-4ab218329468\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"
Sep 05 06:35:06.498660 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.498630    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"
Sep 05 06:35:06.568900 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.568822    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:06.642038 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.642007    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:06.768826 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:06.768801    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f"]
Sep 05 06:35:06.771244 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:35:06.771220    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f095918_637a_40f8_a199_4ab218329468.slice/crio-316ad753a7e6eef779895cb0e09f1010ad387a464596458a282295ae43cb106f WatchSource:0}: Error finding container 316ad753a7e6eef779895cb0e09f1010ad387a464596458a282295ae43cb106f: Status 404 returned error can't find the container with id 316ad753a7e6eef779895cb0e09f1010ad387a464596458a282295ae43cb106f
Sep 05 06:35:07.169446 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:07.169370    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-b6tlv"
Sep 05 06:35:07.220204 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:07.220175    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f" event={"ID":"4f095918-637a-40f8-a199-4ab218329468","Type":"ContainerStarted","Data":"316ad753a7e6eef779895cb0e09f1010ad387a464596458a282295ae43cb106f"}
Sep 05 06:35:09.350903 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:09.350854    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:09.451052 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:09.451019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:12.251354 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:12.251319    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f" event={"ID":"4f095918-637a-40f8-a199-4ab218329468","Type":"ContainerStarted","Data":"20ec6682bf3f678c4c8988aed785a286a5479d6405b86e5f6fb2283034511e86"}
Sep 05 06:35:12.271902 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:12.271839    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7xh2f" podStartSLOduration=1.737041565 podStartE2EDuration="6.271825163s" totalImagesPullingTime="4.534783598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:35:12.270082914 +0000 UTC m=+609.874631764" watchObservedRunningTime="2026-09-05 06:35:12.271825163 +0000 UTC m=+609.876374001"
Sep 05 06:35:15.212052 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:15.212021    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:35:15.766572 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:15.766532    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:15.873828 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:15.873795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:15.970391 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:15.970359    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:16.256387 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:16.256357    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"]
Sep 05 06:35:16.259895 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:16.259877    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:16.272350 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:16.272324    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"]
Sep 05 06:35:16.419447 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:16.419414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34818f5e-c8f2-4cf1-a919-d10c87e8dc81-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-qbs7b\" (UID: \"34818f5e-c8f2-4cf1-a919-d10c87e8dc81\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:16.419447 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:16.419446    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxlz8\" (UniqueName: \"kubernetes.io/projected/34818f5e-c8f2-4cf1-a919-d10c87e8dc81-kube-api-access-qxlz8\") pod \"kuadrant-operator-controller-manager-96db98c47-qbs7b\" (UID: \"34818f5e-c8f2-4cf1-a919-d10c87e8dc81\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:16.520086 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:16.520011    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34818f5e-c8f2-4cf1-a919-d10c87e8dc81-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-qbs7b\" (UID: \"34818f5e-c8f2-4cf1-a919-d10c87e8dc81\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:16.520086 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:16.520044    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxlz8\" (UniqueName: \"kubernetes.io/projected/34818f5e-c8f2-4cf1-a919-d10c87e8dc81-kube-api-access-qxlz8\") pod \"kuadrant-operator-controller-manager-96db98c47-qbs7b\" (UID: \"34818f5e-c8f2-4cf1-a919-d10c87e8dc81\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:16.520459 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:16.520442    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34818f5e-c8f2-4cf1-a919-d10c87e8dc81-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-qbs7b\" (UID: \"34818f5e-c8f2-4cf1-a919-d10c87e8dc81\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:16.532971 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:16.532939    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxlz8\" (UniqueName: \"kubernetes.io/projected/34818f5e-c8f2-4cf1-a919-d10c87e8dc81-kube-api-access-qxlz8\") pod \"kuadrant-operator-controller-manager-96db98c47-qbs7b\" (UID: \"34818f5e-c8f2-4cf1-a919-d10c87e8dc81\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:16.569740 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:16.569714    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:16.852637 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:16.852612    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"]
Sep 05 06:35:16.853874 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:35:16.853837    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34818f5e_c8f2_4cf1_a919_d10c87e8dc81.slice/crio-2f78d307c728836e773bf4961096d8a42f41734d3e4d441c66c1ad649d392050 WatchSource:0}: Error finding container 2f78d307c728836e773bf4961096d8a42f41734d3e4d441c66c1ad649d392050: Status 404 returned error can't find the container with id 2f78d307c728836e773bf4961096d8a42f41734d3e4d441c66c1ad649d392050
Sep 05 06:35:17.275937 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.275900    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b" event={"ID":"34818f5e-c8f2-4cf1-a919-d10c87e8dc81","Type":"ContainerStarted","Data":"bd290104f504038e2a6e66e111b33007194ca503769e332628abfaba105ba297"}
Sep 05 06:35:17.276517 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.275962    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b" event={"ID":"34818f5e-c8f2-4cf1-a919-d10c87e8dc81","Type":"ContainerStarted","Data":"2f78d307c728836e773bf4961096d8a42f41734d3e4d441c66c1ad649d392050"}
Sep 05 06:35:17.276517 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.276035    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:17.299327 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.299279    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b" podStartSLOduration=1.299263516 podStartE2EDuration="1.299263516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:35:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:35:17.29723751 +0000 UTC m=+614.901786361" watchObservedRunningTime="2026-09-05 06:35:17.299263516 +0000 UTC m=+614.903812353"
Sep 05 06:35:17.407922 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.407890    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"]
Sep 05 06:35:17.408121 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.408080    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj" podUID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" containerName="manager" containerID="cri-o://4959737fee51106c081ee4489f6e6ecaa7dd36af1a59e5a16b9dd285ffd41cc8" gracePeriod=2
Sep 05 06:35:17.417314 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.417288    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"]
Sep 05 06:35:17.428785 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:17.428745    2583 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5be01874-8cdf-4856-8c55-ba5ce9ee0209\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-plxpj\": pods \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:35:17.431056 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.431033    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"]
Sep 05 06:35:17.434593 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.434566    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"]
Sep 05 06:35:17.434979 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.434956    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" containerName="manager"
Sep 05 06:35:17.434979 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.434979    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" containerName="manager"
Sep 05 06:35:17.435142 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.435076    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" containerName="manager"
Sep 05 06:35:17.438259 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.438240    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"
Sep 05 06:35:17.440598 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:17.440567    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:35:17.457853 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.457793    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"]
Sep 05 06:35:17.459147 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.459114    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"]
Sep 05 06:35:17.468779 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.468754    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"]
Sep 05 06:35:17.469000 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.468976    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d" podUID="61108c4a-0157-4c03-a1ad-71840aad4ff5" containerName="manager" containerID="cri-o://3e76b030b3a1805ee6d9b0740f1778743931f6139f2c41569cd15d6a43176d04" gracePeriod=2
Sep 05 06:35:17.469965 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.469946    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"]
Sep 05 06:35:17.470213 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.470201    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34818f5e-c8f2-4cf1-a919-d10c87e8dc81" containerName="manager"
Sep 05 06:35:17.470274 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.470214    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="34818f5e-c8f2-4cf1-a919-d10c87e8dc81" containerName="manager"
Sep 05 06:35:17.470328 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.470275    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="34818f5e-c8f2-4cf1-a919-d10c87e8dc81" containerName="manager"
Sep 05 06:35:17.473185 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.473168    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"
Sep 05 06:35:17.474891 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:17.474853    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:35:17.491173 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:17.491143    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-d7l2d\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="61108c4a-0157-4c03-a1ad-71840aad4ff5" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:35:17.491790 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.491769    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"]
Sep 05 06:35:17.493520 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.493496    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"]
Sep 05 06:35:17.498986 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.498967    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-zxnl6"]
Sep 05 06:35:17.499256 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.499244    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61108c4a-0157-4c03-a1ad-71840aad4ff5" containerName="manager"
Sep 05 06:35:17.499296 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.499257    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="61108c4a-0157-4c03-a1ad-71840aad4ff5" containerName="manager"
Sep 05 06:35:17.499330 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.499305    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="61108c4a-0157-4c03-a1ad-71840aad4ff5" containerName="manager"
Sep 05 06:35:17.502023 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.502007    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-zxnl6"
Sep 05 06:35:17.518906 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:17.518844    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:35:17.520739 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.520716    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-zxnl6"]
Sep 05 06:35:17.522752 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:17.522725    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-d7l2d\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="61108c4a-0157-4c03-a1ad-71840aad4ff5" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:35:17.529511 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.529458    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9c0fd9d-3913-4419-9d47-53b9ebdc6170-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-5v8w4\" (UID: \"f9c0fd9d-3913-4419-9d47-53b9ebdc6170\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"
Sep 05 06:35:17.529511 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.529500    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c8gd\" (UniqueName: \"kubernetes.io/projected/f9c0fd9d-3913-4419-9d47-53b9ebdc6170-kube-api-access-7c8gd\") pod \"kuadrant-operator-controller-manager-58fc56757c-5v8w4\" (UID: \"f9c0fd9d-3913-4419-9d47-53b9ebdc6170\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"
Sep 05 06:35:17.542836 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:17.542813    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:35:17.630334 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.630301    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c8gd\" (UniqueName: \"kubernetes.io/projected/f9c0fd9d-3913-4419-9d47-53b9ebdc6170-kube-api-access-7c8gd\") pod \"kuadrant-operator-controller-manager-58fc56757c-5v8w4\" (UID: \"f9c0fd9d-3913-4419-9d47-53b9ebdc6170\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"
Sep 05 06:35:17.630430 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.630381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zk7d\" (UniqueName: \"kubernetes.io/projected/112b41f8-f6ef-48ca-9b90-069bdc59cec4-kube-api-access-5zk7d\") pod \"limitador-operator-controller-manager-6c549b6d85-zxnl6\" (UID: \"112b41f8-f6ef-48ca-9b90-069bdc59cec4\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-zxnl6"
Sep 05 06:35:17.630479 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.630447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fafdaca-2f52-47c2-b49f-e5bc7bd1d480-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-kzw5s\" (UID: \"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"
Sep 05 06:35:17.630521 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.630504    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9c0fd9d-3913-4419-9d47-53b9ebdc6170-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-5v8w4\" (UID: \"f9c0fd9d-3913-4419-9d47-53b9ebdc6170\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"
Sep 05 06:35:17.630556 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.630538    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctwh4\" (UniqueName: \"kubernetes.io/projected/9fafdaca-2f52-47c2-b49f-e5bc7bd1d480-kube-api-access-ctwh4\") pod \"kuadrant-operator-controller-manager-96db98c47-kzw5s\" (UID: \"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"
Sep 05 06:35:17.631064 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.631042    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9c0fd9d-3913-4419-9d47-53b9ebdc6170-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-5v8w4\" (UID: \"f9c0fd9d-3913-4419-9d47-53b9ebdc6170\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"
Sep 05 06:35:17.644981 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.644956    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c8gd\" (UniqueName: \"kubernetes.io/projected/f9c0fd9d-3913-4419-9d47-53b9ebdc6170-kube-api-access-7c8gd\") pod \"kuadrant-operator-controller-manager-58fc56757c-5v8w4\" (UID: \"f9c0fd9d-3913-4419-9d47-53b9ebdc6170\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"
Sep 05 06:35:17.703801 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.703777    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:35:17.706062 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.706042    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:35:17.706285 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:17.706263    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-d7l2d\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="61108c4a-0157-4c03-a1ad-71840aad4ff5" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:35:17.708309 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:17.708285    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:35:17.710167 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:17.710140    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-d7l2d\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="61108c4a-0157-4c03-a1ad-71840aad4ff5" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:35:17.712013 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:17.711992    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:35:17.731540 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.731518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwh4\" (UniqueName: \"kubernetes.io/projected/9fafdaca-2f52-47c2-b49f-e5bc7bd1d480-kube-api-access-ctwh4\") pod \"kuadrant-operator-controller-manager-96db98c47-kzw5s\" (UID: \"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"
Sep 05 06:35:17.731626 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.731566    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk7d\" (UniqueName: \"kubernetes.io/projected/112b41f8-f6ef-48ca-9b90-069bdc59cec4-kube-api-access-5zk7d\") pod \"limitador-operator-controller-manager-6c549b6d85-zxnl6\" (UID: \"112b41f8-f6ef-48ca-9b90-069bdc59cec4\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-zxnl6"
Sep 05 06:35:17.731626 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.731602    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fafdaca-2f52-47c2-b49f-e5bc7bd1d480-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-kzw5s\" (UID: \"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"
Sep 05 06:35:17.731905 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.731888    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fafdaca-2f52-47c2-b49f-e5bc7bd1d480-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-kzw5s\" (UID: \"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"
Sep 05 06:35:17.743504 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.743484    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zk7d\" (UniqueName: \"kubernetes.io/projected/112b41f8-f6ef-48ca-9b90-069bdc59cec4-kube-api-access-5zk7d\") pod \"limitador-operator-controller-manager-6c549b6d85-zxnl6\" (UID: \"112b41f8-f6ef-48ca-9b90-069bdc59cec4\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-zxnl6"
Sep 05 06:35:17.743620 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.743548    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctwh4\" (UniqueName: \"kubernetes.io/projected/9fafdaca-2f52-47c2-b49f-e5bc7bd1d480-kube-api-access-ctwh4\") pod \"kuadrant-operator-controller-manager-96db98c47-kzw5s\" (UID: \"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"
Sep 05 06:35:17.832107 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.832018    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5be01874-8cdf-4856-8c55-ba5ce9ee0209-extensions-socket-volume\") pod \"5be01874-8cdf-4856-8c55-ba5ce9ee0209\" (UID: \"5be01874-8cdf-4856-8c55-ba5ce9ee0209\") "
Sep 05 06:35:17.832107 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.832067    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw8k2\" (UniqueName: \"kubernetes.io/projected/61108c4a-0157-4c03-a1ad-71840aad4ff5-kube-api-access-cw8k2\") pod \"61108c4a-0157-4c03-a1ad-71840aad4ff5\" (UID: \"61108c4a-0157-4c03-a1ad-71840aad4ff5\") "
Sep 05 06:35:17.832107 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.832087    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krpws\" (UniqueName: \"kubernetes.io/projected/5be01874-8cdf-4856-8c55-ba5ce9ee0209-kube-api-access-krpws\") pod \"5be01874-8cdf-4856-8c55-ba5ce9ee0209\" (UID: \"5be01874-8cdf-4856-8c55-ba5ce9ee0209\") "
Sep 05 06:35:17.832523 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.832497    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be01874-8cdf-4856-8c55-ba5ce9ee0209-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5be01874-8cdf-4856-8c55-ba5ce9ee0209" (UID: "5be01874-8cdf-4856-8c55-ba5ce9ee0209"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:35:17.834296 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.834273    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5be01874-8cdf-4856-8c55-ba5ce9ee0209-kube-api-access-krpws" (OuterVolumeSpecName: "kube-api-access-krpws") pod "5be01874-8cdf-4856-8c55-ba5ce9ee0209" (UID: "5be01874-8cdf-4856-8c55-ba5ce9ee0209"). InnerVolumeSpecName "kube-api-access-krpws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:35:17.834356 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.834329    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61108c4a-0157-4c03-a1ad-71840aad4ff5-kube-api-access-cw8k2" (OuterVolumeSpecName: "kube-api-access-cw8k2") pod "61108c4a-0157-4c03-a1ad-71840aad4ff5" (UID: "61108c4a-0157-4c03-a1ad-71840aad4ff5"). InnerVolumeSpecName "kube-api-access-cw8k2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:35:17.835435 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.835416    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"
Sep 05 06:35:17.852392 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.852369    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"
Sep 05 06:35:17.858371 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.858345    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-zxnl6"
Sep 05 06:35:17.933476 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.933447    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5be01874-8cdf-4856-8c55-ba5ce9ee0209-extensions-socket-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:35:17.933568 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.933483    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw8k2\" (UniqueName: \"kubernetes.io/projected/61108c4a-0157-4c03-a1ad-71840aad4ff5-kube-api-access-cw8k2\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:35:17.933568 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:17.933498    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krpws\" (UniqueName: \"kubernetes.io/projected/5be01874-8cdf-4856-8c55-ba5ce9ee0209-kube-api-access-krpws\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:35:18.115660 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.115629    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"]
Sep 05 06:35:18.117586 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:35:18.117554    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c0fd9d_3913_4419_9d47_53b9ebdc6170.slice/crio-ff365ca87e6ec6c4e0b792b52de368008533764fb809a56ad036fabec53ca121 WatchSource:0}: Error finding container ff365ca87e6ec6c4e0b792b52de368008533764fb809a56ad036fabec53ca121: Status 404 returned error can't find the container with id ff365ca87e6ec6c4e0b792b52de368008533764fb809a56ad036fabec53ca121
Sep 05 06:35:18.142549 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.142472    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-zxnl6"]
Sep 05 06:35:18.143666 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.143641    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"]
Sep 05 06:35:18.146989 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:35:18.146960    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fafdaca_2f52_47c2_b49f_e5bc7bd1d480.slice/crio-3857c1971304f3e75d5642a8fd10578f94c338050f77b6e667125c5390300e6f WatchSource:0}: Error finding container 3857c1971304f3e75d5642a8fd10578f94c338050f77b6e667125c5390300e6f: Status 404 returned error can't find the container with id 3857c1971304f3e75d5642a8fd10578f94c338050f77b6e667125c5390300e6f
Sep 05 06:35:18.147298 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:35:18.147278    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112b41f8_f6ef_48ca_9b90_069bdc59cec4.slice/crio-92d681b8085204a324c62d523adf649a46b1b227b769aaec1c4b1af7d28518bf WatchSource:0}: Error finding container 92d681b8085204a324c62d523adf649a46b1b227b769aaec1c4b1af7d28518bf: Status 404 returned error can't find the container with id 92d681b8085204a324c62d523adf649a46b1b227b769aaec1c4b1af7d28518bf
Sep 05 06:35:18.282603 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.282568    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-zxnl6" event={"ID":"112b41f8-f6ef-48ca-9b90-069bdc59cec4","Type":"ContainerStarted","Data":"82f12a9702482665bc26fc57547f047f7ef80f7e78d592859e5cd072b8fada04"}
Sep 05 06:35:18.283074 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.282657    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-zxnl6" event={"ID":"112b41f8-f6ef-48ca-9b90-069bdc59cec4","Type":"ContainerStarted","Data":"92d681b8085204a324c62d523adf649a46b1b227b769aaec1c4b1af7d28518bf"}
Sep 05 06:35:18.283074 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.282691    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-zxnl6"
Sep 05 06:35:18.284096 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.284073    2583 generic.go:356] "Generic (PLEG): container finished" podID="61108c4a-0157-4c03-a1ad-71840aad4ff5" containerID="3e76b030b3a1805ee6d9b0740f1778743931f6139f2c41569cd15d6a43176d04" exitCode=0
Sep 05 06:35:18.284204 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.284124    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:35:18.284904 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.284173    2583 scope.go:117] "RemoveContainer" containerID="3e76b030b3a1805ee6d9b0740f1778743931f6139f2c41569cd15d6a43176d04"
Sep 05 06:35:18.285037 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:18.284947    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-d7l2d\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="61108c4a-0157-4c03-a1ad-71840aad4ff5" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:35:18.285939 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.285900    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s" event={"ID":"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480","Type":"ContainerStarted","Data":"189f7db76a827b57f4155c1086642b9a9474fdbae2dddc470bae99f33f72b076"}
Sep 05 06:35:18.286031 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.285951    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s" event={"ID":"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480","Type":"ContainerStarted","Data":"3857c1971304f3e75d5642a8fd10578f94c338050f77b6e667125c5390300e6f"}
Sep 05 06:35:18.286031 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.285980    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"
Sep 05 06:35:18.287633 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.287612    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4" event={"ID":"f9c0fd9d-3913-4419-9d47-53b9ebdc6170","Type":"ContainerStarted","Data":"10edf34460a3334c2df8ec7b7dc83d9a67b5a23e33967d90c01c58ec2bffcf28"}
Sep 05 06:35:18.287725 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.287652    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4" event={"ID":"f9c0fd9d-3913-4419-9d47-53b9ebdc6170","Type":"ContainerStarted","Data":"ff365ca87e6ec6c4e0b792b52de368008533764fb809a56ad036fabec53ca121"}
Sep 05 06:35:18.287725 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.287690    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"
Sep 05 06:35:18.289159 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.289140    2583 generic.go:356] "Generic (PLEG): container finished" podID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" containerID="4959737fee51106c081ee4489f6e6ecaa7dd36af1a59e5a16b9dd285ffd41cc8" exitCode=0
Sep 05 06:35:18.289259 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.289197    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:35:18.289498 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:18.289484    2583 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b" container="manager"
Sep 05 06:35:18.294451 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.294256    2583 scope.go:117] "RemoveContainer" containerID="3e76b030b3a1805ee6d9b0740f1778743931f6139f2c41569cd15d6a43176d04"
Sep 05 06:35:18.294610 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:18.294576    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e76b030b3a1805ee6d9b0740f1778743931f6139f2c41569cd15d6a43176d04\": container with ID starting with 3e76b030b3a1805ee6d9b0740f1778743931f6139f2c41569cd15d6a43176d04 not found: ID does not exist" containerID="3e76b030b3a1805ee6d9b0740f1778743931f6139f2c41569cd15d6a43176d04"
Sep 05 06:35:18.294673 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.294621    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e76b030b3a1805ee6d9b0740f1778743931f6139f2c41569cd15d6a43176d04"} err="failed to get container status \"3e76b030b3a1805ee6d9b0740f1778743931f6139f2c41569cd15d6a43176d04\": rpc error: code = NotFound desc = could not find container \"3e76b030b3a1805ee6d9b0740f1778743931f6139f2c41569cd15d6a43176d04\": container with ID starting with 3e76b030b3a1805ee6d9b0740f1778743931f6139f2c41569cd15d6a43176d04 not found: ID does not exist"
Sep 05 06:35:18.294673 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.294644    2583 scope.go:117] "RemoveContainer" containerID="4959737fee51106c081ee4489f6e6ecaa7dd36af1a59e5a16b9dd285ffd41cc8"
Sep 05 06:35:18.306317 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.306269    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-zxnl6" podStartSLOduration=1.306251008 podStartE2EDuration="1.306251008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:35:18.304350686 +0000 UTC m=+615.908899525" watchObservedRunningTime="2026-09-05 06:35:18.306251008 +0000 UTC m=+615.910799847"
Sep 05 06:35:18.306647 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:18.306618    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:35:18.309094 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:18.309068    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-d7l2d\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="61108c4a-0157-4c03-a1ad-71840aad4ff5" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d7l2d"
Sep 05 06:35:18.311060 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.311031    2583 scope.go:117] "RemoveContainer" containerID="4959737fee51106c081ee4489f6e6ecaa7dd36af1a59e5a16b9dd285ffd41cc8"
Sep 05 06:35:18.311341 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:18.311312    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-qbs7b\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="34818f5e-c8f2-4cf1-a919-d10c87e8dc81" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:18.311635 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:18.311576    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4959737fee51106c081ee4489f6e6ecaa7dd36af1a59e5a16b9dd285ffd41cc8\": container with ID starting with 4959737fee51106c081ee4489f6e6ecaa7dd36af1a59e5a16b9dd285ffd41cc8 not found: ID does not exist" containerID="4959737fee51106c081ee4489f6e6ecaa7dd36af1a59e5a16b9dd285ffd41cc8"
Sep 05 06:35:18.311635 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.311610    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4959737fee51106c081ee4489f6e6ecaa7dd36af1a59e5a16b9dd285ffd41cc8"} err="failed to get container status \"4959737fee51106c081ee4489f6e6ecaa7dd36af1a59e5a16b9dd285ffd41cc8\": rpc error: code = NotFound desc = could not find container \"4959737fee51106c081ee4489f6e6ecaa7dd36af1a59e5a16b9dd285ffd41cc8\": container with ID starting with 4959737fee51106c081ee4489f6e6ecaa7dd36af1a59e5a16b9dd285ffd41cc8 not found: ID does not exist"
Sep 05 06:35:18.332512 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.332474    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s" podStartSLOduration=1.332462153 podStartE2EDuration="1.332462153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:35:18.330618641 +0000 UTC m=+615.935167478" watchObservedRunningTime="2026-09-05 06:35:18.332462153 +0000 UTC m=+615.937010992"
Sep 05 06:35:18.332684 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:18.332661    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-plxpj\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-plxpj"
Sep 05 06:35:18.359219 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.359186    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4" podStartSLOduration=1.359173669 podStartE2EDuration="1.359173669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:35:18.35811715 +0000 UTC m=+615.962666013" watchObservedRunningTime="2026-09-05 06:35:18.359173669 +0000 UTC m=+615.963722484"
Sep 05 06:35:18.914628 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.914545    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5be01874-8cdf-4856-8c55-ba5ce9ee0209" path="/var/lib/kubelet/pods/5be01874-8cdf-4856-8c55-ba5ce9ee0209/volumes"
Sep 05 06:35:18.914904 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:18.914889    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61108c4a-0157-4c03-a1ad-71840aad4ff5" path="/var/lib/kubelet/pods/61108c4a-0157-4c03-a1ad-71840aad4ff5/volumes"
Sep 05 06:35:19.298435 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:19.298392    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b" podUID="34818f5e-c8f2-4cf1-a919-d10c87e8dc81" containerName="manager" containerID="cri-o://bd290104f504038e2a6e66e111b33007194ca503769e332628abfaba105ba297" gracePeriod=2
Sep 05 06:35:19.541977 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:19.541953    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:19.645840 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:19.645760    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxlz8\" (UniqueName: \"kubernetes.io/projected/34818f5e-c8f2-4cf1-a919-d10c87e8dc81-kube-api-access-qxlz8\") pod \"34818f5e-c8f2-4cf1-a919-d10c87e8dc81\" (UID: \"34818f5e-c8f2-4cf1-a919-d10c87e8dc81\") "
Sep 05 06:35:19.645840 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:19.645835    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34818f5e-c8f2-4cf1-a919-d10c87e8dc81-extensions-socket-volume\") pod \"34818f5e-c8f2-4cf1-a919-d10c87e8dc81\" (UID: \"34818f5e-c8f2-4cf1-a919-d10c87e8dc81\") "
Sep 05 06:35:19.646250 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:19.646216    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34818f5e-c8f2-4cf1-a919-d10c87e8dc81-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "34818f5e-c8f2-4cf1-a919-d10c87e8dc81" (UID: "34818f5e-c8f2-4cf1-a919-d10c87e8dc81"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:35:19.647731 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:19.647711    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34818f5e-c8f2-4cf1-a919-d10c87e8dc81-kube-api-access-qxlz8" (OuterVolumeSpecName: "kube-api-access-qxlz8") pod "34818f5e-c8f2-4cf1-a919-d10c87e8dc81" (UID: "34818f5e-c8f2-4cf1-a919-d10c87e8dc81"). InnerVolumeSpecName "kube-api-access-qxlz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:35:19.746815 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:19.746781    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34818f5e-c8f2-4cf1-a919-d10c87e8dc81-extensions-socket-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:35:19.746815 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:19.746809    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxlz8\" (UniqueName: \"kubernetes.io/projected/34818f5e-c8f2-4cf1-a919-d10c87e8dc81-kube-api-access-qxlz8\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:35:20.305709 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:20.305675    2583 generic.go:356] "Generic (PLEG): container finished" podID="34818f5e-c8f2-4cf1-a919-d10c87e8dc81" containerID="bd290104f504038e2a6e66e111b33007194ca503769e332628abfaba105ba297" exitCode=0
Sep 05 06:35:20.306180 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:20.305726    2583 scope.go:117] "RemoveContainer" containerID="bd290104f504038e2a6e66e111b33007194ca503769e332628abfaba105ba297"
Sep 05 06:35:20.306180 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:20.305726    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:20.308414 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:20.308383    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-qbs7b\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="34818f5e-c8f2-4cf1-a919-d10c87e8dc81" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:20.314349 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:20.314332    2583 scope.go:117] "RemoveContainer" containerID="bd290104f504038e2a6e66e111b33007194ca503769e332628abfaba105ba297"
Sep 05 06:35:20.314615 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:20.314594    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd290104f504038e2a6e66e111b33007194ca503769e332628abfaba105ba297\": container with ID starting with bd290104f504038e2a6e66e111b33007194ca503769e332628abfaba105ba297 not found: ID does not exist" containerID="bd290104f504038e2a6e66e111b33007194ca503769e332628abfaba105ba297"
Sep 05 06:35:20.314679 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:20.314622    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd290104f504038e2a6e66e111b33007194ca503769e332628abfaba105ba297"} err="failed to get container status \"bd290104f504038e2a6e66e111b33007194ca503769e332628abfaba105ba297\": rpc error: code = NotFound desc = could not find container \"bd290104f504038e2a6e66e111b33007194ca503769e332628abfaba105ba297\": container with ID starting with bd290104f504038e2a6e66e111b33007194ca503769e332628abfaba105ba297 not found: ID does not exist"
Sep 05 06:35:20.316469 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:20.316450    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-qbs7b\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="34818f5e-c8f2-4cf1-a919-d10c87e8dc81" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-qbs7b"
Sep 05 06:35:20.914292 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:20.914258    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34818f5e-c8f2-4cf1-a919-d10c87e8dc81" path="/var/lib/kubelet/pods/34818f5e-c8f2-4cf1-a919-d10c87e8dc81/volumes"
Sep 05 06:35:22.386307 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:22.386268    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:22.492876 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:22.492829    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:26.174492 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:26.174407    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:26.245782 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:26.245743    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:26.371206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:26.371173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:26.470010 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:26.469975    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:29.301608 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.301574    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"
Sep 05 06:35:29.304095 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.301646    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-zxnl6"
Sep 05 06:35:29.304095 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.301761    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"
Sep 05 06:35:29.418804 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.418771    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"]
Sep 05 06:35:29.419062 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.419034    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4" podUID="f9c0fd9d-3913-4419-9d47-53b9ebdc6170" containerName="manager" containerID="cri-o://10edf34460a3334c2df8ec7b7dc83d9a67b5a23e33967d90c01c58ec2bffcf28" gracePeriod=10
Sep 05 06:35:29.646851 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.646826    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"]
Sep 05 06:35:29.650116 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.650099    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"
Sep 05 06:35:29.663290 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.663254    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"
Sep 05 06:35:29.664240 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.664217    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"]
Sep 05 06:35:29.724311 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.724279    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8q6q\" (UniqueName: \"kubernetes.io/projected/23a50426-27a4-4de9-9388-2c9f44993758-kube-api-access-p8q6q\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-84fnm\" (UID: \"23a50426-27a4-4de9-9388-2c9f44993758\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"
Sep 05 06:35:29.724476 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.724324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23a50426-27a4-4de9-9388-2c9f44993758-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-84fnm\" (UID: \"23a50426-27a4-4de9-9388-2c9f44993758\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"
Sep 05 06:35:29.824784 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.824745    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c8gd\" (UniqueName: \"kubernetes.io/projected/f9c0fd9d-3913-4419-9d47-53b9ebdc6170-kube-api-access-7c8gd\") pod \"f9c0fd9d-3913-4419-9d47-53b9ebdc6170\" (UID: \"f9c0fd9d-3913-4419-9d47-53b9ebdc6170\") "
Sep 05 06:35:29.824784 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.824788    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9c0fd9d-3913-4419-9d47-53b9ebdc6170-extensions-socket-volume\") pod \"f9c0fd9d-3913-4419-9d47-53b9ebdc6170\" (UID: \"f9c0fd9d-3913-4419-9d47-53b9ebdc6170\") "
Sep 05 06:35:29.825058 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.824931    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8q6q\" (UniqueName: \"kubernetes.io/projected/23a50426-27a4-4de9-9388-2c9f44993758-kube-api-access-p8q6q\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-84fnm\" (UID: \"23a50426-27a4-4de9-9388-2c9f44993758\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"
Sep 05 06:35:29.825058 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.824967    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23a50426-27a4-4de9-9388-2c9f44993758-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-84fnm\" (UID: \"23a50426-27a4-4de9-9388-2c9f44993758\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"
Sep 05 06:35:29.825209 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.825185    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9c0fd9d-3913-4419-9d47-53b9ebdc6170-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f9c0fd9d-3913-4419-9d47-53b9ebdc6170" (UID: "f9c0fd9d-3913-4419-9d47-53b9ebdc6170"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:35:29.825387 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.825367    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23a50426-27a4-4de9-9388-2c9f44993758-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-84fnm\" (UID: \"23a50426-27a4-4de9-9388-2c9f44993758\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"
Sep 05 06:35:29.826697 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.826675    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9c0fd9d-3913-4419-9d47-53b9ebdc6170-kube-api-access-7c8gd" (OuterVolumeSpecName: "kube-api-access-7c8gd") pod "f9c0fd9d-3913-4419-9d47-53b9ebdc6170" (UID: "f9c0fd9d-3913-4419-9d47-53b9ebdc6170"). InnerVolumeSpecName "kube-api-access-7c8gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:35:29.834519 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.834495    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8q6q\" (UniqueName: \"kubernetes.io/projected/23a50426-27a4-4de9-9388-2c9f44993758-kube-api-access-p8q6q\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-84fnm\" (UID: \"23a50426-27a4-4de9-9388-2c9f44993758\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"
Sep 05 06:35:29.925586 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.925506    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c8gd\" (UniqueName: \"kubernetes.io/projected/f9c0fd9d-3913-4419-9d47-53b9ebdc6170-kube-api-access-7c8gd\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:35:29.925586 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.925525    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9c0fd9d-3913-4419-9d47-53b9ebdc6170-extensions-socket-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:35:29.964269 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.964236    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:29.969167 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:29.969148    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"
Sep 05 06:35:30.066371 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.066342    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:30.261179 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.261152    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"]
Sep 05 06:35:30.263592 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:35:30.263569    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a50426_27a4_4de9_9388_2c9f44993758.slice/crio-77d7c8c8ef154364416b17647c0957aafd97893081e1ef894cd4676b6adc38eb WatchSource:0}: Error finding container 77d7c8c8ef154364416b17647c0957aafd97893081e1ef894cd4676b6adc38eb: Status 404 returned error can't find the container with id 77d7c8c8ef154364416b17647c0957aafd97893081e1ef894cd4676b6adc38eb
Sep 05 06:35:30.353965 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.353930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm" event={"ID":"23a50426-27a4-4de9-9388-2c9f44993758","Type":"ContainerStarted","Data":"5502cd6646bd16df3ab021631f4fbd41e9cc9e8959b9aae1d1906e00dc179800"}
Sep 05 06:35:30.354371 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.353992    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm" event={"ID":"23a50426-27a4-4de9-9388-2c9f44993758","Type":"ContainerStarted","Data":"77d7c8c8ef154364416b17647c0957aafd97893081e1ef894cd4676b6adc38eb"}
Sep 05 06:35:30.354371 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.354030    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"
Sep 05 06:35:30.355312 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.355291    2583 generic.go:356] "Generic (PLEG): container finished" podID="f9c0fd9d-3913-4419-9d47-53b9ebdc6170" containerID="10edf34460a3334c2df8ec7b7dc83d9a67b5a23e33967d90c01c58ec2bffcf28" exitCode=0
Sep 05 06:35:30.355412 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.355332    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4" event={"ID":"f9c0fd9d-3913-4419-9d47-53b9ebdc6170","Type":"ContainerDied","Data":"10edf34460a3334c2df8ec7b7dc83d9a67b5a23e33967d90c01c58ec2bffcf28"}
Sep 05 06:35:30.355412 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.355346    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"
Sep 05 06:35:30.355412 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.355362    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4" event={"ID":"f9c0fd9d-3913-4419-9d47-53b9ebdc6170","Type":"ContainerDied","Data":"ff365ca87e6ec6c4e0b792b52de368008533764fb809a56ad036fabec53ca121"}
Sep 05 06:35:30.355412 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.355383    2583 scope.go:117] "RemoveContainer" containerID="10edf34460a3334c2df8ec7b7dc83d9a67b5a23e33967d90c01c58ec2bffcf28"
Sep 05 06:35:30.363394 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.363372    2583 scope.go:117] "RemoveContainer" containerID="10edf34460a3334c2df8ec7b7dc83d9a67b5a23e33967d90c01c58ec2bffcf28"
Sep 05 06:35:30.363660 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:30.363642    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10edf34460a3334c2df8ec7b7dc83d9a67b5a23e33967d90c01c58ec2bffcf28\": container with ID starting with 10edf34460a3334c2df8ec7b7dc83d9a67b5a23e33967d90c01c58ec2bffcf28 not found: ID does not exist" containerID="10edf34460a3334c2df8ec7b7dc83d9a67b5a23e33967d90c01c58ec2bffcf28"
Sep 05 06:35:30.363708 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.363669    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10edf34460a3334c2df8ec7b7dc83d9a67b5a23e33967d90c01c58ec2bffcf28"} err="failed to get container status \"10edf34460a3334c2df8ec7b7dc83d9a67b5a23e33967d90c01c58ec2bffcf28\": rpc error: code = NotFound desc = could not find container \"10edf34460a3334c2df8ec7b7dc83d9a67b5a23e33967d90c01c58ec2bffcf28\": container with ID starting with 10edf34460a3334c2df8ec7b7dc83d9a67b5a23e33967d90c01c58ec2bffcf28 not found: ID does not exist"
Sep 05 06:35:30.383728 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.383678    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm" podStartSLOduration=1.383658886 podStartE2EDuration="1.383658886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:35:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:35:30.382034708 +0000 UTC m=+627.986583547" watchObservedRunningTime="2026-09-05 06:35:30.383658886 +0000 UTC m=+627.988207725"
Sep 05 06:35:30.400234 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.400205    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"]
Sep 05 06:35:30.407316 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.407289    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5v8w4"]
Sep 05 06:35:30.915210 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:30.915175    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9c0fd9d-3913-4419-9d47-53b9ebdc6170" path="/var/lib/kubelet/pods/f9c0fd9d-3913-4419-9d47-53b9ebdc6170/volumes"
Sep 05 06:35:35.741394 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:35.741354    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:35.838681 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:35.838651    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:35.942240 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:35.942212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:41.363986 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:41.363956    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"
Sep 05 06:35:41.417759 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:41.417725    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"]
Sep 05 06:35:41.418202 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:41.418167    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s" podUID="9fafdaca-2f52-47c2-b49f-e5bc7bd1d480" containerName="manager" containerID="cri-o://189f7db76a827b57f4155c1086642b9a9474fdbae2dddc470bae99f33f72b076" gracePeriod=10
Sep 05 06:35:41.654844 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:41.654821    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"
Sep 05 06:35:41.703943 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:41.703913    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctwh4\" (UniqueName: \"kubernetes.io/projected/9fafdaca-2f52-47c2-b49f-e5bc7bd1d480-kube-api-access-ctwh4\") pod \"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480\" (UID: \"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480\") "
Sep 05 06:35:41.704100 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:41.703964    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fafdaca-2f52-47c2-b49f-e5bc7bd1d480-extensions-socket-volume\") pod \"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480\" (UID: \"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480\") "
Sep 05 06:35:41.704395 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:41.704349    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fafdaca-2f52-47c2-b49f-e5bc7bd1d480-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9fafdaca-2f52-47c2-b49f-e5bc7bd1d480" (UID: "9fafdaca-2f52-47c2-b49f-e5bc7bd1d480"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:35:41.706029 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:41.706009    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fafdaca-2f52-47c2-b49f-e5bc7bd1d480-kube-api-access-ctwh4" (OuterVolumeSpecName: "kube-api-access-ctwh4") pod "9fafdaca-2f52-47c2-b49f-e5bc7bd1d480" (UID: "9fafdaca-2f52-47c2-b49f-e5bc7bd1d480"). InnerVolumeSpecName "kube-api-access-ctwh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:35:41.804813 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:41.804773    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fafdaca-2f52-47c2-b49f-e5bc7bd1d480-extensions-socket-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:35:41.804813 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:41.804806    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctwh4\" (UniqueName: \"kubernetes.io/projected/9fafdaca-2f52-47c2-b49f-e5bc7bd1d480-kube-api-access-ctwh4\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:35:42.415712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:42.415660    2583 generic.go:356] "Generic (PLEG): container finished" podID="9fafdaca-2f52-47c2-b49f-e5bc7bd1d480" containerID="189f7db76a827b57f4155c1086642b9a9474fdbae2dddc470bae99f33f72b076" exitCode=0
Sep 05 06:35:42.415712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:42.415706    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s" event={"ID":"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480","Type":"ContainerDied","Data":"189f7db76a827b57f4155c1086642b9a9474fdbae2dddc470bae99f33f72b076"}
Sep 05 06:35:42.416290 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:42.415764    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"
Sep 05 06:35:42.416290 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:42.415779    2583 scope.go:117] "RemoveContainer" containerID="189f7db76a827b57f4155c1086642b9a9474fdbae2dddc470bae99f33f72b076"
Sep 05 06:35:42.416290 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:42.415769    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s" event={"ID":"9fafdaca-2f52-47c2-b49f-e5bc7bd1d480","Type":"ContainerDied","Data":"3857c1971304f3e75d5642a8fd10578f94c338050f77b6e667125c5390300e6f"}
Sep 05 06:35:42.425008 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:42.424805    2583 scope.go:117] "RemoveContainer" containerID="189f7db76a827b57f4155c1086642b9a9474fdbae2dddc470bae99f33f72b076"
Sep 05 06:35:42.425125 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:35:42.425104    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"189f7db76a827b57f4155c1086642b9a9474fdbae2dddc470bae99f33f72b076\": container with ID starting with 189f7db76a827b57f4155c1086642b9a9474fdbae2dddc470bae99f33f72b076 not found: ID does not exist" containerID="189f7db76a827b57f4155c1086642b9a9474fdbae2dddc470bae99f33f72b076"
Sep 05 06:35:42.425178 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:42.425131    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"189f7db76a827b57f4155c1086642b9a9474fdbae2dddc470bae99f33f72b076"} err="failed to get container status \"189f7db76a827b57f4155c1086642b9a9474fdbae2dddc470bae99f33f72b076\": rpc error: code = NotFound desc = could not find container \"189f7db76a827b57f4155c1086642b9a9474fdbae2dddc470bae99f33f72b076\": container with ID starting with 189f7db76a827b57f4155c1086642b9a9474fdbae2dddc470bae99f33f72b076 not found: ID does not exist"
Sep 05 06:35:42.444615 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:42.444587    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"]
Sep 05 06:35:42.453248 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:42.453226    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kzw5s"]
Sep 05 06:35:42.915108 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:42.915077    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fafdaca-2f52-47c2-b49f-e5bc7bd1d480" path="/var/lib/kubelet/pods/9fafdaca-2f52-47c2-b49f-e5bc7bd1d480/volumes"
Sep 05 06:35:45.796808 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:45.796777    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:45.992621 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:45.992585    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:50.077746 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:50.077693    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:50.178964 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:50.178935    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:59.727542 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:59.727504    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:35:59.829396 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:35:59.829364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:01.478563 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.478530    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:01.578988 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.578956    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:01.678168 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.678134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:01.941763 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.941680    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:36:01.942098 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.942079    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9c0fd9d-3913-4419-9d47-53b9ebdc6170" containerName="manager"
Sep 05 06:36:01.942188 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.942100    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9c0fd9d-3913-4419-9d47-53b9ebdc6170" containerName="manager"
Sep 05 06:36:01.942188 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.942111    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fafdaca-2f52-47c2-b49f-e5bc7bd1d480" containerName="manager"
Sep 05 06:36:01.942188 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.942118    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fafdaca-2f52-47c2-b49f-e5bc7bd1d480" containerName="manager"
Sep 05 06:36:01.942331 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.942192    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9c0fd9d-3913-4419-9d47-53b9ebdc6170" containerName="manager"
Sep 05 06:36:01.942331 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.942207    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fafdaca-2f52-47c2-b49f-e5bc7bd1d480" containerName="manager"
Sep 05 06:36:01.945339 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.945314    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"
Sep 05 06:36:01.948038 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.948019    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 05 06:36:01.953428 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.953404    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:36:01.987616 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:01.987587    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:36:02.045265 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.045233    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf8w4\" (UniqueName: \"kubernetes.io/projected/0fa6df0d-162f-4555-b1ec-cee7372eb7d0-kube-api-access-bf8w4\") pod \"limitador-limitador-85d9db4d5d-22rqm\" (UID: \"0fa6df0d-162f-4555-b1ec-cee7372eb7d0\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"
Sep 05 06:36:02.045453 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.045305    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0fa6df0d-162f-4555-b1ec-cee7372eb7d0-config-file\") pod \"limitador-limitador-85d9db4d5d-22rqm\" (UID: \"0fa6df0d-162f-4555-b1ec-cee7372eb7d0\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"
Sep 05 06:36:02.146136 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.146107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0fa6df0d-162f-4555-b1ec-cee7372eb7d0-config-file\") pod \"limitador-limitador-85d9db4d5d-22rqm\" (UID: \"0fa6df0d-162f-4555-b1ec-cee7372eb7d0\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"
Sep 05 06:36:02.146321 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.146142    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf8w4\" (UniqueName: \"kubernetes.io/projected/0fa6df0d-162f-4555-b1ec-cee7372eb7d0-kube-api-access-bf8w4\") pod \"limitador-limitador-85d9db4d5d-22rqm\" (UID: \"0fa6df0d-162f-4555-b1ec-cee7372eb7d0\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"
Sep 05 06:36:02.146764 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.146737    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0fa6df0d-162f-4555-b1ec-cee7372eb7d0-config-file\") pod \"limitador-limitador-85d9db4d5d-22rqm\" (UID: \"0fa6df0d-162f-4555-b1ec-cee7372eb7d0\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"
Sep 05 06:36:02.155350 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.155326    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf8w4\" (UniqueName: \"kubernetes.io/projected/0fa6df0d-162f-4555-b1ec-cee7372eb7d0-kube-api-access-bf8w4\") pod \"limitador-limitador-85d9db4d5d-22rqm\" (UID: \"0fa6df0d-162f-4555-b1ec-cee7372eb7d0\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"
Sep 05 06:36:02.256209 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.256126    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"
Sep 05 06:36:02.311743 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.311645    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:02.406480 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.406446    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:02.529003 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.528975    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:36:02.531429 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:36:02.531404    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa6df0d_162f_4555_b1ec_cee7372eb7d0.slice/crio-2348a001ea0337b97bb8d12c6d70aa6d0a4c2aba3832711df151bd68c9a40473 WatchSource:0}: Error finding container 2348a001ea0337b97bb8d12c6d70aa6d0a4c2aba3832711df151bd68c9a40473: Status 404 returned error can't find the container with id 2348a001ea0337b97bb8d12c6d70aa6d0a4c2aba3832711df151bd68c9a40473
Sep 05 06:36:02.583450 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.583420    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-whnkp"]
Sep 05 06:36:02.587800 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.587781    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-whnkp"
Sep 05 06:36:02.590252 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.590235    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fgrcs\""
Sep 05 06:36:02.593845 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.593818    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-whnkp"]
Sep 05 06:36:02.650325 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.650288    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n87x\" (UniqueName: \"kubernetes.io/projected/40863562-b3d2-465f-8541-dbf911f69479-kube-api-access-4n87x\") pod \"authorino-c548b5d7d-whnkp\" (UID: \"40863562-b3d2-465f-8541-dbf911f69479\") " pod="kuadrant-system/authorino-c548b5d7d-whnkp"
Sep 05 06:36:02.750849 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.750810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n87x\" (UniqueName: \"kubernetes.io/projected/40863562-b3d2-465f-8541-dbf911f69479-kube-api-access-4n87x\") pod \"authorino-c548b5d7d-whnkp\" (UID: \"40863562-b3d2-465f-8541-dbf911f69479\") " pod="kuadrant-system/authorino-c548b5d7d-whnkp"
Sep 05 06:36:02.760266 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.760234    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n87x\" (UniqueName: \"kubernetes.io/projected/40863562-b3d2-465f-8541-dbf911f69479-kube-api-access-4n87x\") pod \"authorino-c548b5d7d-whnkp\" (UID: \"40863562-b3d2-465f-8541-dbf911f69479\") " pod="kuadrant-system/authorino-c548b5d7d-whnkp"
Sep 05 06:36:02.900204 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.900181    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fgrcs\""
Sep 05 06:36:02.907853 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:02.907834    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-whnkp"
Sep 05 06:36:03.183958 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:03.183933    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-whnkp"]
Sep 05 06:36:03.186054 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:36:03.186027    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40863562_b3d2_465f_8541_dbf911f69479.slice/crio-96b40f687507622a4a32f226a28d4c19ee34408a195a4a0fa5328a53861e73ec WatchSource:0}: Error finding container 96b40f687507622a4a32f226a28d4c19ee34408a195a4a0fa5328a53861e73ec: Status 404 returned error can't find the container with id 96b40f687507622a4a32f226a28d4c19ee34408a195a4a0fa5328a53861e73ec
Sep 05 06:36:03.517109 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:03.517068    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-22rqm" event={"ID":"0fa6df0d-162f-4555-b1ec-cee7372eb7d0","Type":"ContainerStarted","Data":"2348a001ea0337b97bb8d12c6d70aa6d0a4c2aba3832711df151bd68c9a40473"}
Sep 05 06:36:03.518315 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:03.518289    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-whnkp" event={"ID":"40863562-b3d2-465f-8541-dbf911f69479","Type":"ContainerStarted","Data":"96b40f687507622a4a32f226a28d4c19ee34408a195a4a0fa5328a53861e73ec"}
Sep 05 06:36:04.524987 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:04.524946    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-22rqm" event={"ID":"0fa6df0d-162f-4555-b1ec-cee7372eb7d0","Type":"ContainerStarted","Data":"483128e256859f3942aef593a6923fe92a3bd6add2dec4851c6259adb85bbdcd"}
Sep 05 06:36:04.525438 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:04.525084    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"
Sep 05 06:36:04.544088 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:04.544031    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-22rqm" podStartSLOduration=2.3187938900000002 podStartE2EDuration="3.544010049s" totalImagesPullingTime="1.225216159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:36:04.542175443 +0000 UTC m=+662.146724282" watchObservedRunningTime="2026-09-05 06:36:04.544010049 +0000 UTC m=+662.148558893"
Sep 05 06:36:05.531004 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:05.530969    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-whnkp" event={"ID":"40863562-b3d2-465f-8541-dbf911f69479","Type":"ContainerStarted","Data":"645ad4e421bbf98003b2870cbdc01bf16ac48f3b6ecd723a947b467c9ca73b4a"}
Sep 05 06:36:05.548670 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:05.548616    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-whnkp" podStartSLOduration=1.828600281 podStartE2EDuration="3.548600122s" totalImagesPullingTime="1.719999841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:36:05.54812189 +0000 UTC m=+663.152670729" watchObservedRunningTime="2026-09-05 06:36:05.548600122 +0000 UTC m=+663.153148959"
Sep 05 06:36:15.532246 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:15.532212    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"
Sep 05 06:36:19.705710 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:19.705675    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:19.806534 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:19.806500    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:20.217646 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:20.217613    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:32.569196 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:32.569166    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:33.089387 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:33.089336    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b64c88565-d4t5c"]
Sep 05 06:36:33.092550 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:33.092528    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b64c88565-d4t5c"
Sep 05 06:36:33.102047 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:33.102022    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b64c88565-d4t5c"]
Sep 05 06:36:33.169582 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:33.169550    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:33.187779 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:33.187731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrgsm\" (UniqueName: \"kubernetes.io/projected/ac708068-6747-46de-8ad7-04c9e659b260-kube-api-access-qrgsm\") pod \"authorino-5b64c88565-d4t5c\" (UID: \"ac708068-6747-46de-8ad7-04c9e659b260\") " pod="kuadrant-system/authorino-5b64c88565-d4t5c"
Sep 05 06:36:33.207571 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:33.207542    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b64c88565-d4t5c"]
Sep 05 06:36:33.207777 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:36:33.207758    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qrgsm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5b64c88565-d4t5c" podUID="ac708068-6747-46de-8ad7-04c9e659b260"
Sep 05 06:36:33.288555 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:33.288518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrgsm\" (UniqueName: \"kubernetes.io/projected/ac708068-6747-46de-8ad7-04c9e659b260-kube-api-access-qrgsm\") pod \"authorino-5b64c88565-d4t5c\" (UID: \"ac708068-6747-46de-8ad7-04c9e659b260\") " pod="kuadrant-system/authorino-5b64c88565-d4t5c"
Sep 05 06:36:33.300270 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:33.300246    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrgsm\" (UniqueName: \"kubernetes.io/projected/ac708068-6747-46de-8ad7-04c9e659b260-kube-api-access-qrgsm\") pod \"authorino-5b64c88565-d4t5c\" (UID: \"ac708068-6747-46de-8ad7-04c9e659b260\") " pod="kuadrant-system/authorino-5b64c88565-d4t5c"
Sep 05 06:36:33.651543 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:33.651509    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b64c88565-d4t5c"
Sep 05 06:36:33.658518 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:33.658494    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b64c88565-d4t5c"
Sep 05 06:36:33.792635 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:33.792603    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrgsm\" (UniqueName: \"kubernetes.io/projected/ac708068-6747-46de-8ad7-04c9e659b260-kube-api-access-qrgsm\") pod \"ac708068-6747-46de-8ad7-04c9e659b260\" (UID: \"ac708068-6747-46de-8ad7-04c9e659b260\") "
Sep 05 06:36:33.794737 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:33.794712    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac708068-6747-46de-8ad7-04c9e659b260-kube-api-access-qrgsm" (OuterVolumeSpecName: "kube-api-access-qrgsm") pod "ac708068-6747-46de-8ad7-04c9e659b260" (UID: "ac708068-6747-46de-8ad7-04c9e659b260"). InnerVolumeSpecName "kube-api-access-qrgsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:36:33.893480 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:33.893446    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrgsm\" (UniqueName: \"kubernetes.io/projected/ac708068-6747-46de-8ad7-04c9e659b260-kube-api-access-qrgsm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:36:34.661745 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:34.657315    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b64c88565-d4t5c"
Sep 05 06:36:34.695974 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:34.695942    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b64c88565-d4t5c"]
Sep 05 06:36:34.699351 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:34.699325    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b64c88565-d4t5c"]
Sep 05 06:36:34.914163 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:34.914083    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac708068-6747-46de-8ad7-04c9e659b260" path="/var/lib/kubelet/pods/ac708068-6747-46de-8ad7-04c9e659b260/volumes"
Sep 05 06:36:45.478767 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:45.478728    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-whnkp"]
Sep 05 06:36:45.479173 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:45.478927    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-whnkp" podUID="40863562-b3d2-465f-8541-dbf911f69479" containerName="authorino" containerID="cri-o://645ad4e421bbf98003b2870cbdc01bf16ac48f3b6ecd723a947b467c9ca73b4a" gracePeriod=30
Sep 05 06:36:45.714232 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:45.714200    2583 generic.go:356] "Generic (PLEG): container finished" podID="40863562-b3d2-465f-8541-dbf911f69479" containerID="645ad4e421bbf98003b2870cbdc01bf16ac48f3b6ecd723a947b467c9ca73b4a" exitCode=0
Sep 05 06:36:45.714375 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:45.714268    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-whnkp" event={"ID":"40863562-b3d2-465f-8541-dbf911f69479","Type":"ContainerDied","Data":"645ad4e421bbf98003b2870cbdc01bf16ac48f3b6ecd723a947b467c9ca73b4a"}
Sep 05 06:36:45.725203 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:45.725184    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-whnkp"
Sep 05 06:36:45.791040 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:45.790973    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n87x\" (UniqueName: \"kubernetes.io/projected/40863562-b3d2-465f-8541-dbf911f69479-kube-api-access-4n87x\") pod \"40863562-b3d2-465f-8541-dbf911f69479\" (UID: \"40863562-b3d2-465f-8541-dbf911f69479\") "
Sep 05 06:36:45.792972 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:45.792945    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40863562-b3d2-465f-8541-dbf911f69479-kube-api-access-4n87x" (OuterVolumeSpecName: "kube-api-access-4n87x") pod "40863562-b3d2-465f-8541-dbf911f69479" (UID: "40863562-b3d2-465f-8541-dbf911f69479"). InnerVolumeSpecName "kube-api-access-4n87x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:36:45.891784 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:45.891750    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n87x\" (UniqueName: \"kubernetes.io/projected/40863562-b3d2-465f-8541-dbf911f69479-kube-api-access-4n87x\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:36:46.720230 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:46.720200    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-whnkp"
Sep 05 06:36:46.720230 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:46.720224    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-whnkp" event={"ID":"40863562-b3d2-465f-8541-dbf911f69479","Type":"ContainerDied","Data":"96b40f687507622a4a32f226a28d4c19ee34408a195a4a0fa5328a53861e73ec"}
Sep 05 06:36:46.720790 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:46.720270    2583 scope.go:117] "RemoveContainer" containerID="645ad4e421bbf98003b2870cbdc01bf16ac48f3b6ecd723a947b467c9ca73b4a"
Sep 05 06:36:46.741362 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:46.741335    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-whnkp"]
Sep 05 06:36:46.747270 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:46.747251    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-whnkp"]
Sep 05 06:36:46.914182 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:46.914153    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40863562-b3d2-465f-8541-dbf911f69479" path="/var/lib/kubelet/pods/40863562-b3d2-465f-8541-dbf911f69479/volumes"
Sep 05 06:36:50.476422 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:50.476390    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:50.566622 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:50.566588    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:50.629090 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:50.629056    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:51.071271 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:51.071238    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:51.172410 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:51.172375    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:54.603024 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:54.602989    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:54.702066 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:54.702031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:54.809108 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:54.809074    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:36:54.877742 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:36:54.877676    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:07.220500 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:07.220460    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:07.286557 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:07.286531    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:24.809204 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:24.809143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:26.211727 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:26.211693    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:26.312226 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:26.312189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:26.413099 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:26.413067    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:26.646051 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:26.645962    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:26.749788 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:26.749751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:26.964509 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:26.964476    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:27.061995 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.061957    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:27.095814 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.095775    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-kxf79"]
Sep 05 06:37:27.096188 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.096169    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40863562-b3d2-465f-8541-dbf911f69479" containerName="authorino"
Sep 05 06:37:27.096273 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.096190    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="40863562-b3d2-465f-8541-dbf911f69479" containerName="authorino"
Sep 05 06:37:27.096273 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.096269    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="40863562-b3d2-465f-8541-dbf911f69479" containerName="authorino"
Sep 05 06:37:27.100227 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.100205    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-kxf79"
Sep 05 06:37:27.103699 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.103673    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-s7sh6\""
Sep 05 06:37:27.103803 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.103731    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 05 06:37:27.116319 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.116160    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-kxf79"]
Sep 05 06:37:27.149183 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.149156    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb"]
Sep 05 06:37:27.152503 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.152483    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb"
Sep 05 06:37:27.169010 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.168978    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb"]
Sep 05 06:37:27.203712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.203686    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9s9q\" (UniqueName: \"kubernetes.io/projected/05b4a34f-8094-44b3-944b-a8a95fbf7dbf-kube-api-access-w9s9q\") pod \"payload-processing-5b54b7fbb7-kxf79\" (UID: \"05b4a34f-8094-44b3-944b-a8a95fbf7dbf\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-kxf79"
Sep 05 06:37:27.203842 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.203719    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64c55\" (UniqueName: \"kubernetes.io/projected/5cc87164-e87f-4989-9f35-ccd5474b0017-kube-api-access-64c55\") pod \"payload-pre-processing-59fbc47bf8-qghsb\" (UID: \"5cc87164-e87f-4989-9f35-ccd5474b0017\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb"
Sep 05 06:37:27.203842 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.203752    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cc87164-e87f-4989-9f35-ccd5474b0017-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-qghsb\" (UID: \"5cc87164-e87f-4989-9f35-ccd5474b0017\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb"
Sep 05 06:37:27.203968 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.203844    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05b4a34f-8094-44b3-944b-a8a95fbf7dbf-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-kxf79\" (UID: \"05b4a34f-8094-44b3-944b-a8a95fbf7dbf\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-kxf79"
Sep 05 06:37:27.304523 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.304434    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9s9q\" (UniqueName: \"kubernetes.io/projected/05b4a34f-8094-44b3-944b-a8a95fbf7dbf-kube-api-access-w9s9q\") pod \"payload-processing-5b54b7fbb7-kxf79\" (UID: \"05b4a34f-8094-44b3-944b-a8a95fbf7dbf\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-kxf79"
Sep 05 06:37:27.304523 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.304479    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64c55\" (UniqueName: \"kubernetes.io/projected/5cc87164-e87f-4989-9f35-ccd5474b0017-kube-api-access-64c55\") pod \"payload-pre-processing-59fbc47bf8-qghsb\" (UID: \"5cc87164-e87f-4989-9f35-ccd5474b0017\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb"
Sep 05 06:37:27.304523 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.304518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cc87164-e87f-4989-9f35-ccd5474b0017-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-qghsb\" (UID: \"5cc87164-e87f-4989-9f35-ccd5474b0017\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb"
Sep 05 06:37:27.305023 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.304572    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05b4a34f-8094-44b3-944b-a8a95fbf7dbf-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-kxf79\" (UID: \"05b4a34f-8094-44b3-944b-a8a95fbf7dbf\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-kxf79"
Sep 05 06:37:27.305258 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.305239    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cc87164-e87f-4989-9f35-ccd5474b0017-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-qghsb\" (UID: \"5cc87164-e87f-4989-9f35-ccd5474b0017\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb"
Sep 05 06:37:27.305296 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.305275    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05b4a34f-8094-44b3-944b-a8a95fbf7dbf-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-kxf79\" (UID: \"05b4a34f-8094-44b3-944b-a8a95fbf7dbf\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-kxf79"
Sep 05 06:37:27.315748 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.315727    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9s9q\" (UniqueName: \"kubernetes.io/projected/05b4a34f-8094-44b3-944b-a8a95fbf7dbf-kube-api-access-w9s9q\") pod \"payload-processing-5b54b7fbb7-kxf79\" (UID: \"05b4a34f-8094-44b3-944b-a8a95fbf7dbf\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-kxf79"
Sep 05 06:37:27.315886 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.315822    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64c55\" (UniqueName: \"kubernetes.io/projected/5cc87164-e87f-4989-9f35-ccd5474b0017-kube-api-access-64c55\") pod \"payload-pre-processing-59fbc47bf8-qghsb\" (UID: \"5cc87164-e87f-4989-9f35-ccd5474b0017\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb"
Sep 05 06:37:27.409963 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.409928    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-kxf79"
Sep 05 06:37:27.462213 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.462180    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb"
Sep 05 06:37:27.680172 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.680146    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-kxf79"]
Sep 05 06:37:27.682002 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:37:27.681974    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b4a34f_8094_44b3_944b_a8a95fbf7dbf.slice/crio-00b3ffc831ae2b79126178e34bfe7a2f2573eab06caa97759ec2d483b9cbb58e WatchSource:0}: Error finding container 00b3ffc831ae2b79126178e34bfe7a2f2573eab06caa97759ec2d483b9cbb58e: Status 404 returned error can't find the container with id 00b3ffc831ae2b79126178e34bfe7a2f2573eab06caa97759ec2d483b9cbb58e
Sep 05 06:37:27.683918 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.683899    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 05 06:37:27.739735 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.739707    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb"]
Sep 05 06:37:27.741477 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:37:27.741455    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cc87164_e87f_4989_9f35_ccd5474b0017.slice/crio-0e04e3c7b70eb310db7cd17dc4023cd468d69e80ad11a8f5273b3113c03c6b04 WatchSource:0}: Error finding container 0e04e3c7b70eb310db7cd17dc4023cd468d69e80ad11a8f5273b3113c03c6b04: Status 404 returned error can't find the container with id 0e04e3c7b70eb310db7cd17dc4023cd468d69e80ad11a8f5273b3113c03c6b04
Sep 05 06:37:27.838237 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.838201    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:37:27.895566 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.895522    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-kxf79" event={"ID":"05b4a34f-8094-44b3-944b-a8a95fbf7dbf","Type":"ContainerStarted","Data":"00b3ffc831ae2b79126178e34bfe7a2f2573eab06caa97759ec2d483b9cbb58e"}
Sep 05 06:37:27.896747 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:27.896722    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb" event={"ID":"5cc87164-e87f-4989-9f35-ccd5474b0017","Type":"ContainerStarted","Data":"0e04e3c7b70eb310db7cd17dc4023cd468d69e80ad11a8f5273b3113c03c6b04"}
Sep 05 06:37:29.912547 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:29.912449    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb" event={"ID":"5cc87164-e87f-4989-9f35-ccd5474b0017","Type":"ContainerStarted","Data":"ac9fdbc0d55c6a443d3ae462c58093abd0d9feb4fdccf5979e06d508f339c7e1"}
Sep 05 06:37:29.913075 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:29.913056    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb"
Sep 05 06:37:29.914029 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:29.914005    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-kxf79" event={"ID":"05b4a34f-8094-44b3-944b-a8a95fbf7dbf","Type":"ContainerStarted","Data":"d488768b6766d1745532614d79bcf55ef3e2aec1421f6bc0d8c952805be4b303"}
Sep 05 06:37:29.914144 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:29.914128    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-kxf79"
Sep 05 06:37:29.932321 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:29.932269    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb" podStartSLOduration=1.181797104 podStartE2EDuration="2.932251793s" totalImagesPullingTime="1.750454689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:37:29.930230926 +0000 UTC m=+747.534779765" watchObservedRunningTime="2026-09-05 06:37:29.932251793 +0000 UTC m=+747.536800629"
Sep 05 06:37:29.947025 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:29.946985    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-kxf79" podStartSLOduration=1.144176439 podStartE2EDuration="2.946971191s" totalImagesPullingTime="1.802794752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:37:29.94656647 +0000 UTC m=+747.551115309" watchObservedRunningTime="2026-09-05 06:37:29.946971191 +0000 UTC m=+747.551520028"
Sep 05 06:37:36.616593 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:36.616553    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:36.718374 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:36.718338    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:40.922813 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:40.922728    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-kxf79"
Sep 05 06:37:40.923238 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:40.922901    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb"
Sep 05 06:37:48.768636 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:48.768604    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:37:49.251879 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:37:49.251827    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:38:01.687060 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:01.687023    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:38:02.559584 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:02.559548    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:38:07.262193 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.262160    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"]
Sep 05 06:38:07.266952 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.266930    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.269899 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.269875    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 05 06:38:07.269899 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.269890    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 05 06:38:07.270937 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.270921    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 05 06:38:07.271034 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.271016    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wkllk\""
Sep 05 06:38:07.276823 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.276802    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"]
Sep 05 06:38:07.293756 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.293736    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:38:07.426712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.426679    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp54c\" (UniqueName: \"kubernetes.io/projected/3812579a-474d-4139-a775-f4cb57121308-kube-api-access-gp54c\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.426906 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.426732    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3812579a-474d-4139-a775-f4cb57121308-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.426906 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.426753    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3812579a-474d-4139-a775-f4cb57121308-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.426906 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.426770    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3812579a-474d-4139-a775-f4cb57121308-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.427020 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.426788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3812579a-474d-4139-a775-f4cb57121308-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.430048 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.427232    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3812579a-474d-4139-a775-f4cb57121308-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.531230 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.531134    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3812579a-474d-4139-a775-f4cb57121308-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.531230 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.531187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3812579a-474d-4139-a775-f4cb57121308-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.531230 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.531208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3812579a-474d-4139-a775-f4cb57121308-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.531230 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.531224    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3812579a-474d-4139-a775-f4cb57121308-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.531230 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.531241    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3812579a-474d-4139-a775-f4cb57121308-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.531616 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.531297    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp54c\" (UniqueName: \"kubernetes.io/projected/3812579a-474d-4139-a775-f4cb57121308-kube-api-access-gp54c\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.531674 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.531647    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3812579a-474d-4139-a775-f4cb57121308-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.531715 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.531680    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3812579a-474d-4139-a775-f4cb57121308-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.531715 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.531707    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3812579a-474d-4139-a775-f4cb57121308-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.533324 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.533303    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3812579a-474d-4139-a775-f4cb57121308-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.533690 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.533669    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3812579a-474d-4139-a775-f4cb57121308-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.540974 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.540952    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp54c\" (UniqueName: \"kubernetes.io/projected/3812579a-474d-4139-a775-f4cb57121308-kube-api-access-gp54c\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh\" (UID: \"3812579a-474d-4139-a775-f4cb57121308\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.577777 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.577752    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:07.854206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:07.854119    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"]
Sep 05 06:38:07.856494 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:38:07.856468    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3812579a_474d_4139_a775_f4cb57121308.slice/crio-bc6025d84ab2fbd4548497da6f46bc660c7f858ba96fdf404a279971d5ba287f WatchSource:0}: Error finding container bc6025d84ab2fbd4548497da6f46bc660c7f858ba96fdf404a279971d5ba287f: Status 404 returned error can't find the container with id bc6025d84ab2fbd4548497da6f46bc660c7f858ba96fdf404a279971d5ba287f
Sep 05 06:38:08.086213 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:08.086177    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh" event={"ID":"3812579a-474d-4139-a775-f4cb57121308","Type":"ContainerStarted","Data":"bc6025d84ab2fbd4548497da6f46bc660c7f858ba96fdf404a279971d5ba287f"}
Sep 05 06:38:08.359473 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:08.359438    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:38:09.092350 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:09.092250    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh" event={"ID":"3812579a-474d-4139-a775-f4cb57121308","Type":"ContainerStarted","Data":"af722e23020af8a03f1f1385243719a9533daf28d75d3f1a859850c6ed42a137"}
Sep 05 06:38:09.113439 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:09.113385    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh" podStartSLOduration=1.149539965 podStartE2EDuration="2.113371304s" totalImagesPullingTime="963.831339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:38:09.11248777 +0000 UTC m=+786.717036609" watchObservedRunningTime="2026-09-05 06:38:09.113371304 +0000 UTC m=+786.717920142"
Sep 05 06:38:11.892789 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:11.892756    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:38:13.152945 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:13.152905    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:38:17.578713 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:17.578676    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:17.579224 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:17.578746    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:17.591191 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:17.591167    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:18.145384 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:18.145357    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh"
Sep 05 06:38:21.683107 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:21.683077    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:38:23.156040 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:23.156006    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:38:28.449198 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.449113    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"]
Sep 05 06:38:28.453030 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.453001    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.456122 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.456101    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 05 06:38:28.464616 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.464595    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"]
Sep 05 06:38:28.487155 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.487122    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:38:28.490220 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.490199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd66b90-5009-4017-80c6-8a844bfd5d35-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.490283 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.490239    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cd66b90-5009-4017-80c6-8a844bfd5d35-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.490283 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.490256    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cd66b90-5009-4017-80c6-8a844bfd5d35-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.490349 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.490332    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cd66b90-5009-4017-80c6-8a844bfd5d35-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.490387 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.490371    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cd66b90-5009-4017-80c6-8a844bfd5d35-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.490443 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.490425    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgt2n\" (UniqueName: \"kubernetes.io/projected/3cd66b90-5009-4017-80c6-8a844bfd5d35-kube-api-access-fgt2n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.591776 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.591739    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cd66b90-5009-4017-80c6-8a844bfd5d35-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.591965 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.591804    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cd66b90-5009-4017-80c6-8a844bfd5d35-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.591965 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.591852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgt2n\" (UniqueName: \"kubernetes.io/projected/3cd66b90-5009-4017-80c6-8a844bfd5d35-kube-api-access-fgt2n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.591965 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.591913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd66b90-5009-4017-80c6-8a844bfd5d35-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.591965 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.591957    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cd66b90-5009-4017-80c6-8a844bfd5d35-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.592178 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.591988    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cd66b90-5009-4017-80c6-8a844bfd5d35-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.592236 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.592205    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cd66b90-5009-4017-80c6-8a844bfd5d35-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.592296 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.592238    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cd66b90-5009-4017-80c6-8a844bfd5d35-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.592346 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.592325    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd66b90-5009-4017-80c6-8a844bfd5d35-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.594285 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.594258    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cd66b90-5009-4017-80c6-8a844bfd5d35-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.594536 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.594511    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cd66b90-5009-4017-80c6-8a844bfd5d35-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.601855 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.601834    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgt2n\" (UniqueName: \"kubernetes.io/projected/3cd66b90-5009-4017-80c6-8a844bfd5d35-kube-api-access-fgt2n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lztvr\" (UID: \"3cd66b90-5009-4017-80c6-8a844bfd5d35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:28.763899 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:28.763798    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:29.039592 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:29.039469    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"]
Sep 05 06:38:29.042086 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:38:29.042059    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd66b90_5009_4017_80c6_8a844bfd5d35.slice/crio-8735b79c9ccf13d24b284d9f0b674afc94462c7d8a450b152977196afb2a403b WatchSource:0}: Error finding container 8735b79c9ccf13d24b284d9f0b674afc94462c7d8a450b152977196afb2a403b: Status 404 returned error can't find the container with id 8735b79c9ccf13d24b284d9f0b674afc94462c7d8a450b152977196afb2a403b
Sep 05 06:38:29.052029 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:29.052008    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:38:29.156752 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:29.156717    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:38:29.184091 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:29.184061    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr" event={"ID":"3cd66b90-5009-4017-80c6-8a844bfd5d35","Type":"ContainerStarted","Data":"8735b79c9ccf13d24b284d9f0b674afc94462c7d8a450b152977196afb2a403b"}
Sep 05 06:38:30.023504 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:30.023471    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:38:30.190151 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:30.190113    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr" event={"ID":"3cd66b90-5009-4017-80c6-8a844bfd5d35","Type":"ContainerStarted","Data":"4d9ba5532f2281c08d30b57d404cfe96a45a106a8e8833ba05aff2ff935a0d9c"}
Sep 05 06:38:30.210748 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:30.210703    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr" podStartSLOduration=2.03506376 podStartE2EDuration="2.210687495s" totalImagesPullingTime="175.623735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:38:30.210323069 +0000 UTC m=+807.814871908" watchObservedRunningTime="2026-09-05 06:38:30.210687495 +0000 UTC m=+807.815236333"
Sep 05 06:38:30.367756 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:30.367682    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:38:38.479123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.479089    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"]
Sep 05 06:38:38.482550 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.482529    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.485582 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.485563    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 05 06:38:38.497651 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.497629    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"]
Sep 05 06:38:38.522945 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.522917    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:38:38.578232 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.578207    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/904385aa-554a-45bc-89af-48aa50c8e6b7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.578365 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.578241    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/904385aa-554a-45bc-89af-48aa50c8e6b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.578365 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.578274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/904385aa-554a-45bc-89af-48aa50c8e6b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.578444 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.578370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tvgz\" (UniqueName: \"kubernetes.io/projected/904385aa-554a-45bc-89af-48aa50c8e6b7-kube-api-access-5tvgz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.578444 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.578413    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/904385aa-554a-45bc-89af-48aa50c8e6b7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.578513 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.578458    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/904385aa-554a-45bc-89af-48aa50c8e6b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.678845 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.678809    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/904385aa-554a-45bc-89af-48aa50c8e6b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.679037 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.678888    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/904385aa-554a-45bc-89af-48aa50c8e6b7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.679037 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.679011    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/904385aa-554a-45bc-89af-48aa50c8e6b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.679117 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.679072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/904385aa-554a-45bc-89af-48aa50c8e6b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.679178 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.679118    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tvgz\" (UniqueName: \"kubernetes.io/projected/904385aa-554a-45bc-89af-48aa50c8e6b7-kube-api-access-5tvgz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.679178 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.679151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/904385aa-554a-45bc-89af-48aa50c8e6b7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.679367 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.679332    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/904385aa-554a-45bc-89af-48aa50c8e6b7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.679497 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.679441    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/904385aa-554a-45bc-89af-48aa50c8e6b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.679497 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.679456    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/904385aa-554a-45bc-89af-48aa50c8e6b7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.681264 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.681244    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/904385aa-554a-45bc-89af-48aa50c8e6b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.681435 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.681420    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/904385aa-554a-45bc-89af-48aa50c8e6b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.688343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.688323    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tvgz\" (UniqueName: \"kubernetes.io/projected/904385aa-554a-45bc-89af-48aa50c8e6b7-kube-api-access-5tvgz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thbxv\" (UID: \"904385aa-554a-45bc-89af-48aa50c8e6b7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:38.764396 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.764319    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:38.764396 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.764381    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:38.777140 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.777121    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:38.792756 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:38.792724    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:39.069159 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:39.069135    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"]
Sep 05 06:38:39.071295 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:38:39.071271    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod904385aa_554a_45bc_89af_48aa50c8e6b7.slice/crio-31fb53111713d35faeaa877e1e6ff496dd567ae4441cbadf2324d71c90e4bdd7 WatchSource:0}: Error finding container 31fb53111713d35faeaa877e1e6ff496dd567ae4441cbadf2324d71c90e4bdd7: Status 404 returned error can't find the container with id 31fb53111713d35faeaa877e1e6ff496dd567ae4441cbadf2324d71c90e4bdd7
Sep 05 06:38:39.234356 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:39.234317    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv" event={"ID":"904385aa-554a-45bc-89af-48aa50c8e6b7","Type":"ContainerStarted","Data":"31fb53111713d35faeaa877e1e6ff496dd567ae4441cbadf2324d71c90e4bdd7"}
Sep 05 06:38:39.246983 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:39.246954    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lztvr"
Sep 05 06:38:39.959076 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:39.959040    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:38:40.241493 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:40.241410    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv" event={"ID":"904385aa-554a-45bc-89af-48aa50c8e6b7","Type":"ContainerStarted","Data":"4447076b54164e9efd9a0b17dccc69dd4cda8e2bdb8a1b430de702fde8d3c18f"}
Sep 05 06:38:40.279814 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:40.279767    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv" podStartSLOduration=2.106977021 podStartE2EDuration="2.279752382s" totalImagesPullingTime="172.775361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:38:40.279058524 +0000 UTC m=+817.883607363" watchObservedRunningTime="2026-09-05 06:38:40.279752382 +0000 UTC m=+817.884301220"
Sep 05 06:38:46.660882 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:46.660840    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:38:48.793595 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:48.793566    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:48.794010 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:48.793612    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:48.806110 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:48.806085    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:38:49.291948 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:38:49.291920    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thbxv"
Sep 05 06:39:56.972318 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:39:56.972231    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:39:57.062563 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:39:57.062532    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:39:58.144681 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:39:58.144651    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:39:58.241845 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:39:58.241816    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:14.731327 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:14.731293    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:14.834175 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:14.834140    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:15.150502 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:15.150424    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:15.260933 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:15.260895    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:16.255849 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:16.255812    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:16.349790 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:16.349759    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:16.762370 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:16.762334    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:18.363283 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:18.363244    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:40:18.569346 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:18.569316    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:18.680601 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:18.680515    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:19.739101 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:19.739056    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:19.838588 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:19.838555    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:20.156498 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.156415    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:20.346798 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.346760    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:20.449009 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.448982    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:20.473786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.473757    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"]
Sep 05 06:40:20.477179 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.477159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"
Sep 05 06:40:20.480032 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.480006    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-6efc3a-dockercfg-5rzgb\""
Sep 05 06:40:20.480135 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.480043    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-6efc3a\""
Sep 05 06:40:20.489332 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.489307    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"]
Sep 05 06:40:20.514770 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.514740    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzczw\" (UniqueName: \"kubernetes.io/projected/140dd883-f7f6-4cec-9d47-8d0448b7aaa3-kube-api-access-nzczw\") pod \"payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt\" (UID: \"140dd883-f7f6-4cec-9d47-8d0448b7aaa3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"
Sep 05 06:40:20.514936 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.514794    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/140dd883-f7f6-4cec-9d47-8d0448b7aaa3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt\" (UID: \"140dd883-f7f6-4cec-9d47-8d0448b7aaa3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"
Sep 05 06:40:20.530689 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.530661    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"]
Sep 05 06:40:20.533857 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.533842    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"
Sep 05 06:40:20.544234 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.544210    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"]
Sep 05 06:40:20.615480 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.615449    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2xwj\" (UniqueName: \"kubernetes.io/projected/c69c9092-d8e3-49a0-8416-a0a2368668e1-kube-api-access-z2xwj\") pod \"payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6\" (UID: \"c69c9092-d8e3-49a0-8416-a0a2368668e1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"
Sep 05 06:40:20.615648 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.615508    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzczw\" (UniqueName: \"kubernetes.io/projected/140dd883-f7f6-4cec-9d47-8d0448b7aaa3-kube-api-access-nzczw\") pod \"payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt\" (UID: \"140dd883-f7f6-4cec-9d47-8d0448b7aaa3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"
Sep 05 06:40:20.615648 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.615594    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/140dd883-f7f6-4cec-9d47-8d0448b7aaa3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt\" (UID: \"140dd883-f7f6-4cec-9d47-8d0448b7aaa3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"
Sep 05 06:40:20.615735 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.615647    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c69c9092-d8e3-49a0-8416-a0a2368668e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6\" (UID: \"c69c9092-d8e3-49a0-8416-a0a2368668e1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"
Sep 05 06:40:20.616220 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.616203    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/140dd883-f7f6-4cec-9d47-8d0448b7aaa3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt\" (UID: \"140dd883-f7f6-4cec-9d47-8d0448b7aaa3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"
Sep 05 06:40:20.626418 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.626394    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzczw\" (UniqueName: \"kubernetes.io/projected/140dd883-f7f6-4cec-9d47-8d0448b7aaa3-kube-api-access-nzczw\") pod \"payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt\" (UID: \"140dd883-f7f6-4cec-9d47-8d0448b7aaa3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"
Sep 05 06:40:20.716786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.716702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c69c9092-d8e3-49a0-8416-a0a2368668e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6\" (UID: \"c69c9092-d8e3-49a0-8416-a0a2368668e1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"
Sep 05 06:40:20.716786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.716743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2xwj\" (UniqueName: \"kubernetes.io/projected/c69c9092-d8e3-49a0-8416-a0a2368668e1-kube-api-access-z2xwj\") pod \"payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6\" (UID: \"c69c9092-d8e3-49a0-8416-a0a2368668e1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"
Sep 05 06:40:20.717412 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.717391    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c69c9092-d8e3-49a0-8416-a0a2368668e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6\" (UID: \"c69c9092-d8e3-49a0-8416-a0a2368668e1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"
Sep 05 06:40:20.730038 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.730007    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2xwj\" (UniqueName: \"kubernetes.io/projected/c69c9092-d8e3-49a0-8416-a0a2368668e1-kube-api-access-z2xwj\") pod \"payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6\" (UID: \"c69c9092-d8e3-49a0-8416-a0a2368668e1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"
Sep 05 06:40:20.791188 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.791140    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"
Sep 05 06:40:20.844356 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:20.844324    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"
Sep 05 06:40:21.066609 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:21.066531    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"]
Sep 05 06:40:21.069955 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:40:21.069923    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140dd883_f7f6_4cec_9d47_8d0448b7aaa3.slice/crio-23796127d50948ddc07d42c202a44def84a1c1bda10add2a238bd6476bc60759 WatchSource:0}: Error finding container 23796127d50948ddc07d42c202a44def84a1c1bda10add2a238bd6476bc60759: Status 404 returned error can't find the container with id 23796127d50948ddc07d42c202a44def84a1c1bda10add2a238bd6476bc60759
Sep 05 06:40:21.127320 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:21.127291    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"]
Sep 05 06:40:21.128264 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:40:21.128240    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69c9092_d8e3_49a0_8416_a0a2368668e1.slice/crio-20138ecb64214fefcb9ed16d920680a7c5ec51892af11a885bdb4a2f613883a8 WatchSource:0}: Error finding container 20138ecb64214fefcb9ed16d920680a7c5ec51892af11a885bdb4a2f613883a8: Status 404 returned error can't find the container with id 20138ecb64214fefcb9ed16d920680a7c5ec51892af11a885bdb4a2f613883a8
Sep 05 06:40:21.705229 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:21.705193    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6" event={"ID":"c69c9092-d8e3-49a0-8416-a0a2368668e1","Type":"ContainerStarted","Data":"b3859916213edc017d7fdbf3eb6b515df83f51eeb98be4ff883b320dc9978c24"}
Sep 05 06:40:21.705429 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:21.705270    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6" event={"ID":"c69c9092-d8e3-49a0-8416-a0a2368668e1","Type":"ContainerStarted","Data":"20138ecb64214fefcb9ed16d920680a7c5ec51892af11a885bdb4a2f613883a8"}
Sep 05 06:40:21.705429 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:21.705302    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"
Sep 05 06:40:21.707103 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:21.707078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt" event={"ID":"140dd883-f7f6-4cec-9d47-8d0448b7aaa3","Type":"ContainerStarted","Data":"bab7d038af17243efdd14b7d3478a030ab02f3107a1fe6c6b0db3cc83d639ce0"}
Sep 05 06:40:21.707234 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:21.707123    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt" event={"ID":"140dd883-f7f6-4cec-9d47-8d0448b7aaa3","Type":"ContainerStarted","Data":"23796127d50948ddc07d42c202a44def84a1c1bda10add2a238bd6476bc60759"}
Sep 05 06:40:21.707234 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:21.707211    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"
Sep 05 06:40:21.745756 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:21.745710    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6" podStartSLOduration=1.745696137 podStartE2EDuration="1.745696137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:40:21.725134735 +0000 UTC m=+919.329683575" watchObservedRunningTime="2026-09-05 06:40:21.745696137 +0000 UTC m=+919.350244976"
Sep 05 06:40:21.745956 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:21.745936    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt" podStartSLOduration=1.7459292720000001 podStartE2EDuration="1.745929272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:40:21.744781232 +0000 UTC m=+919.349330071" watchObservedRunningTime="2026-09-05 06:40:21.745929272 +0000 UTC m=+919.350478133"
Sep 05 06:40:23.222146 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:23.222109    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:23.301939 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:23.301908    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:23.467802 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:23.467772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:23.844166 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:23.844129    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:24.026042 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:24.026007    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:24.320158 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:24.320123    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:24.641647 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:24.641559    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:25.044441 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:25.044409    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:26.017690 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:26.017650    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:26.140774 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:26.140741    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:27.335269 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:27.335231    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:27.422906 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:27.422847    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:27.525595 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:27.525563    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:27.638631 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:27.638548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:27.737494 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:27.737458    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:28.024149 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.024108    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:28.144568 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.144531    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:28.263543 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.263505    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"]
Sep 05 06:40:28.267056 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.267038    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"
Sep 05 06:40:28.271772 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.271747    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-faf2bf41-dockercfg-nqx29\""
Sep 05 06:40:28.272076 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.272055    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-faf2bf41\""
Sep 05 06:40:28.279304 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.279248    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"]
Sep 05 06:40:28.350254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.350226    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"]
Sep 05 06:40:28.353706 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.353686    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"
Sep 05 06:40:28.374534 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.374510    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"]
Sep 05 06:40:28.384146 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.384126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t88th\" (UniqueName: \"kubernetes.io/projected/d2332d63-9e86-47d3-ae64-5eeb5d5f2276-kube-api-access-t88th\") pod \"payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29\" (UID: \"d2332d63-9e86-47d3-ae64-5eeb5d5f2276\") " pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"
Sep 05 06:40:28.384295 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.384157    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84954661-5554-4c33-b56c-cc367af890b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f\" (UID: \"84954661-5554-4c33-b56c-cc367af890b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"
Sep 05 06:40:28.384295 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.384195    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8c57\" (UniqueName: \"kubernetes.io/projected/84954661-5554-4c33-b56c-cc367af890b5-kube-api-access-n8c57\") pod \"payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f\" (UID: \"84954661-5554-4c33-b56c-cc367af890b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"
Sep 05 06:40:28.384295 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.384266    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2332d63-9e86-47d3-ae64-5eeb5d5f2276-plugins-config-volume\") pod \"payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29\" (UID: \"d2332d63-9e86-47d3-ae64-5eeb5d5f2276\") " pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"
Sep 05 06:40:28.485557 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.485522    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t88th\" (UniqueName: \"kubernetes.io/projected/d2332d63-9e86-47d3-ae64-5eeb5d5f2276-kube-api-access-t88th\") pod \"payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29\" (UID: \"d2332d63-9e86-47d3-ae64-5eeb5d5f2276\") " pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"
Sep 05 06:40:28.485557 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.485568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84954661-5554-4c33-b56c-cc367af890b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f\" (UID: \"84954661-5554-4c33-b56c-cc367af890b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"
Sep 05 06:40:28.485832 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.485605    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8c57\" (UniqueName: \"kubernetes.io/projected/84954661-5554-4c33-b56c-cc367af890b5-kube-api-access-n8c57\") pod \"payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f\" (UID: \"84954661-5554-4c33-b56c-cc367af890b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"
Sep 05 06:40:28.485832 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.485625    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2332d63-9e86-47d3-ae64-5eeb5d5f2276-plugins-config-volume\") pod \"payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29\" (UID: \"d2332d63-9e86-47d3-ae64-5eeb5d5f2276\") " pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"
Sep 05 06:40:28.486400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.486376    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2332d63-9e86-47d3-ae64-5eeb5d5f2276-plugins-config-volume\") pod \"payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29\" (UID: \"d2332d63-9e86-47d3-ae64-5eeb5d5f2276\") " pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"
Sep 05 06:40:28.486488 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.486380    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84954661-5554-4c33-b56c-cc367af890b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f\" (UID: \"84954661-5554-4c33-b56c-cc367af890b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"
Sep 05 06:40:28.496674 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.496646    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8c57\" (UniqueName: \"kubernetes.io/projected/84954661-5554-4c33-b56c-cc367af890b5-kube-api-access-n8c57\") pod \"payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f\" (UID: \"84954661-5554-4c33-b56c-cc367af890b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"
Sep 05 06:40:28.496846 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.496824    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t88th\" (UniqueName: \"kubernetes.io/projected/d2332d63-9e86-47d3-ae64-5eeb5d5f2276-kube-api-access-t88th\") pod \"payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29\" (UID: \"d2332d63-9e86-47d3-ae64-5eeb5d5f2276\") " pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"
Sep 05 06:40:28.578566 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.578497    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"
Sep 05 06:40:28.663483 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.663451    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"
Sep 05 06:40:28.851449 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.851427    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"]
Sep 05 06:40:28.853041 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:40:28.853008    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84954661_5554_4c33_b56c_cc367af890b5.slice/crio-915cad052b229fe24a7586e58f44fdcfb0ef609418c3613e3275befbd9fbaf98 WatchSource:0}: Error finding container 915cad052b229fe24a7586e58f44fdcfb0ef609418c3613e3275befbd9fbaf98: Status 404 returned error can't find the container with id 915cad052b229fe24a7586e58f44fdcfb0ef609418c3613e3275befbd9fbaf98
Sep 05 06:40:28.943333 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:28.943304    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"]
Sep 05 06:40:28.944910 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:40:28.944880    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2332d63_9e86_47d3_ae64_5eeb5d5f2276.slice/crio-df7b2913550ebf7f7d5d03c278fcb93782e3184fd28e776bdd6cf9d38c6387c7 WatchSource:0}: Error finding container df7b2913550ebf7f7d5d03c278fcb93782e3184fd28e776bdd6cf9d38c6387c7: Status 404 returned error can't find the container with id df7b2913550ebf7f7d5d03c278fcb93782e3184fd28e776bdd6cf9d38c6387c7
Sep 05 06:40:29.365658 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:29.365548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:29.461954 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:29.461917    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:29.670298 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:29.670210    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:29.752122 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:29.752091    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29" event={"ID":"d2332d63-9e86-47d3-ae64-5eeb5d5f2276","Type":"ContainerStarted","Data":"6000c6afec7f4a7664507680ad70f03fc35e33202aff7a92e54d56125283751f"}
Sep 05 06:40:29.752313 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:29.752141    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29" event={"ID":"d2332d63-9e86-47d3-ae64-5eeb5d5f2276","Type":"ContainerStarted","Data":"df7b2913550ebf7f7d5d03c278fcb93782e3184fd28e776bdd6cf9d38c6387c7"}
Sep 05 06:40:29.752313 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:29.752190    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"
Sep 05 06:40:29.753773 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:29.753749    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f" event={"ID":"84954661-5554-4c33-b56c-cc367af890b5","Type":"ContainerStarted","Data":"15fb5b35d0d06141f482e4d057e94f4abb1033b5b781792a43b083937f289db0"}
Sep 05 06:40:29.753930 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:29.753782    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f" event={"ID":"84954661-5554-4c33-b56c-cc367af890b5","Type":"ContainerStarted","Data":"915cad052b229fe24a7586e58f44fdcfb0ef609418c3613e3275befbd9fbaf98"}
Sep 05 06:40:29.753930 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:29.753811    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"
Sep 05 06:40:29.771454 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:29.771414    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29" podStartSLOduration=1.771378936 podStartE2EDuration="1.771378936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:40:29.770291872 +0000 UTC m=+927.374840711" watchObservedRunningTime="2026-09-05 06:40:29.771378936 +0000 UTC m=+927.375927770"
Sep 05 06:40:29.789478 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:29.789439    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f" podStartSLOduration=1.7894260709999998 podStartE2EDuration="1.789426071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:40:29.788971674 +0000 UTC m=+927.393520529" watchObservedRunningTime="2026-09-05 06:40:29.789426071 +0000 UTC m=+927.393974909"
Sep 05 06:40:29.922043 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:29.921969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:30.019186 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.019140    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"]
Sep 05 06:40:30.020099 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.020074    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:30.030905 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.030852    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"
Sep 05 06:40:30.033488 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.033465    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-e04a57\""
Sep 05 06:40:30.037853 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.037825    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"]
Sep 05 06:40:30.044121 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.044094    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"]
Sep 05 06:40:30.047656 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.047636    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"
Sep 05 06:40:30.050734 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.050712    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-e04a57-dockercfg-c4h9p\""
Sep 05 06:40:30.059007 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.058987    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"]
Sep 05 06:40:30.100953 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.100916    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq2vf\" (UniqueName: \"kubernetes.io/projected/381ef0cb-36f4-4f74-b7b0-1c35e0b3e939-kube-api-access-xq2vf\") pod \"payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7\" (UID: \"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"
Sep 05 06:40:30.101132 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.100982    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d18710f-e6b9-4779-9a5f-d0854341658e-plugins-config-volume\") pod \"payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f\" (UID: \"1d18710f-e6b9-4779-9a5f-d0854341658e\") " pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"
Sep 05 06:40:30.101132 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.101069    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtbtf\" (UniqueName: \"kubernetes.io/projected/1d18710f-e6b9-4779-9a5f-d0854341658e-kube-api-access-xtbtf\") pod \"payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f\" (UID: \"1d18710f-e6b9-4779-9a5f-d0854341658e\") " pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"
Sep 05 06:40:30.101257 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.101182    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/381ef0cb-36f4-4f74-b7b0-1c35e0b3e939-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7\" (UID: \"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"
Sep 05 06:40:30.201980 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.201939    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/381ef0cb-36f4-4f74-b7b0-1c35e0b3e939-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7\" (UID: \"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"
Sep 05 06:40:30.202178 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.202009    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq2vf\" (UniqueName: \"kubernetes.io/projected/381ef0cb-36f4-4f74-b7b0-1c35e0b3e939-kube-api-access-xq2vf\") pod \"payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7\" (UID: \"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"
Sep 05 06:40:30.202178 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.202050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d18710f-e6b9-4779-9a5f-d0854341658e-plugins-config-volume\") pod \"payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f\" (UID: \"1d18710f-e6b9-4779-9a5f-d0854341658e\") " pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"
Sep 05 06:40:30.202178 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.202099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtbtf\" (UniqueName: \"kubernetes.io/projected/1d18710f-e6b9-4779-9a5f-d0854341658e-kube-api-access-xtbtf\") pod \"payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f\" (UID: \"1d18710f-e6b9-4779-9a5f-d0854341658e\") " pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"
Sep 05 06:40:30.203327 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.203297    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/381ef0cb-36f4-4f74-b7b0-1c35e0b3e939-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7\" (UID: \"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"
Sep 05 06:40:30.203503 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.203438    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d18710f-e6b9-4779-9a5f-d0854341658e-plugins-config-volume\") pod \"payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f\" (UID: \"1d18710f-e6b9-4779-9a5f-d0854341658e\") " pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"
Sep 05 06:40:30.211152 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.211128    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq2vf\" (UniqueName: \"kubernetes.io/projected/381ef0cb-36f4-4f74-b7b0-1c35e0b3e939-kube-api-access-xq2vf\") pod \"payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7\" (UID: \"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"
Sep 05 06:40:30.212599 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.212570    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtbtf\" (UniqueName: \"kubernetes.io/projected/1d18710f-e6b9-4779-9a5f-d0854341658e-kube-api-access-xtbtf\") pod \"payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f\" (UID: \"1d18710f-e6b9-4779-9a5f-d0854341658e\") " pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"
Sep 05 06:40:30.334977 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.334916    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:30.343825 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.343803    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"
Sep 05 06:40:30.358994 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.358969    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"
Sep 05 06:40:30.627290 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.627260    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"]
Sep 05 06:40:30.629590 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:40:30.629560    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381ef0cb_36f4_4f74_b7b0_1c35e0b3e939.slice/crio-fd0a5953561a145dd93047c7e879ddc74c5c2933c10ffb264f841687dc16d677 WatchSource:0}: Error finding container fd0a5953561a145dd93047c7e879ddc74c5c2933c10ffb264f841687dc16d677: Status 404 returned error can't find the container with id fd0a5953561a145dd93047c7e879ddc74c5c2933c10ffb264f841687dc16d677
Sep 05 06:40:30.656292 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.656269    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"]
Sep 05 06:40:30.661684 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.661663    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:40:30.666004 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:40:30.665980    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d18710f_e6b9_4779_9a5f_d0854341658e.slice/crio-c5535f42fa542e993922503318038aff35a9fc6067f71bd64b01283dd36340a4 WatchSource:0}: Error finding container c5535f42fa542e993922503318038aff35a9fc6067f71bd64b01283dd36340a4: Status 404 returned error can't find the container with id c5535f42fa542e993922503318038aff35a9fc6067f71bd64b01283dd36340a4
Sep 05 06:40:30.762298 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.762263    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f" event={"ID":"1d18710f-e6b9-4779-9a5f-d0854341658e","Type":"ContainerStarted","Data":"48718f43bb5e49c3c75e27b5ec0c73d4085e9c335720ed58e402c0fd5fd28271"}
Sep 05 06:40:30.762461 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.762344    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f" event={"ID":"1d18710f-e6b9-4779-9a5f-d0854341658e","Type":"ContainerStarted","Data":"c5535f42fa542e993922503318038aff35a9fc6067f71bd64b01283dd36340a4"}
Sep 05 06:40:30.762461 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.762382    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"
Sep 05 06:40:30.764245 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.764217    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7" event={"ID":"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939","Type":"ContainerStarted","Data":"b3d924122ceb5e07a04722da59070eebc8e396255ea21be7f04d63c0e1013a1d"}
Sep 05 06:40:30.764321 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.764263    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7" event={"ID":"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939","Type":"ContainerStarted","Data":"fd0a5953561a145dd93047c7e879ddc74c5c2933c10ffb264f841687dc16d677"}
Sep 05 06:40:30.764530 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.764512    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"
Sep 05 06:40:30.784605 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.784557    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f" podStartSLOduration=0.784542269 podStartE2EDuration="784.542269ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:40:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:40:30.783138575 +0000 UTC m=+928.387687420" watchObservedRunningTime="2026-09-05 06:40:30.784542269 +0000 UTC m=+928.389091107"
Sep 05 06:40:30.802849 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:30.802791    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7" podStartSLOduration=1.802771668 podStartE2EDuration="1.802771668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:40:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:40:30.800391792 +0000 UTC m=+928.404940632" watchObservedRunningTime="2026-09-05 06:40:30.802771668 +0000 UTC m=+928.407320503"
Sep 05 06:40:31.194038 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:31.194005    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:32.714535 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:32.714505    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"
Sep 05 06:40:32.714978 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:32.714573    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"
Sep 05 06:40:33.634331 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:33.634299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:33.808139 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:33.808105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:33.898186 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:33.898098    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:33.997281 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:33.997232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:34.684480 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:34.684442    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:36.792948 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:36.792916    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:38.489528 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:38.489494    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:40.766763 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:40.766687    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"
Sep 05 06:40:40.766763 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:40.766751    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"
Sep 05 06:40:41.770711 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:41.770677    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"
Sep 05 06:40:42.088747 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:42.088665    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:42.778019 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:42.777473    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"
Sep 05 06:40:43.575043 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:43.575010    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:43.896823 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:43.896721    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:44.224476 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:44.224439    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:44.449476 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:44.449448    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:44.674664 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:44.674575    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:44.772558 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:44.772521    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:44.914498 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:44.914451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:47.741747 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:47.741714    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:47.841484 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:47.841456    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:48.869843 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:48.869801    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:48.969890 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:48.969838    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:48.985225 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:48.985192    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:40:49.070735 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.070702    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:49.565712 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.565673    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:49.655514 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.655466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:49.755129 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.755099    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"]
Sep 05 06:40:49.759729 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.759713    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"
Sep 05 06:40:49.762927 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.762904    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-5d5f17\""
Sep 05 06:40:49.763062 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.763004    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-5d5f17-dockercfg-h2cck\""
Sep 05 06:40:49.773637 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.773615    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"]
Sep 05 06:40:49.881419 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.881341    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm7xf\" (UniqueName: \"kubernetes.io/projected/e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec-kube-api-access-lm7xf\") pod \"payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8\" (UID: \"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"
Sep 05 06:40:49.881419 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.881412    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8\" (UID: \"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"
Sep 05 06:40:49.981979 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.981942    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm7xf\" (UniqueName: \"kubernetes.io/projected/e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec-kube-api-access-lm7xf\") pod \"payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8\" (UID: \"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"
Sep 05 06:40:49.982175 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.982069    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8\" (UID: \"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"
Sep 05 06:40:49.982717 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.982696    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8\" (UID: \"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"
Sep 05 06:40:49.999618 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:49.999582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm7xf\" (UniqueName: \"kubernetes.io/projected/e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec-kube-api-access-lm7xf\") pod \"payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8\" (UID: \"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"
Sep 05 06:40:50.069569 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:50.069533    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"
Sep 05 06:40:50.345606 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:50.345581    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"]
Sep 05 06:40:50.347573 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:40:50.347543    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2e8dc8d_1fe7_449f_aa8a_05a0f54b90ec.slice/crio-098920531db390789ae728245071d9b7a0db3a1f8967231b7d850b41453a78bb WatchSource:0}: Error finding container 098920531db390789ae728245071d9b7a0db3a1f8967231b7d850b41453a78bb: Status 404 returned error can't find the container with id 098920531db390789ae728245071d9b7a0db3a1f8967231b7d850b41453a78bb
Sep 05 06:40:50.858464 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:50.858430    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:50.872226 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:50.872198    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8" event={"ID":"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec","Type":"ContainerStarted","Data":"ff1026be96c1d0d8a94fe3d927f9ee09da8af2767268f21c431ce10758a6f680"}
Sep 05 06:40:50.872388 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:50.872245    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8" event={"ID":"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec","Type":"ContainerStarted","Data":"098920531db390789ae728245071d9b7a0db3a1f8967231b7d850b41453a78bb"}
Sep 05 06:40:50.872388 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:50.872287    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"
Sep 05 06:40:50.902597 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:50.902545    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8" podStartSLOduration=1.902530152 podStartE2EDuration="1.902530152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:40:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:40:50.900942927 +0000 UTC m=+948.505491777" watchObservedRunningTime="2026-09-05 06:40:50.902530152 +0000 UTC m=+948.507078989"
Sep 05 06:40:51.893160 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:51.893130    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:52.656978 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:52.656945    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:52.819773 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:52.819745    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:53.413798 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:53.413755    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:53.534917 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:53.534853    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:53.631826 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:53.631785    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:53.801147 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:53.801113    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:53.901899 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:53.901842    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:40:54.554755 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:40:54.554724    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:00.478166 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:00.478132    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:00.579594 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:00.579557    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:01.879298 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:01.879266    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"
Sep 05 06:41:05.065240 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:05.065205    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:41:08.055376 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.055344    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:08.088157 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.088122    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"]
Sep 05 06:41:08.088366 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.088339    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29" podUID="d2332d63-9e86-47d3-ae64-5eeb5d5f2276" containerName="payload-processing" containerID="cri-o://6000c6afec7f4a7664507680ad70f03fc35e33202aff7a92e54d56125283751f" gracePeriod=30
Sep 05 06:41:08.095952 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.095134    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"]
Sep 05 06:41:08.095952 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.095367    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f" podUID="84954661-5554-4c33-b56c-cc367af890b5" containerName="payload-pre-processing" containerID="cri-o://15fb5b35d0d06141f482e4d057e94f4abb1033b5b781792a43b083937f289db0" gracePeriod=30
Sep 05 06:41:08.131275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.131239    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:08.227568 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.227526    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:08.314531 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.314501    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:08.365893 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.365854    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"
Sep 05 06:41:08.390460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.390439    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"
Sep 05 06:41:08.439562 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.439529    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2332d63-9e86-47d3-ae64-5eeb5d5f2276-plugins-config-volume\") pod \"d2332d63-9e86-47d3-ae64-5eeb5d5f2276\" (UID: \"d2332d63-9e86-47d3-ae64-5eeb5d5f2276\") "
Sep 05 06:41:08.439745 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.439626    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t88th\" (UniqueName: \"kubernetes.io/projected/d2332d63-9e86-47d3-ae64-5eeb5d5f2276-kube-api-access-t88th\") pod \"d2332d63-9e86-47d3-ae64-5eeb5d5f2276\" (UID: \"d2332d63-9e86-47d3-ae64-5eeb5d5f2276\") "
Sep 05 06:41:08.439745 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.439671    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84954661-5554-4c33-b56c-cc367af890b5-plugins-config-volume\") pod \"84954661-5554-4c33-b56c-cc367af890b5\" (UID: \"84954661-5554-4c33-b56c-cc367af890b5\") "
Sep 05 06:41:08.439745 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.439699    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8c57\" (UniqueName: \"kubernetes.io/projected/84954661-5554-4c33-b56c-cc367af890b5-kube-api-access-n8c57\") pod \"84954661-5554-4c33-b56c-cc367af890b5\" (UID: \"84954661-5554-4c33-b56c-cc367af890b5\") "
Sep 05 06:41:08.440009 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.439963    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2332d63-9e86-47d3-ae64-5eeb5d5f2276-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d2332d63-9e86-47d3-ae64-5eeb5d5f2276" (UID: "d2332d63-9e86-47d3-ae64-5eeb5d5f2276"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:41:08.440440 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.440416    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84954661-5554-4c33-b56c-cc367af890b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "84954661-5554-4c33-b56c-cc367af890b5" (UID: "84954661-5554-4c33-b56c-cc367af890b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:41:08.442303 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.442279    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84954661-5554-4c33-b56c-cc367af890b5-kube-api-access-n8c57" (OuterVolumeSpecName: "kube-api-access-n8c57") pod "84954661-5554-4c33-b56c-cc367af890b5" (UID: "84954661-5554-4c33-b56c-cc367af890b5"). InnerVolumeSpecName "kube-api-access-n8c57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:41:08.442384 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.442368    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2332d63-9e86-47d3-ae64-5eeb5d5f2276-kube-api-access-t88th" (OuterVolumeSpecName: "kube-api-access-t88th") pod "d2332d63-9e86-47d3-ae64-5eeb5d5f2276" (UID: "d2332d63-9e86-47d3-ae64-5eeb5d5f2276"). InnerVolumeSpecName "kube-api-access-t88th". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:41:08.472411 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.472388    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:08.540809 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.540769    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2332d63-9e86-47d3-ae64-5eeb5d5f2276-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:08.540809 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.540801    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t88th\" (UniqueName: \"kubernetes.io/projected/d2332d63-9e86-47d3-ae64-5eeb5d5f2276-kube-api-access-t88th\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:08.540809 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.540812    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84954661-5554-4c33-b56c-cc367af890b5-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:08.541064 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.540821    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8c57\" (UniqueName: \"kubernetes.io/projected/84954661-5554-4c33-b56c-cc367af890b5-kube-api-access-n8c57\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:08.943427 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.943396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:08.960234 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.960203    2583 generic.go:356] "Generic (PLEG): container finished" podID="84954661-5554-4c33-b56c-cc367af890b5" containerID="15fb5b35d0d06141f482e4d057e94f4abb1033b5b781792a43b083937f289db0" exitCode=0
Sep 05 06:41:08.960356 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.960251    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"
Sep 05 06:41:08.960356 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.960277    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f" event={"ID":"84954661-5554-4c33-b56c-cc367af890b5","Type":"ContainerDied","Data":"15fb5b35d0d06141f482e4d057e94f4abb1033b5b781792a43b083937f289db0"}
Sep 05 06:41:08.960356 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.960328    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f" event={"ID":"84954661-5554-4c33-b56c-cc367af890b5","Type":"ContainerDied","Data":"915cad052b229fe24a7586e58f44fdcfb0ef609418c3613e3275befbd9fbaf98"}
Sep 05 06:41:08.960356 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.960351    2583 scope.go:117] "RemoveContainer" containerID="15fb5b35d0d06141f482e4d057e94f4abb1033b5b781792a43b083937f289db0"
Sep 05 06:41:08.961842 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.961818    2583 generic.go:356] "Generic (PLEG): container finished" podID="d2332d63-9e86-47d3-ae64-5eeb5d5f2276" containerID="6000c6afec7f4a7664507680ad70f03fc35e33202aff7a92e54d56125283751f" exitCode=0
Sep 05 06:41:08.961952 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.961880    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"
Sep 05 06:41:08.961952 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.961889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29" event={"ID":"d2332d63-9e86-47d3-ae64-5eeb5d5f2276","Type":"ContainerDied","Data":"6000c6afec7f4a7664507680ad70f03fc35e33202aff7a92e54d56125283751f"}
Sep 05 06:41:08.961952 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.961945    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29" event={"ID":"d2332d63-9e86-47d3-ae64-5eeb5d5f2276","Type":"ContainerDied","Data":"df7b2913550ebf7f7d5d03c278fcb93782e3184fd28e776bdd6cf9d38c6387c7"}
Sep 05 06:41:08.969251 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.969236    2583 scope.go:117] "RemoveContainer" containerID="15fb5b35d0d06141f482e4d057e94f4abb1033b5b781792a43b083937f289db0"
Sep 05 06:41:08.969523 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:41:08.969507    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15fb5b35d0d06141f482e4d057e94f4abb1033b5b781792a43b083937f289db0\": container with ID starting with 15fb5b35d0d06141f482e4d057e94f4abb1033b5b781792a43b083937f289db0 not found: ID does not exist" containerID="15fb5b35d0d06141f482e4d057e94f4abb1033b5b781792a43b083937f289db0"
Sep 05 06:41:08.969572 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.969532    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15fb5b35d0d06141f482e4d057e94f4abb1033b5b781792a43b083937f289db0"} err="failed to get container status \"15fb5b35d0d06141f482e4d057e94f4abb1033b5b781792a43b083937f289db0\": rpc error: code = NotFound desc = could not find container \"15fb5b35d0d06141f482e4d057e94f4abb1033b5b781792a43b083937f289db0\": container with ID starting with 15fb5b35d0d06141f482e4d057e94f4abb1033b5b781792a43b083937f289db0 not found: ID does not exist"
Sep 05 06:41:08.969572 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.969548    2583 scope.go:117] "RemoveContainer" containerID="6000c6afec7f4a7664507680ad70f03fc35e33202aff7a92e54d56125283751f"
Sep 05 06:41:08.977051 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.977036    2583 scope.go:117] "RemoveContainer" containerID="6000c6afec7f4a7664507680ad70f03fc35e33202aff7a92e54d56125283751f"
Sep 05 06:41:08.977302 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:41:08.977285    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6000c6afec7f4a7664507680ad70f03fc35e33202aff7a92e54d56125283751f\": container with ID starting with 6000c6afec7f4a7664507680ad70f03fc35e33202aff7a92e54d56125283751f not found: ID does not exist" containerID="6000c6afec7f4a7664507680ad70f03fc35e33202aff7a92e54d56125283751f"
Sep 05 06:41:08.977347 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.977307    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6000c6afec7f4a7664507680ad70f03fc35e33202aff7a92e54d56125283751f"} err="failed to get container status \"6000c6afec7f4a7664507680ad70f03fc35e33202aff7a92e54d56125283751f\": rpc error: code = NotFound desc = could not find container \"6000c6afec7f4a7664507680ad70f03fc35e33202aff7a92e54d56125283751f\": container with ID starting with 6000c6afec7f4a7664507680ad70f03fc35e33202aff7a92e54d56125283751f not found: ID does not exist"
Sep 05 06:41:08.984429 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.984408    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"]
Sep 05 06:41:08.990255 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:08.990235    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29"]
Sep 05 06:41:09.004333 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:09.004303    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"]
Sep 05 06:41:09.007800 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:09.007768    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f"]
Sep 05 06:41:09.036239 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:09.036212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:09.141483 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:09.141459    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:09.620879 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:09.620835    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:09.790281 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:09.790245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:10.915385 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:10.915342    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84954661-5554-4c33-b56c-cc367af890b5" path="/var/lib/kubelet/pods/84954661-5554-4c33-b56c-cc367af890b5/volumes"
Sep 05 06:41:10.915892 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:10.915832    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2332d63-9e86-47d3-ae64-5eeb5d5f2276" path="/var/lib/kubelet/pods/d2332d63-9e86-47d3-ae64-5eeb5d5f2276/volumes"
Sep 05 06:41:12.799260 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:12.799224    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:15.504288 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:15.504255    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:15.605049 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:15.605016    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:15.708684 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:15.708650    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:15.808998 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:15.808912    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:16.069328 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.069242    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:16.324492 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.324405    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:16.424941 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.424905    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:16.472418 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.469893    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"]
Sep 05 06:41:16.472418 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.470707    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2332d63-9e86-47d3-ae64-5eeb5d5f2276" containerName="payload-processing"
Sep 05 06:41:16.472418 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.470728    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2332d63-9e86-47d3-ae64-5eeb5d5f2276" containerName="payload-processing"
Sep 05 06:41:16.472418 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.470761    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84954661-5554-4c33-b56c-cc367af890b5" containerName="payload-pre-processing"
Sep 05 06:41:16.472418 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.470770    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="84954661-5554-4c33-b56c-cc367af890b5" containerName="payload-pre-processing"
Sep 05 06:41:16.472418 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.470940    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="84954661-5554-4c33-b56c-cc367af890b5" containerName="payload-pre-processing"
Sep 05 06:41:16.472418 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.470960    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2332d63-9e86-47d3-ae64-5eeb5d5f2276" containerName="payload-processing"
Sep 05 06:41:16.476226 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.476204    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"
Sep 05 06:41:16.479068 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.479040    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-ea7120c2\""
Sep 05 06:41:16.488290 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.488264    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"]
Sep 05 06:41:16.504793 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.504763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30cc2b03-6a67-46a1-803a-0745524cac0d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq\" (UID: \"30cc2b03-6a67-46a1-803a-0745524cac0d\") " pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"
Sep 05 06:41:16.505168 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.504936    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7trrq\" (UniqueName: \"kubernetes.io/projected/30cc2b03-6a67-46a1-803a-0745524cac0d-kube-api-access-7trrq\") pod \"payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq\" (UID: \"30cc2b03-6a67-46a1-803a-0745524cac0d\") " pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"
Sep 05 06:41:16.606393 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.606304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7trrq\" (UniqueName: \"kubernetes.io/projected/30cc2b03-6a67-46a1-803a-0745524cac0d-kube-api-access-7trrq\") pod \"payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq\" (UID: \"30cc2b03-6a67-46a1-803a-0745524cac0d\") " pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"
Sep 05 06:41:16.606552 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.606401    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30cc2b03-6a67-46a1-803a-0745524cac0d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq\" (UID: \"30cc2b03-6a67-46a1-803a-0745524cac0d\") " pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"
Sep 05 06:41:16.607165 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.607139    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30cc2b03-6a67-46a1-803a-0745524cac0d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq\" (UID: \"30cc2b03-6a67-46a1-803a-0745524cac0d\") " pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"
Sep 05 06:41:16.615598 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.615573    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7trrq\" (UniqueName: \"kubernetes.io/projected/30cc2b03-6a67-46a1-803a-0745524cac0d-kube-api-access-7trrq\") pod \"payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq\" (UID: \"30cc2b03-6a67-46a1-803a-0745524cac0d\") " pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"
Sep 05 06:41:16.786972 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:16.786930    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"
Sep 05 06:41:17.074273 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:17.074237    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"]
Sep 05 06:41:17.075964 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:41:17.075937    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30cc2b03_6a67_46a1_803a_0745524cac0d.slice/crio-ffe91eb5839034394d9c085bfcc172304857d7dc903b40b94e22641a9390fb17 WatchSource:0}: Error finding container ffe91eb5839034394d9c085bfcc172304857d7dc903b40b94e22641a9390fb17: Status 404 returned error can't find the container with id ffe91eb5839034394d9c085bfcc172304857d7dc903b40b94e22641a9390fb17
Sep 05 06:41:17.818199 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:17.818162    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:18.013493 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:18.013443    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq" event={"ID":"30cc2b03-6a67-46a1-803a-0745524cac0d","Type":"ContainerStarted","Data":"6d3de7764c3c977bcb7325be71b97fe90e260a7abcb4cc8ab061e2fa5ce674dd"}
Sep 05 06:41:18.013755 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:18.013610    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"
Sep 05 06:41:18.013755 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:18.013633    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq" event={"ID":"30cc2b03-6a67-46a1-803a-0745524cac0d","Type":"ContainerStarted","Data":"ffe91eb5839034394d9c085bfcc172304857d7dc903b40b94e22641a9390fb17"}
Sep 05 06:41:18.033597 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:18.033553    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq" podStartSLOduration=2.03353859 podStartE2EDuration="2.03353859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:41:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:41:18.032278113 +0000 UTC m=+975.636826962" watchObservedRunningTime="2026-09-05 06:41:18.03353859 +0000 UTC m=+975.638087427"
Sep 05 06:41:19.972959 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:19.972923    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:22.866379 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:22.866343    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:41:29.021501 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:29.021425    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"
Sep 05 06:41:30.087820 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.087785    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"]
Sep 05 06:41:30.091301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.091279    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.095454 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.095431    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-e04a57\"/\"kube-root-ca.crt\""
Sep 05 06:41:30.095573 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.095441    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-e04a57\"/\"autores-model-e04a57-kserve-self-signed-certs\""
Sep 05 06:41:30.095573 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.095480    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-e04a57\"/\"default-dockercfg-wh7n5\""
Sep 05 06:41:30.095573 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.095462    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-e04a57\"/\"openshift-service-ca.crt\""
Sep 05 06:41:30.106416 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.106393    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"]
Sep 05 06:41:30.123231 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.123197    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:30.218631 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.218588    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-dshm\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.218804 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.218654    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b0e60a-89a5-4969-8ccb-1179f301916a-tls-certs\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.218804 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.218711    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpnfl\" (UniqueName: \"kubernetes.io/projected/f3b0e60a-89a5-4969-8ccb-1179f301916a-kube-api-access-kpnfl\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.218804 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.218748    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-model-cache\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.218804 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.218784    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-home\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.218969 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.218840    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-tmp-dir\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.320165 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.320130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b0e60a-89a5-4969-8ccb-1179f301916a-tls-certs\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.320165 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.320168    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnfl\" (UniqueName: \"kubernetes.io/projected/f3b0e60a-89a5-4969-8ccb-1179f301916a-kube-api-access-kpnfl\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.320423 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.320195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-model-cache\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.320423 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.320397    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-home\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.320534 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.320439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-tmp-dir\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.320534 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.320495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-dshm\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.320822 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.320778    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-model-cache\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.320822 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.320796    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-home\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.321057 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.320961    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-tmp-dir\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.322639 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.322607    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-dshm\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.322849 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.322831    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b0e60a-89a5-4969-8ccb-1179f301916a-tls-certs\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.331230 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.331208    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpnfl\" (UniqueName: \"kubernetes.io/projected/f3b0e60a-89a5-4969-8ccb-1179f301916a-kube-api-access-kpnfl\") pod \"autores-model-e04a57-kserve-669b897999-mgslr\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") " pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.400590 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.400503    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:30.671608 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:30.671573    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"]
Sep 05 06:41:30.672788 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:41:30.672760    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3b0e60a_89a5_4969_8ccb_1179f301916a.slice/crio-7295c075cf9db2d3d214895d9da20d05da716c253a57b25dd1eae7884cdc460b WatchSource:0}: Error finding container 7295c075cf9db2d3d214895d9da20d05da716c253a57b25dd1eae7884cdc460b: Status 404 returned error can't find the container with id 7295c075cf9db2d3d214895d9da20d05da716c253a57b25dd1eae7884cdc460b
Sep 05 06:41:31.080000 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:31.079959    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr" event={"ID":"f3b0e60a-89a5-4969-8ccb-1179f301916a","Type":"ContainerStarted","Data":"ec5fcc41bfe14052cdee69914e0130cd764eeb926916fb1fd0f497164ed169ed"}
Sep 05 06:41:31.080185 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:31.080014    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr" event={"ID":"f3b0e60a-89a5-4969-8ccb-1179f301916a","Type":"ContainerStarted","Data":"7295c075cf9db2d3d214895d9da20d05da716c253a57b25dd1eae7884cdc460b"}
Sep 05 06:41:31.100296 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:31.100238    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr" podStartSLOduration=1.10022167 podStartE2EDuration="1.10022167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:41:31.099342658 +0000 UTC m=+988.703891497" watchObservedRunningTime="2026-09-05 06:41:31.10022167 +0000 UTC m=+988.704770508"
Sep 05 06:41:35.658130 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.658094    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"]
Sep 05 06:41:35.661636 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.661619    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.666025 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.665992    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6efc3a\"/\"kube-root-ca.crt\""
Sep 05 06:41:35.666164 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.665989    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6efc3a\"/\"openshift-service-ca.crt\""
Sep 05 06:41:35.666164 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.666126    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6efc3a\"/\"test-model-6efc3a-kserve-self-signed-certs\""
Sep 05 06:41:35.666293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.666168    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6efc3a\"/\"default-dockercfg-zf7f5\""
Sep 05 06:41:35.673113 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.673084    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"]
Sep 05 06:41:35.694212 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.694181    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:35.765413 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.765374    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-model-cache\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.765615 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.765448    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47jxl\" (UniqueName: \"kubernetes.io/projected/0933122f-9f68-4bbe-9620-09c653705d52-kube-api-access-47jxl\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.765615 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.765477    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0933122f-9f68-4bbe-9620-09c653705d52-tls-certs\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.765615 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.765503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-tmp-dir\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.765615 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.765605    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-dshm\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.765800 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.765656    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-home\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.866580 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.866550    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-tmp-dir\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.866786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.866595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-dshm\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.866786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.866624    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-home\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.866786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.866648    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-model-cache\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.866786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.866684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47jxl\" (UniqueName: \"kubernetes.io/projected/0933122f-9f68-4bbe-9620-09c653705d52-kube-api-access-47jxl\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.866786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.866702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0933122f-9f68-4bbe-9620-09c653705d52-tls-certs\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.867142 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.867117    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-tmp-dir\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.867230 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.867157    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-home\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.867230 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.867179    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-model-cache\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.868882 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.868850    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-dshm\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.869172 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.869152    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0933122f-9f68-4bbe-9620-09c653705d52-tls-certs\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.876517 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.876483    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47jxl\" (UniqueName: \"kubernetes.io/projected/0933122f-9f68-4bbe-9620-09c653705d52-kube-api-access-47jxl\") pod \"test-model-6efc3a-kserve-d4f9dd5c7-jdcc4\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") " pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:35.973679 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:35.973646    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:36.245761 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:36.245739    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"]
Sep 05 06:41:36.247649 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:41:36.247620    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0933122f_9f68_4bbe_9620_09c653705d52.slice/crio-0b9256af264444d275b515a43d25a36368249d53b95e80a3a08712f9d9f27f10 WatchSource:0}: Error finding container 0b9256af264444d275b515a43d25a36368249d53b95e80a3a08712f9d9f27f10: Status 404 returned error can't find the container with id 0b9256af264444d275b515a43d25a36368249d53b95e80a3a08712f9d9f27f10
Sep 05 06:41:37.113668 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:37.113630    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4" event={"ID":"0933122f-9f68-4bbe-9620-09c653705d52","Type":"ContainerStarted","Data":"58c39d528ec32311ecddb1cb4a132c1ecc61e59363596e8e651c79376637aedb"}
Sep 05 06:41:37.113668 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:37.113675    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4" event={"ID":"0933122f-9f68-4bbe-9620-09c653705d52","Type":"ContainerStarted","Data":"0b9256af264444d275b515a43d25a36368249d53b95e80a3a08712f9d9f27f10"}
Sep 05 06:41:37.132255 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:37.132199    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4" podStartSLOduration=2.13218174 podStartE2EDuration="2.13218174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:41:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:41:37.131827165 +0000 UTC m=+994.736376003" watchObservedRunningTime="2026-09-05 06:41:37.13218174 +0000 UTC m=+994.736730578"
Sep 05 06:41:38.064613 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:38.064578    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:39.401385 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:39.401349    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"]
Sep 05 06:41:39.426046 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:39.426018    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:39.730787 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:39.730758    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:40.390980 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:40.390944    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk"]
Sep 05 06:41:40.394489 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:40.394463    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk"
Sep 05 06:41:40.397201 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:40.397174    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:41:40.397332 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:40.397214    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:41:40.401382 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:40.401359    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:40.404347 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:40.404325    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk"]
Sep 05 06:41:40.509217 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:40.509183    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/050997c1-0dec-491c-8091-23562463b709-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk\" (UID: \"050997c1-0dec-491c-8091-23562463b709\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk"
Sep 05 06:41:40.610080 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:40.610041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/050997c1-0dec-491c-8091-23562463b709-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk\" (UID: \"050997c1-0dec-491c-8091-23562463b709\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk"
Sep 05 06:41:40.610638 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:40.610616    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/050997c1-0dec-491c-8091-23562463b709-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk\" (UID: \"050997c1-0dec-491c-8091-23562463b709\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk"
Sep 05 06:41:40.707280 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:40.707250    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk"
Sep 05 06:41:40.827724 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:40.827689    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:40.977229 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:40.977204    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk"]
Sep 05 06:41:40.979472 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:41:40.979445    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050997c1_0dec_491c_8091_23562463b709.slice/crio-c1b2d9e5610b482c0cf0f95ea86049b07673dc8d80df436d8a4cc0b42576adaa WatchSource:0}: Error finding container c1b2d9e5610b482c0cf0f95ea86049b07673dc8d80df436d8a4cc0b42576adaa: Status 404 returned error can't find the container with id c1b2d9e5610b482c0cf0f95ea86049b07673dc8d80df436d8a4cc0b42576adaa
Sep 05 06:41:41.135114 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:41.135079    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk" event={"ID":"050997c1-0dec-491c-8091-23562463b709","Type":"ContainerStarted","Data":"c1b2d9e5610b482c0cf0f95ea86049b07673dc8d80df436d8a4cc0b42576adaa"}
Sep 05 06:41:44.152816 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:44.152779    2583 generic.go:356] "Generic (PLEG): container finished" podID="050997c1-0dec-491c-8091-23562463b709" containerID="d9ad92a21a62f1c3bc836857739cc9b420f2d74a5a44a4c1d087bd091dd946c5" exitCode=0
Sep 05 06:41:44.153243 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:44.152835    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk" event={"ID":"050997c1-0dec-491c-8091-23562463b709","Type":"ContainerDied","Data":"d9ad92a21a62f1c3bc836857739cc9b420f2d74a5a44a4c1d087bd091dd946c5"}
Sep 05 06:41:45.169582 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:45.169546    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:41:45.301621 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:45.301596    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk"
Sep 05 06:41:45.458178 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:45.458147    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/050997c1-0dec-491c-8091-23562463b709-maas-api-service-ca\") pod \"050997c1-0dec-491c-8091-23562463b709\" (UID: \"050997c1-0dec-491c-8091-23562463b709\") "
Sep 05 06:41:45.458494 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:45.458470    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/050997c1-0dec-491c-8091-23562463b709-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "050997c1-0dec-491c-8091-23562463b709" (UID: "050997c1-0dec-491c-8091-23562463b709"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:41:45.559279 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:45.559247    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/050997c1-0dec-491c-8091-23562463b709-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:45.974624 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:45.974589    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:45.974809 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:45.974642    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:45.987224 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:45.987196    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:46.163742 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:46.163714    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk"
Sep 05 06:41:46.163742 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:46.163727    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk" event={"ID":"050997c1-0dec-491c-8091-23562463b709","Type":"ContainerDied","Data":"c1b2d9e5610b482c0cf0f95ea86049b07673dc8d80df436d8a4cc0b42576adaa"}
Sep 05 06:41:46.163988 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:46.163774    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1b2d9e5610b482c0cf0f95ea86049b07673dc8d80df436d8a4cc0b42576adaa"
Sep 05 06:41:46.175999 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:46.175976    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:41:48.887215 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:48.887178    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:49.838823 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:49.838785    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:50.480985 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.480955    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:50.511451 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.511418    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"]
Sep 05 06:41:50.511715 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.511685    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f" podUID="1d18710f-e6b9-4779-9a5f-d0854341658e" containerName="payload-processing" containerID="cri-o://48718f43bb5e49c3c75e27b5ec0c73d4085e9c335720ed58e402c0fd5fd28271" gracePeriod=30
Sep 05 06:41:50.520323 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.520210    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"]
Sep 05 06:41:50.520465 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.520414    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7" podUID="381ef0cb-36f4-4f74-b7b0-1c35e0b3e939" containerName="payload-pre-processing" containerID="cri-o://b3d924122ceb5e07a04722da59070eebc8e396255ea21be7f04d63c0e1013a1d" gracePeriod=30
Sep 05 06:41:50.558197 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.558169    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:50.638688 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.638661    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:50.721149 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.721124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:50.795138 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.795109    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"
Sep 05 06:41:50.795297 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.795210    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:50.798321 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.798286    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"
Sep 05 06:41:50.904739 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.904701    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq2vf\" (UniqueName: \"kubernetes.io/projected/381ef0cb-36f4-4f74-b7b0-1c35e0b3e939-kube-api-access-xq2vf\") pod \"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939\" (UID: \"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939\") "
Sep 05 06:41:50.904739 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.904742    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d18710f-e6b9-4779-9a5f-d0854341658e-plugins-config-volume\") pod \"1d18710f-e6b9-4779-9a5f-d0854341658e\" (UID: \"1d18710f-e6b9-4779-9a5f-d0854341658e\") "
Sep 05 06:41:50.905031 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.904771    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtbtf\" (UniqueName: \"kubernetes.io/projected/1d18710f-e6b9-4779-9a5f-d0854341658e-kube-api-access-xtbtf\") pod \"1d18710f-e6b9-4779-9a5f-d0854341658e\" (UID: \"1d18710f-e6b9-4779-9a5f-d0854341658e\") "
Sep 05 06:41:50.905031 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.904834    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/381ef0cb-36f4-4f74-b7b0-1c35e0b3e939-plugins-config-volume\") pod \"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939\" (UID: \"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939\") "
Sep 05 06:41:50.905275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.905243    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d18710f-e6b9-4779-9a5f-d0854341658e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d18710f-e6b9-4779-9a5f-d0854341658e" (UID: "1d18710f-e6b9-4779-9a5f-d0854341658e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:41:50.905366 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.905271    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/381ef0cb-36f4-4f74-b7b0-1c35e0b3e939-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "381ef0cb-36f4-4f74-b7b0-1c35e0b3e939" (UID: "381ef0cb-36f4-4f74-b7b0-1c35e0b3e939"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:41:50.906963 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.906940    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/381ef0cb-36f4-4f74-b7b0-1c35e0b3e939-kube-api-access-xq2vf" (OuterVolumeSpecName: "kube-api-access-xq2vf") pod "381ef0cb-36f4-4f74-b7b0-1c35e0b3e939" (UID: "381ef0cb-36f4-4f74-b7b0-1c35e0b3e939"). InnerVolumeSpecName "kube-api-access-xq2vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:41:50.907315 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:50.907294    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d18710f-e6b9-4779-9a5f-d0854341658e-kube-api-access-xtbtf" (OuterVolumeSpecName: "kube-api-access-xtbtf") pod "1d18710f-e6b9-4779-9a5f-d0854341658e" (UID: "1d18710f-e6b9-4779-9a5f-d0854341658e"). InnerVolumeSpecName "kube-api-access-xtbtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:41:51.006486 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.006454    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq2vf\" (UniqueName: \"kubernetes.io/projected/381ef0cb-36f4-4f74-b7b0-1c35e0b3e939-kube-api-access-xq2vf\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:51.006486 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.006486    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d18710f-e6b9-4779-9a5f-d0854341658e-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:51.006691 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.006571    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtbtf\" (UniqueName: \"kubernetes.io/projected/1d18710f-e6b9-4779-9a5f-d0854341658e-kube-api-access-xtbtf\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:51.006691 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.006587    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/381ef0cb-36f4-4f74-b7b0-1c35e0b3e939-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:51.081058 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.080975    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:51.197372 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.197317    2583 generic.go:356] "Generic (PLEG): container finished" podID="1d18710f-e6b9-4779-9a5f-d0854341658e" containerID="48718f43bb5e49c3c75e27b5ec0c73d4085e9c335720ed58e402c0fd5fd28271" exitCode=0
Sep 05 06:41:51.197372 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.197365    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"
Sep 05 06:41:51.197613 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.197405    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f" event={"ID":"1d18710f-e6b9-4779-9a5f-d0854341658e","Type":"ContainerDied","Data":"48718f43bb5e49c3c75e27b5ec0c73d4085e9c335720ed58e402c0fd5fd28271"}
Sep 05 06:41:51.197744 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.197510    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f" event={"ID":"1d18710f-e6b9-4779-9a5f-d0854341658e","Type":"ContainerDied","Data":"c5535f42fa542e993922503318038aff35a9fc6067f71bd64b01283dd36340a4"}
Sep 05 06:41:51.197821 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.197589    2583 scope.go:117] "RemoveContainer" containerID="48718f43bb5e49c3c75e27b5ec0c73d4085e9c335720ed58e402c0fd5fd28271"
Sep 05 06:41:51.199390 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.199368    2583 generic.go:356] "Generic (PLEG): container finished" podID="381ef0cb-36f4-4f74-b7b0-1c35e0b3e939" containerID="b3d924122ceb5e07a04722da59070eebc8e396255ea21be7f04d63c0e1013a1d" exitCode=0
Sep 05 06:41:51.199514 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.199421    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"
Sep 05 06:41:51.199514 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.199492    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7" event={"ID":"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939","Type":"ContainerDied","Data":"b3d924122ceb5e07a04722da59070eebc8e396255ea21be7f04d63c0e1013a1d"}
Sep 05 06:41:51.199636 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.199534    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7" event={"ID":"381ef0cb-36f4-4f74-b7b0-1c35e0b3e939","Type":"ContainerDied","Data":"fd0a5953561a145dd93047c7e879ddc74c5c2933c10ffb264f841687dc16d677"}
Sep 05 06:41:51.208205 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.208189    2583 scope.go:117] "RemoveContainer" containerID="48718f43bb5e49c3c75e27b5ec0c73d4085e9c335720ed58e402c0fd5fd28271"
Sep 05 06:41:51.208495 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:41:51.208473    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48718f43bb5e49c3c75e27b5ec0c73d4085e9c335720ed58e402c0fd5fd28271\": container with ID starting with 48718f43bb5e49c3c75e27b5ec0c73d4085e9c335720ed58e402c0fd5fd28271 not found: ID does not exist" containerID="48718f43bb5e49c3c75e27b5ec0c73d4085e9c335720ed58e402c0fd5fd28271"
Sep 05 06:41:51.208572 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.208507    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48718f43bb5e49c3c75e27b5ec0c73d4085e9c335720ed58e402c0fd5fd28271"} err="failed to get container status \"48718f43bb5e49c3c75e27b5ec0c73d4085e9c335720ed58e402c0fd5fd28271\": rpc error: code = NotFound desc = could not find container \"48718f43bb5e49c3c75e27b5ec0c73d4085e9c335720ed58e402c0fd5fd28271\": container with ID starting with 48718f43bb5e49c3c75e27b5ec0c73d4085e9c335720ed58e402c0fd5fd28271 not found: ID does not exist"
Sep 05 06:41:51.208572 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.208530    2583 scope.go:117] "RemoveContainer" containerID="b3d924122ceb5e07a04722da59070eebc8e396255ea21be7f04d63c0e1013a1d"
Sep 05 06:41:51.216581 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.216565    2583 scope.go:117] "RemoveContainer" containerID="b3d924122ceb5e07a04722da59070eebc8e396255ea21be7f04d63c0e1013a1d"
Sep 05 06:41:51.216822 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:41:51.216806    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3d924122ceb5e07a04722da59070eebc8e396255ea21be7f04d63c0e1013a1d\": container with ID starting with b3d924122ceb5e07a04722da59070eebc8e396255ea21be7f04d63c0e1013a1d not found: ID does not exist" containerID="b3d924122ceb5e07a04722da59070eebc8e396255ea21be7f04d63c0e1013a1d"
Sep 05 06:41:51.216884 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.216828    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3d924122ceb5e07a04722da59070eebc8e396255ea21be7f04d63c0e1013a1d"} err="failed to get container status \"b3d924122ceb5e07a04722da59070eebc8e396255ea21be7f04d63c0e1013a1d\": rpc error: code = NotFound desc = could not find container \"b3d924122ceb5e07a04722da59070eebc8e396255ea21be7f04d63c0e1013a1d\": container with ID starting with b3d924122ceb5e07a04722da59070eebc8e396255ea21be7f04d63c0e1013a1d not found: ID does not exist"
Sep 05 06:41:51.220373 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.220354    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"]
Sep 05 06:41:51.225295 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.225267    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f"]
Sep 05 06:41:51.238070 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.238051    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"]
Sep 05 06:41:51.247026 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:51.247002    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7"]
Sep 05 06:41:52.915991 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:52.915953    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d18710f-e6b9-4779-9a5f-d0854341658e" path="/var/lib/kubelet/pods/1d18710f-e6b9-4779-9a5f-d0854341658e/volumes"
Sep 05 06:41:52.916399 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:52.916383    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="381ef0cb-36f4-4f74-b7b0-1c35e0b3e939" path="/var/lib/kubelet/pods/381ef0cb-36f4-4f74-b7b0-1c35e0b3e939/volumes"
Sep 05 06:41:54.421231 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.421192    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr" podUID="f3b0e60a-89a5-4969-8ccb-1179f301916a" containerName="main" containerID="cri-o://ec5fcc41bfe14052cdee69914e0130cd764eeb926916fb1fd0f497164ed169ed" gracePeriod=45
Sep 05 06:41:54.675005 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.674942    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:54.838402 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.838370    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-model-cache\") pod \"f3b0e60a-89a5-4969-8ccb-1179f301916a\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") "
Sep 05 06:41:54.838584 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.838450    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-tmp-dir\") pod \"f3b0e60a-89a5-4969-8ccb-1179f301916a\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") "
Sep 05 06:41:54.838584 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.838507    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-home\") pod \"f3b0e60a-89a5-4969-8ccb-1179f301916a\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") "
Sep 05 06:41:54.838584 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.838566    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b0e60a-89a5-4969-8ccb-1179f301916a-tls-certs\") pod \"f3b0e60a-89a5-4969-8ccb-1179f301916a\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") "
Sep 05 06:41:54.838750 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.838605    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-dshm\") pod \"f3b0e60a-89a5-4969-8ccb-1179f301916a\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") "
Sep 05 06:41:54.838750 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.838631    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpnfl\" (UniqueName: \"kubernetes.io/projected/f3b0e60a-89a5-4969-8ccb-1179f301916a-kube-api-access-kpnfl\") pod \"f3b0e60a-89a5-4969-8ccb-1179f301916a\" (UID: \"f3b0e60a-89a5-4969-8ccb-1179f301916a\") "
Sep 05 06:41:54.838750 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.838668    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f3b0e60a-89a5-4969-8ccb-1179f301916a" (UID: "f3b0e60a-89a5-4969-8ccb-1179f301916a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:41:54.838750 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.838687    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-model-cache" (OuterVolumeSpecName: "model-cache") pod "f3b0e60a-89a5-4969-8ccb-1179f301916a" (UID: "f3b0e60a-89a5-4969-8ccb-1179f301916a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:41:54.839016 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.838792    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-home" (OuterVolumeSpecName: "home") pod "f3b0e60a-89a5-4969-8ccb-1179f301916a" (UID: "f3b0e60a-89a5-4969-8ccb-1179f301916a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:41:54.839016 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.838944    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:54.839016 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.838964    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:54.839016 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.838980    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:54.840823 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.840802    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-dshm" (OuterVolumeSpecName: "dshm") pod "f3b0e60a-89a5-4969-8ccb-1179f301916a" (UID: "f3b0e60a-89a5-4969-8ccb-1179f301916a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:41:54.840908 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.840806    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3b0e60a-89a5-4969-8ccb-1179f301916a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f3b0e60a-89a5-4969-8ccb-1179f301916a" (UID: "f3b0e60a-89a5-4969-8ccb-1179f301916a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:41:54.840962 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.840922    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b0e60a-89a5-4969-8ccb-1179f301916a-kube-api-access-kpnfl" (OuterVolumeSpecName: "kube-api-access-kpnfl") pod "f3b0e60a-89a5-4969-8ccb-1179f301916a" (UID: "f3b0e60a-89a5-4969-8ccb-1179f301916a"). InnerVolumeSpecName "kube-api-access-kpnfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:41:54.939416 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.939350    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b0e60a-89a5-4969-8ccb-1179f301916a-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:54.939416 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.939379    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b0e60a-89a5-4969-8ccb-1179f301916a-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:54.939416 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:54.939392    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpnfl\" (UniqueName: \"kubernetes.io/projected/f3b0e60a-89a5-4969-8ccb-1179f301916a-kube-api-access-kpnfl\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:55.223523 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:55.223490    2583 generic.go:356] "Generic (PLEG): container finished" podID="f3b0e60a-89a5-4969-8ccb-1179f301916a" containerID="ec5fcc41bfe14052cdee69914e0130cd764eeb926916fb1fd0f497164ed169ed" exitCode=0
Sep 05 06:41:55.223691 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:55.223539    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"
Sep 05 06:41:55.223691 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:55.223570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr" event={"ID":"f3b0e60a-89a5-4969-8ccb-1179f301916a","Type":"ContainerDied","Data":"ec5fcc41bfe14052cdee69914e0130cd764eeb926916fb1fd0f497164ed169ed"}
Sep 05 06:41:55.223691 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:55.223614    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr" event={"ID":"f3b0e60a-89a5-4969-8ccb-1179f301916a","Type":"ContainerDied","Data":"7295c075cf9db2d3d214895d9da20d05da716c253a57b25dd1eae7884cdc460b"}
Sep 05 06:41:55.223691 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:55.223636    2583 scope.go:117] "RemoveContainer" containerID="ec5fcc41bfe14052cdee69914e0130cd764eeb926916fb1fd0f497164ed169ed"
Sep 05 06:41:55.231972 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:55.231951    2583 scope.go:117] "RemoveContainer" containerID="ec5fcc41bfe14052cdee69914e0130cd764eeb926916fb1fd0f497164ed169ed"
Sep 05 06:41:55.232267 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:41:55.232239    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec5fcc41bfe14052cdee69914e0130cd764eeb926916fb1fd0f497164ed169ed\": container with ID starting with ec5fcc41bfe14052cdee69914e0130cd764eeb926916fb1fd0f497164ed169ed not found: ID does not exist" containerID="ec5fcc41bfe14052cdee69914e0130cd764eeb926916fb1fd0f497164ed169ed"
Sep 05 06:41:55.232372 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:55.232267    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec5fcc41bfe14052cdee69914e0130cd764eeb926916fb1fd0f497164ed169ed"} err="failed to get container status \"ec5fcc41bfe14052cdee69914e0130cd764eeb926916fb1fd0f497164ed169ed\": rpc error: code = NotFound desc = could not find container \"ec5fcc41bfe14052cdee69914e0130cd764eeb926916fb1fd0f497164ed169ed\": container with ID starting with ec5fcc41bfe14052cdee69914e0130cd764eeb926916fb1fd0f497164ed169ed not found: ID does not exist"
Sep 05 06:41:55.247807 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:55.247780    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"]
Sep 05 06:41:55.254674 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:55.254651    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-e04a57/autores-model-e04a57-kserve-669b897999-mgslr"]
Sep 05 06:41:55.977213 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:55.977175    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:56.637128 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.637097    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:56.666372 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.666337    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"]
Sep 05 06:41:56.666612 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.666581    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq" podUID="30cc2b03-6a67-46a1-803a-0745524cac0d" containerName="payload-processing" containerID="cri-o://6d3de7764c3c977bcb7325be71b97fe90e260a7abcb4cc8ab061e2fa5ce674dd" gracePeriod=30
Sep 05 06:41:56.734637 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.734608    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:56.834802 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.834772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:56.904096 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.904015    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk"]
Sep 05 06:41:56.913080 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.911065    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea7120c2-dc2vk"]
Sep 05 06:41:56.917872 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.917835    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:56.920829 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.920804    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="050997c1-0dec-491c-8091-23562463b709" path="/var/lib/kubelet/pods/050997c1-0dec-491c-8091-23562463b709/volumes"
Sep 05 06:41:56.921210 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.921197    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3b0e60a-89a5-4969-8ccb-1179f301916a" path="/var/lib/kubelet/pods/f3b0e60a-89a5-4969-8ccb-1179f301916a/volumes"
Sep 05 06:41:56.929999 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.929981    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"
Sep 05 06:41:56.955506 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.955477    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7trrq\" (UniqueName: \"kubernetes.io/projected/30cc2b03-6a67-46a1-803a-0745524cac0d-kube-api-access-7trrq\") pod \"30cc2b03-6a67-46a1-803a-0745524cac0d\" (UID: \"30cc2b03-6a67-46a1-803a-0745524cac0d\") "
Sep 05 06:41:56.955673 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.955525    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30cc2b03-6a67-46a1-803a-0745524cac0d-plugins-config-volume\") pod \"30cc2b03-6a67-46a1-803a-0745524cac0d\" (UID: \"30cc2b03-6a67-46a1-803a-0745524cac0d\") "
Sep 05 06:41:56.955932 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.955907    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30cc2b03-6a67-46a1-803a-0745524cac0d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "30cc2b03-6a67-46a1-803a-0745524cac0d" (UID: "30cc2b03-6a67-46a1-803a-0745524cac0d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:41:56.957506 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:56.957485    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30cc2b03-6a67-46a1-803a-0745524cac0d-kube-api-access-7trrq" (OuterVolumeSpecName: "kube-api-access-7trrq") pod "30cc2b03-6a67-46a1-803a-0745524cac0d" (UID: "30cc2b03-6a67-46a1-803a-0745524cac0d"). InnerVolumeSpecName "kube-api-access-7trrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:41:57.056046 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.056016    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30cc2b03-6a67-46a1-803a-0745524cac0d-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:57.056046 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.056042    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7trrq\" (UniqueName: \"kubernetes.io/projected/30cc2b03-6a67-46a1-803a-0745524cac0d-kube-api-access-7trrq\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:41:57.066339 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.066312    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:57.236263 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.236229    2583 generic.go:356] "Generic (PLEG): container finished" podID="30cc2b03-6a67-46a1-803a-0745524cac0d" containerID="6d3de7764c3c977bcb7325be71b97fe90e260a7abcb4cc8ab061e2fa5ce674dd" exitCode=0
Sep 05 06:41:57.236422 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.236284    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"
Sep 05 06:41:57.236422 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.236317    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq" event={"ID":"30cc2b03-6a67-46a1-803a-0745524cac0d","Type":"ContainerDied","Data":"6d3de7764c3c977bcb7325be71b97fe90e260a7abcb4cc8ab061e2fa5ce674dd"}
Sep 05 06:41:57.236422 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.236370    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq" event={"ID":"30cc2b03-6a67-46a1-803a-0745524cac0d","Type":"ContainerDied","Data":"ffe91eb5839034394d9c085bfcc172304857d7dc903b40b94e22641a9390fb17"}
Sep 05 06:41:57.236422 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.236392    2583 scope.go:117] "RemoveContainer" containerID="6d3de7764c3c977bcb7325be71b97fe90e260a7abcb4cc8ab061e2fa5ce674dd"
Sep 05 06:41:57.245014 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.244995    2583 scope.go:117] "RemoveContainer" containerID="6d3de7764c3c977bcb7325be71b97fe90e260a7abcb4cc8ab061e2fa5ce674dd"
Sep 05 06:41:57.245291 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:41:57.245273    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d3de7764c3c977bcb7325be71b97fe90e260a7abcb4cc8ab061e2fa5ce674dd\": container with ID starting with 6d3de7764c3c977bcb7325be71b97fe90e260a7abcb4cc8ab061e2fa5ce674dd not found: ID does not exist" containerID="6d3de7764c3c977bcb7325be71b97fe90e260a7abcb4cc8ab061e2fa5ce674dd"
Sep 05 06:41:57.245369 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.245298    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d3de7764c3c977bcb7325be71b97fe90e260a7abcb4cc8ab061e2fa5ce674dd"} err="failed to get container status \"6d3de7764c3c977bcb7325be71b97fe90e260a7abcb4cc8ab061e2fa5ce674dd\": rpc error: code = NotFound desc = could not find container \"6d3de7764c3c977bcb7325be71b97fe90e260a7abcb4cc8ab061e2fa5ce674dd\": container with ID starting with 6d3de7764c3c977bcb7325be71b97fe90e260a7abcb4cc8ab061e2fa5ce674dd not found: ID does not exist"
Sep 05 06:41:57.258575 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.258540    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"]
Sep 05 06:41:57.262652 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.262632    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq"]
Sep 05 06:41:57.509952 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.509848    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:57.857669 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:57.857579    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:58.291543 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:58.291509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:58.393507 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:58.393475    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:58.496477 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:58.496441    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:58.646033 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:58.645934    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:58.915066 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:58.914982    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30cc2b03-6a67-46a1-803a-0745524cac0d" path="/var/lib/kubelet/pods/30cc2b03-6a67-46a1-803a-0745524cac0d/volumes"
Sep 05 06:41:59.008942 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:59.008909    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:59.328273 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:59.328241    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:41:59.798014 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:41:59.797972    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:00.726023 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:00.725977    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:00.827210 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:00.827169    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:01.894033 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:01.893992    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:01.961746 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:01.961712    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:02.062632 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.062598    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:02.179207 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.179111    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:02.278354 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.278302    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:02.492278 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.492243    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:02.590882 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.590825    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:02.624528 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.624500    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"]
Sep 05 06:42:02.624856 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.624844    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d18710f-e6b9-4779-9a5f-d0854341658e" containerName="payload-processing"
Sep 05 06:42:02.624936 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.624883    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d18710f-e6b9-4779-9a5f-d0854341658e" containerName="payload-processing"
Sep 05 06:42:02.624936 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.624896    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30cc2b03-6a67-46a1-803a-0745524cac0d" containerName="payload-processing"
Sep 05 06:42:02.624936 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.624903    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="30cc2b03-6a67-46a1-803a-0745524cac0d" containerName="payload-processing"
Sep 05 06:42:02.624936 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.624917    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381ef0cb-36f4-4f74-b7b0-1c35e0b3e939" containerName="payload-pre-processing"
Sep 05 06:42:02.624936 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.624924    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="381ef0cb-36f4-4f74-b7b0-1c35e0b3e939" containerName="payload-pre-processing"
Sep 05 06:42:02.624936 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.624932    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b0e60a-89a5-4969-8ccb-1179f301916a" containerName="main"
Sep 05 06:42:02.624936 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.624937    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b0e60a-89a5-4969-8ccb-1179f301916a" containerName="main"
Sep 05 06:42:02.625171 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.624945    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="050997c1-0dec-491c-8091-23562463b709" containerName="revoke-keys"
Sep 05 06:42:02.625171 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.624950    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="050997c1-0dec-491c-8091-23562463b709" containerName="revoke-keys"
Sep 05 06:42:02.625171 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.625014    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="381ef0cb-36f4-4f74-b7b0-1c35e0b3e939" containerName="payload-pre-processing"
Sep 05 06:42:02.625171 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.625021    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="30cc2b03-6a67-46a1-803a-0745524cac0d" containerName="payload-processing"
Sep 05 06:42:02.625171 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.625028    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b0e60a-89a5-4969-8ccb-1179f301916a" containerName="main"
Sep 05 06:42:02.625171 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.625034    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="050997c1-0dec-491c-8091-23562463b709" containerName="revoke-keys"
Sep 05 06:42:02.625171 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.625040    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d18710f-e6b9-4779-9a5f-d0854341658e" containerName="payload-processing"
Sep 05 06:42:02.627907 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.627891    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"
Sep 05 06:42:02.630827 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.630791    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-46fa710a\""
Sep 05 06:42:02.631195 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.631178    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-46fa710a-dockercfg-dfh7n\""
Sep 05 06:42:02.642978 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.642957    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"]
Sep 05 06:42:02.692680 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.692655    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7d79\" (UniqueName: \"kubernetes.io/projected/3dd238f1-387d-45c3-b805-42c6e08ad5e9-kube-api-access-x7d79\") pod \"payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b\" (UID: \"3dd238f1-387d-45c3-b805-42c6e08ad5e9\") " pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"
Sep 05 06:42:02.692824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.692731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dd238f1-387d-45c3-b805-42c6e08ad5e9-plugins-config-volume\") pod \"payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b\" (UID: \"3dd238f1-387d-45c3-b805-42c6e08ad5e9\") " pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"
Sep 05 06:42:02.793263 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.793181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7d79\" (UniqueName: \"kubernetes.io/projected/3dd238f1-387d-45c3-b805-42c6e08ad5e9-kube-api-access-x7d79\") pod \"payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b\" (UID: \"3dd238f1-387d-45c3-b805-42c6e08ad5e9\") " pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"
Sep 05 06:42:02.793263 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.793262    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dd238f1-387d-45c3-b805-42c6e08ad5e9-plugins-config-volume\") pod \"payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b\" (UID: \"3dd238f1-387d-45c3-b805-42c6e08ad5e9\") " pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"
Sep 05 06:42:02.795929 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.795900    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-46fa710a\""
Sep 05 06:42:02.802288 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.802261    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7d79\" (UniqueName: \"kubernetes.io/projected/3dd238f1-387d-45c3-b805-42c6e08ad5e9-kube-api-access-x7d79\") pod \"payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b\" (UID: \"3dd238f1-387d-45c3-b805-42c6e08ad5e9\") " pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"
Sep 05 06:42:02.804688 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.804663    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dd238f1-387d-45c3-b805-42c6e08ad5e9-plugins-config-volume\") pod \"payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b\" (UID: \"3dd238f1-387d-45c3-b805-42c6e08ad5e9\") " pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"
Sep 05 06:42:02.941243 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.941214    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-46fa710a-dockercfg-dfh7n\""
Sep 05 06:42:02.948449 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:02.948432    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"
Sep 05 06:42:03.234385 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:03.234356    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"]
Sep 05 06:42:03.235983 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:42:03.235960    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd238f1_387d_45c3_b805_42c6e08ad5e9.slice/crio-d890526cbc1f257e8a00bbb88b5e4b5a69edaafe20e0cd206efde0dc30ef9a67 WatchSource:0}: Error finding container d890526cbc1f257e8a00bbb88b5e4b5a69edaafe20e0cd206efde0dc30ef9a67: Status 404 returned error can't find the container with id d890526cbc1f257e8a00bbb88b5e4b5a69edaafe20e0cd206efde0dc30ef9a67
Sep 05 06:42:03.270104 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:03.270078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b" event={"ID":"3dd238f1-387d-45c3-b805-42c6e08ad5e9","Type":"ContainerStarted","Data":"d890526cbc1f257e8a00bbb88b5e4b5a69edaafe20e0cd206efde0dc30ef9a67"}
Sep 05 06:42:03.715978 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:03.715941    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:03.821337 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:03.821274    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:04.277237 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.277198    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b" event={"ID":"3dd238f1-387d-45c3-b805-42c6e08ad5e9","Type":"ContainerStarted","Data":"c9cba21c32eab0e00b089ee9d955a682a66158b5c4ea9b69f12a13727d255f22"}
Sep 05 06:42:04.277757 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.277361    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"
Sep 05 06:42:04.303293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.303242    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b" podStartSLOduration=2.303225024 podStartE2EDuration="2.303225024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:42:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:42:04.302127982 +0000 UTC m=+1021.906676823" watchObservedRunningTime="2026-09-05 06:42:04.303225024 +0000 UTC m=+1021.907773880"
Sep 05 06:42:04.327913 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.325411    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:04.425632 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.425593    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:04.445399 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.445370    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"]
Sep 05 06:42:04.449201 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.449181    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"
Sep 05 06:42:04.452553 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.452529    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-a092eb-dockercfg-d8rnj\""
Sep 05 06:42:04.452553 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.452529    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-a092eb\""
Sep 05 06:42:04.463442 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.463421    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"]
Sep 05 06:42:04.505157 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.505126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc51fe9f-4e04-4ca3-b2d3-00027ac77081-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x\" (UID: \"cc51fe9f-4e04-4ca3-b2d3-00027ac77081\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"
Sep 05 06:42:04.505294 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.505163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrrtf\" (UniqueName: \"kubernetes.io/projected/cc51fe9f-4e04-4ca3-b2d3-00027ac77081-kube-api-access-lrrtf\") pod \"payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x\" (UID: \"cc51fe9f-4e04-4ca3-b2d3-00027ac77081\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"
Sep 05 06:42:04.606344 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.606258    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc51fe9f-4e04-4ca3-b2d3-00027ac77081-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x\" (UID: \"cc51fe9f-4e04-4ca3-b2d3-00027ac77081\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"
Sep 05 06:42:04.606344 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.606305    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrrtf\" (UniqueName: \"kubernetes.io/projected/cc51fe9f-4e04-4ca3-b2d3-00027ac77081-kube-api-access-lrrtf\") pod \"payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x\" (UID: \"cc51fe9f-4e04-4ca3-b2d3-00027ac77081\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"
Sep 05 06:42:04.606982 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.606964    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc51fe9f-4e04-4ca3-b2d3-00027ac77081-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x\" (UID: \"cc51fe9f-4e04-4ca3-b2d3-00027ac77081\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"
Sep 05 06:42:04.615618 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.615596    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrrtf\" (UniqueName: \"kubernetes.io/projected/cc51fe9f-4e04-4ca3-b2d3-00027ac77081-kube-api-access-lrrtf\") pod \"payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x\" (UID: \"cc51fe9f-4e04-4ca3-b2d3-00027ac77081\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"
Sep 05 06:42:04.760142 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:04.760112    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"
Sep 05 06:42:05.033324 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:05.033301    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"]
Sep 05 06:42:05.035282 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:42:05.035252    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc51fe9f_4e04_4ca3_b2d3_00027ac77081.slice/crio-4374861778cb0cf1152d496ff997d50aa37604954f332386406455e15f0f19e8 WatchSource:0}: Error finding container 4374861778cb0cf1152d496ff997d50aa37604954f332386406455e15f0f19e8: Status 404 returned error can't find the container with id 4374861778cb0cf1152d496ff997d50aa37604954f332386406455e15f0f19e8
Sep 05 06:42:05.283845 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:05.283747    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x" event={"ID":"cc51fe9f-4e04-4ca3-b2d3-00027ac77081","Type":"ContainerStarted","Data":"76597c658190779ff79aa60f34fc21d2b83f09f4da335fe13a3d592515e51243"}
Sep 05 06:42:05.283845 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:05.283814    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x" event={"ID":"cc51fe9f-4e04-4ca3-b2d3-00027ac77081","Type":"ContainerStarted","Data":"4374861778cb0cf1152d496ff997d50aa37604954f332386406455e15f0f19e8"}
Sep 05 06:42:05.284271 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:05.283964    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"
Sep 05 06:42:05.302190 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:05.302137    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x" podStartSLOduration=1.302118562 podStartE2EDuration="1.302118562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:42:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:42:05.301181427 +0000 UTC m=+1022.905730265" watchObservedRunningTime="2026-09-05 06:42:05.302118562 +0000 UTC m=+1022.906667407"
Sep 05 06:42:05.853140 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:05.853106    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:42:15.285553 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:15.285517    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"
Sep 05 06:42:16.290670 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:16.290637    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"
Sep 05 06:42:18.569964 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:18.569924    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:22.940116 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:22.940087    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:24.889581 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:24.889553    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:25.755355 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:25.755319    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:42:26.797237 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:26.797206    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:28.228113 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:28.228082    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:29.976280 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:29.976247    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:32.729749 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:32.729708    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:32.765016 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:32.764981    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"]
Sep 05 06:42:32.765314 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:32.765286    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b" podUID="3dd238f1-387d-45c3-b805-42c6e08ad5e9" containerName="payload-processing" containerID="cri-o://c9cba21c32eab0e00b089ee9d955a682a66158b5c4ea9b69f12a13727d255f22" gracePeriod=30
Sep 05 06:42:32.813454 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:32.813420    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:32.886550 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:32.886522    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:32.986597 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:32.986511    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:33.021576 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.021554    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"
Sep 05 06:42:33.090137 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.090101    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:33.139314 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.139276    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7d79\" (UniqueName: \"kubernetes.io/projected/3dd238f1-387d-45c3-b805-42c6e08ad5e9-kube-api-access-x7d79\") pod \"3dd238f1-387d-45c3-b805-42c6e08ad5e9\" (UID: \"3dd238f1-387d-45c3-b805-42c6e08ad5e9\") "
Sep 05 06:42:33.139473 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.139355    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dd238f1-387d-45c3-b805-42c6e08ad5e9-plugins-config-volume\") pod \"3dd238f1-387d-45c3-b805-42c6e08ad5e9\" (UID: \"3dd238f1-387d-45c3-b805-42c6e08ad5e9\") "
Sep 05 06:42:33.139717 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.139695    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dd238f1-387d-45c3-b805-42c6e08ad5e9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3dd238f1-387d-45c3-b805-42c6e08ad5e9" (UID: "3dd238f1-387d-45c3-b805-42c6e08ad5e9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:42:33.141379 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.141355    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dd238f1-387d-45c3-b805-42c6e08ad5e9-kube-api-access-x7d79" (OuterVolumeSpecName: "kube-api-access-x7d79") pod "3dd238f1-387d-45c3-b805-42c6e08ad5e9" (UID: "3dd238f1-387d-45c3-b805-42c6e08ad5e9"). InnerVolumeSpecName "kube-api-access-x7d79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:42:33.240612 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.240535    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7d79\" (UniqueName: \"kubernetes.io/projected/3dd238f1-387d-45c3-b805-42c6e08ad5e9-kube-api-access-x7d79\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:42:33.240612 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.240563    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dd238f1-387d-45c3-b805-42c6e08ad5e9-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:42:33.428993 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.428959    2583 generic.go:356] "Generic (PLEG): container finished" podID="3dd238f1-387d-45c3-b805-42c6e08ad5e9" containerID="c9cba21c32eab0e00b089ee9d955a682a66158b5c4ea9b69f12a13727d255f22" exitCode=0
Sep 05 06:42:33.429194 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.429010    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b" event={"ID":"3dd238f1-387d-45c3-b805-42c6e08ad5e9","Type":"ContainerDied","Data":"c9cba21c32eab0e00b089ee9d955a682a66158b5c4ea9b69f12a13727d255f22"}
Sep 05 06:42:33.429194 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.429011    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"
Sep 05 06:42:33.429194 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.429051    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b" event={"ID":"3dd238f1-387d-45c3-b805-42c6e08ad5e9","Type":"ContainerDied","Data":"d890526cbc1f257e8a00bbb88b5e4b5a69edaafe20e0cd206efde0dc30ef9a67"}
Sep 05 06:42:33.429194 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.429074    2583 scope.go:117] "RemoveContainer" containerID="c9cba21c32eab0e00b089ee9d955a682a66158b5c4ea9b69f12a13727d255f22"
Sep 05 06:42:33.437904 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.437886    2583 scope.go:117] "RemoveContainer" containerID="c9cba21c32eab0e00b089ee9d955a682a66158b5c4ea9b69f12a13727d255f22"
Sep 05 06:42:33.438187 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:42:33.438167    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9cba21c32eab0e00b089ee9d955a682a66158b5c4ea9b69f12a13727d255f22\": container with ID starting with c9cba21c32eab0e00b089ee9d955a682a66158b5c4ea9b69f12a13727d255f22 not found: ID does not exist" containerID="c9cba21c32eab0e00b089ee9d955a682a66158b5c4ea9b69f12a13727d255f22"
Sep 05 06:42:33.438264 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.438199    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9cba21c32eab0e00b089ee9d955a682a66158b5c4ea9b69f12a13727d255f22"} err="failed to get container status \"c9cba21c32eab0e00b089ee9d955a682a66158b5c4ea9b69f12a13727d255f22\": rpc error: code = NotFound desc = could not find container \"c9cba21c32eab0e00b089ee9d955a682a66158b5c4ea9b69f12a13727d255f22\": container with ID starting with c9cba21c32eab0e00b089ee9d955a682a66158b5c4ea9b69f12a13727d255f22 not found: ID does not exist"
Sep 05 06:42:33.455010 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.454985    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"]
Sep 05 06:42:33.458339 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:33.458314    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b"]
Sep 05 06:42:34.180170 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:34.180138    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:34.645286 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:34.645254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:34.916116 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:34.916032    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dd238f1-387d-45c3-b805-42c6e08ad5e9" path="/var/lib/kubelet/pods/3dd238f1-387d-45c3-b805-42c6e08ad5e9/volumes"
Sep 05 06:42:34.960343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:34.960311    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:35.429439 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:35.429401    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:37.772088 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:37.772049    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:37.886908 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:37.886855    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:39.034981 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.034944    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:39.149455 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.149421    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:39.252343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.252299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:39.537757 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.537725    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:39.630325 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.630296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:39.643683 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.643655    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"]
Sep 05 06:42:39.644032 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.644019    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dd238f1-387d-45c3-b805-42c6e08ad5e9" containerName="payload-processing"
Sep 05 06:42:39.644080 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.644034    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd238f1-387d-45c3-b805-42c6e08ad5e9" containerName="payload-processing"
Sep 05 06:42:39.644117 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.644101    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dd238f1-387d-45c3-b805-42c6e08ad5e9" containerName="payload-processing"
Sep 05 06:42:39.648235 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.648219    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"
Sep 05 06:42:39.651037 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.651016    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-a40054de\""
Sep 05 06:42:39.651180 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.651077    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-a40054de-dockercfg-mdz7k\""
Sep 05 06:42:39.658960 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.658938    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"]
Sep 05 06:42:39.697043 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.697011    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvbqs\" (UniqueName: \"kubernetes.io/projected/9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3-kube-api-access-hvbqs\") pod \"payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87\" (UID: \"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"
Sep 05 06:42:39.697312 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.697281    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87\" (UID: \"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"
Sep 05 06:42:39.798351 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.798267    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvbqs\" (UniqueName: \"kubernetes.io/projected/9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3-kube-api-access-hvbqs\") pod \"payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87\" (UID: \"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"
Sep 05 06:42:39.798351 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.798325    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87\" (UID: \"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"
Sep 05 06:42:39.798956 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.798934    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87\" (UID: \"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"
Sep 05 06:42:39.807538 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.807506    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvbqs\" (UniqueName: \"kubernetes.io/projected/9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3-kube-api-access-hvbqs\") pod \"payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87\" (UID: \"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"
Sep 05 06:42:39.960309 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:39.960282    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"
Sep 05 06:42:40.230367 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:40.230338    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"]
Sep 05 06:42:40.232234 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:42:40.232207    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9592eca7_0b3a_4d0e_b8a8_02d723c3d3b3.slice/crio-af72b8bf923ccb0d52ad84c01d6ae4a7a3db442bbffb3863a4e6555ffb6a73ce WatchSource:0}: Error finding container af72b8bf923ccb0d52ad84c01d6ae4a7a3db442bbffb3863a4e6555ffb6a73ce: Status 404 returned error can't find the container with id af72b8bf923ccb0d52ad84c01d6ae4a7a3db442bbffb3863a4e6555ffb6a73ce
Sep 05 06:42:40.466159 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:40.466123    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87" event={"ID":"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3","Type":"ContainerStarted","Data":"17f1d84202e60b8dec01267afa1816823c7f097012c441a8a445ee6a4b0ba86e"}
Sep 05 06:42:40.466348 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:40.466181    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87" event={"ID":"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3","Type":"ContainerStarted","Data":"af72b8bf923ccb0d52ad84c01d6ae4a7a3db442bbffb3863a4e6555ffb6a73ce"}
Sep 05 06:42:40.466348 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:40.466205    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"
Sep 05 06:42:40.484910 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:40.484813    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87" podStartSLOduration=1.484800674 podStartE2EDuration="1.484800674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:42:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:42:40.482745419 +0000 UTC m=+1058.087294257" watchObservedRunningTime="2026-09-05 06:42:40.484800674 +0000 UTC m=+1058.089349511"
Sep 05 06:42:41.356816 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:41.356779    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:42:48.576031 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:48.576000    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:50.260909 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.260877    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"]
Sep 05 06:42:50.264446 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.264426    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.269087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.269068    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-a092eb\"/\"default-dockercfg-9qhd9\""
Sep 05 06:42:50.269087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.269088    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-a092eb\"/\"explicit-model-a092eb-kserve-self-signed-certs\""
Sep 05 06:42:50.269235 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.269101    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-a092eb\"/\"openshift-service-ca.crt\""
Sep 05 06:42:50.269235 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.269068    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-a092eb\"/\"kube-root-ca.crt\""
Sep 05 06:42:50.276122 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.276103    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"]
Sep 05 06:42:50.293882 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.293838    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:42:50.391395 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.391362    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-dshm\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.391395 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.391395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-home\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.391649 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.391630    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2q26\" (UniqueName: \"kubernetes.io/projected/391f7a17-6d78-4152-9da9-557fc5e41a01-kube-api-access-h2q26\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.391694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.391658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/391f7a17-6d78-4152-9da9-557fc5e41a01-tls-certs\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.391744 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.391699    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-model-cache\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.391744 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.391716    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-tmp-dir\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.493028 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.492987    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2q26\" (UniqueName: \"kubernetes.io/projected/391f7a17-6d78-4152-9da9-557fc5e41a01-kube-api-access-h2q26\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.493028 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.493026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/391f7a17-6d78-4152-9da9-557fc5e41a01-tls-certs\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.493273 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.493065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-model-cache\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.493273 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.493081    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-tmp-dir\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.493273 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.493104    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-dshm\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.493273 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.493123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-home\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.493527 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.493499    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-model-cache\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.493527 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.493521    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-home\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.493646 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.493591    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-tmp-dir\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.495985 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.495939    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-dshm\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.496330 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.496308    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/391f7a17-6d78-4152-9da9-557fc5e41a01-tls-certs\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.502996 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.502973    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2q26\" (UniqueName: \"kubernetes.io/projected/391f7a17-6d78-4152-9da9-557fc5e41a01-kube-api-access-h2q26\") pod \"explicit-model-a092eb-kserve-57578f6d75-8qvkk\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") " pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.573342 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.573266    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:42:50.847515 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:50.847487    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"]
Sep 05 06:42:50.849399 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:42:50.849375    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod391f7a17_6d78_4152_9da9_557fc5e41a01.slice/crio-f68c214c6fbdfcaac2b7adfc8d749f5212f5fe2b27d89dfa588fbbbea6595d63 WatchSource:0}: Error finding container f68c214c6fbdfcaac2b7adfc8d749f5212f5fe2b27d89dfa588fbbbea6595d63: Status 404 returned error can't find the container with id f68c214c6fbdfcaac2b7adfc8d749f5212f5fe2b27d89dfa588fbbbea6595d63
Sep 05 06:42:51.473249 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:51.473211    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"
Sep 05 06:42:51.528733 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:51.528695    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk" event={"ID":"391f7a17-6d78-4152-9da9-557fc5e41a01","Type":"ContainerStarted","Data":"a0e8ae6a381b563368474de75a43ac754f1409ff828d8b88b9883f5666b65d65"}
Sep 05 06:42:51.528939 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:51.528746    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk" event={"ID":"391f7a17-6d78-4152-9da9-557fc5e41a01","Type":"ContainerStarted","Data":"f68c214c6fbdfcaac2b7adfc8d749f5212f5fe2b27d89dfa588fbbbea6595d63"}
Sep 05 06:42:51.549161 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:51.549108    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk" podStartSLOduration=1.549089232 podStartE2EDuration="1.549089232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:42:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:42:51.547714415 +0000 UTC m=+1069.152263248" watchObservedRunningTime="2026-09-05 06:42:51.549089232 +0000 UTC m=+1069.153638071"
Sep 05 06:42:56.670119 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:42:56.670035    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:43:00.575956 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:00.575913    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:43:00.576537 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:00.576518    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:43:00.598084 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:00.598052    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:43:01.238375 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:01.238349    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:01.599929 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:01.599830    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:43:06.793035 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:06.792998    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"]
Sep 05 06:43:06.820649 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:06.820616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:07.113685 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:07.113598    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:09.206203 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:09.206167    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:09.822280 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:09.822243    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:09.863105 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:09.863069    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"]
Sep 05 06:43:09.863500 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:09.863442    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87" podUID="9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3" containerName="payload-pre-processing" containerID="cri-o://17f1d84202e60b8dec01267afa1816823c7f097012c441a8a445ee6a4b0ba86e" gracePeriod=30
Sep 05 06:43:09.905618 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:09.904680    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:10.005046 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.004967    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:10.076344 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.076268    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:10.115201 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.115176    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"
Sep 05 06:43:10.172549 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.172517    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvbqs\" (UniqueName: \"kubernetes.io/projected/9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3-kube-api-access-hvbqs\") pod \"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3\" (UID: \"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3\") "
Sep 05 06:43:10.172744 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.172569    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3-plugins-config-volume\") pod \"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3\" (UID: \"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3\") "
Sep 05 06:43:10.172984 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.172956    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3" (UID: "9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:43:10.174800 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.174773    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3-kube-api-access-hvbqs" (OuterVolumeSpecName: "kube-api-access-hvbqs") pod "9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3" (UID: "9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3"). InnerVolumeSpecName "kube-api-access-hvbqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:43:10.210970 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.210938    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:10.273806 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.273755    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvbqs\" (UniqueName: \"kubernetes.io/projected/9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3-kube-api-access-hvbqs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:43:10.273806 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.273796    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:43:10.635133 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.635093    2583 generic.go:356] "Generic (PLEG): container finished" podID="9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3" containerID="17f1d84202e60b8dec01267afa1816823c7f097012c441a8a445ee6a4b0ba86e" exitCode=0
Sep 05 06:43:10.635346 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.635140    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"
Sep 05 06:43:10.635346 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.635153    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87" event={"ID":"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3","Type":"ContainerDied","Data":"17f1d84202e60b8dec01267afa1816823c7f097012c441a8a445ee6a4b0ba86e"}
Sep 05 06:43:10.635346 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.635204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87" event={"ID":"9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3","Type":"ContainerDied","Data":"af72b8bf923ccb0d52ad84c01d6ae4a7a3db442bbffb3863a4e6555ffb6a73ce"}
Sep 05 06:43:10.635346 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.635225    2583 scope.go:117] "RemoveContainer" containerID="17f1d84202e60b8dec01267afa1816823c7f097012c441a8a445ee6a4b0ba86e"
Sep 05 06:43:10.644321 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.644298    2583 scope.go:117] "RemoveContainer" containerID="17f1d84202e60b8dec01267afa1816823c7f097012c441a8a445ee6a4b0ba86e"
Sep 05 06:43:10.644607 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:43:10.644590    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17f1d84202e60b8dec01267afa1816823c7f097012c441a8a445ee6a4b0ba86e\": container with ID starting with 17f1d84202e60b8dec01267afa1816823c7f097012c441a8a445ee6a4b0ba86e not found: ID does not exist" containerID="17f1d84202e60b8dec01267afa1816823c7f097012c441a8a445ee6a4b0ba86e"
Sep 05 06:43:10.644661 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.644615    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17f1d84202e60b8dec01267afa1816823c7f097012c441a8a445ee6a4b0ba86e"} err="failed to get container status \"17f1d84202e60b8dec01267afa1816823c7f097012c441a8a445ee6a4b0ba86e\": rpc error: code = NotFound desc = could not find container \"17f1d84202e60b8dec01267afa1816823c7f097012c441a8a445ee6a4b0ba86e\": container with ID starting with 17f1d84202e60b8dec01267afa1816823c7f097012c441a8a445ee6a4b0ba86e not found: ID does not exist"
Sep 05 06:43:10.657002 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.656977    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"]
Sep 05 06:43:10.661843 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.661815    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87"]
Sep 05 06:43:10.897990 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.897886    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:10.915107 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.915078    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3" path="/var/lib/kubelet/pods/9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3/volumes"
Sep 05 06:43:10.995128 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:10.995093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:11.094775 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:11.094739    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:12.498359 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:12.498326    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:15.856531 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:15.856498    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:43:17.209980 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:17.209916    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:17.853423 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:17.853390    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:17.902633 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:17.902598    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"]
Sep 05 06:43:17.902999 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:17.902965    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x" podUID="cc51fe9f-4e04-4ca3-b2d3-00027ac77081" containerName="payload-pre-processing" containerID="cri-o://76597c658190779ff79aa60f34fc21d2b83f09f4da335fe13a3d592515e51243" gracePeriod=30
Sep 05 06:43:17.952722 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:17.952681    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:18.054706 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.054670    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:18.155479 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.155452    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:18.167275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.167257    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"
Sep 05 06:43:18.251804 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.251769    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrrtf\" (UniqueName: \"kubernetes.io/projected/cc51fe9f-4e04-4ca3-b2d3-00027ac77081-kube-api-access-lrrtf\") pod \"cc51fe9f-4e04-4ca3-b2d3-00027ac77081\" (UID: \"cc51fe9f-4e04-4ca3-b2d3-00027ac77081\") "
Sep 05 06:43:18.252301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.251854    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc51fe9f-4e04-4ca3-b2d3-00027ac77081-plugins-config-volume\") pod \"cc51fe9f-4e04-4ca3-b2d3-00027ac77081\" (UID: \"cc51fe9f-4e04-4ca3-b2d3-00027ac77081\") "
Sep 05 06:43:18.252301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.252198    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc51fe9f-4e04-4ca3-b2d3-00027ac77081-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc51fe9f-4e04-4ca3-b2d3-00027ac77081" (UID: "cc51fe9f-4e04-4ca3-b2d3-00027ac77081"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:43:18.253907 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.253885    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc51fe9f-4e04-4ca3-b2d3-00027ac77081-kube-api-access-lrrtf" (OuterVolumeSpecName: "kube-api-access-lrrtf") pod "cc51fe9f-4e04-4ca3-b2d3-00027ac77081" (UID: "cc51fe9f-4e04-4ca3-b2d3-00027ac77081"). InnerVolumeSpecName "kube-api-access-lrrtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:43:18.352725 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.352685    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrrtf\" (UniqueName: \"kubernetes.io/projected/cc51fe9f-4e04-4ca3-b2d3-00027ac77081-kube-api-access-lrrtf\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:43:18.352725 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.352719    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc51fe9f-4e04-4ca3-b2d3-00027ac77081-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:43:18.478333 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.478298    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:18.676207 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.676171    2583 generic.go:356] "Generic (PLEG): container finished" podID="cc51fe9f-4e04-4ca3-b2d3-00027ac77081" containerID="76597c658190779ff79aa60f34fc21d2b83f09f4da335fe13a3d592515e51243" exitCode=0
Sep 05 06:43:18.676436 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.676224    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"
Sep 05 06:43:18.676436 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.676263    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x" event={"ID":"cc51fe9f-4e04-4ca3-b2d3-00027ac77081","Type":"ContainerDied","Data":"76597c658190779ff79aa60f34fc21d2b83f09f4da335fe13a3d592515e51243"}
Sep 05 06:43:18.676436 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.676319    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x" event={"ID":"cc51fe9f-4e04-4ca3-b2d3-00027ac77081","Type":"ContainerDied","Data":"4374861778cb0cf1152d496ff997d50aa37604954f332386406455e15f0f19e8"}
Sep 05 06:43:18.676436 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.676347    2583 scope.go:117] "RemoveContainer" containerID="76597c658190779ff79aa60f34fc21d2b83f09f4da335fe13a3d592515e51243"
Sep 05 06:43:18.685267 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.685252    2583 scope.go:117] "RemoveContainer" containerID="76597c658190779ff79aa60f34fc21d2b83f09f4da335fe13a3d592515e51243"
Sep 05 06:43:18.685527 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:43:18.685509    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76597c658190779ff79aa60f34fc21d2b83f09f4da335fe13a3d592515e51243\": container with ID starting with 76597c658190779ff79aa60f34fc21d2b83f09f4da335fe13a3d592515e51243 not found: ID does not exist" containerID="76597c658190779ff79aa60f34fc21d2b83f09f4da335fe13a3d592515e51243"
Sep 05 06:43:18.685578 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.685536    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76597c658190779ff79aa60f34fc21d2b83f09f4da335fe13a3d592515e51243"} err="failed to get container status \"76597c658190779ff79aa60f34fc21d2b83f09f4da335fe13a3d592515e51243\": rpc error: code = NotFound desc = could not find container \"76597c658190779ff79aa60f34fc21d2b83f09f4da335fe13a3d592515e51243\": container with ID starting with 76597c658190779ff79aa60f34fc21d2b83f09f4da335fe13a3d592515e51243 not found: ID does not exist"
Sep 05 06:43:18.700737 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.700710    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"]
Sep 05 06:43:18.706128 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.706106    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x"]
Sep 05 06:43:18.915613 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:18.915533    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc51fe9f-4e04-4ca3-b2d3-00027ac77081" path="/var/lib/kubelet/pods/cc51fe9f-4e04-4ca3-b2d3-00027ac77081/volumes"
Sep 05 06:43:19.059650 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:19.059617    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:19.166166 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:19.166075    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:19.262743 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:19.262711    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:19.360018 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:19.359979    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:19.801774 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:19.801743    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:21.813728 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:21.813687    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk" podUID="391f7a17-6d78-4152-9da9-557fc5e41a01" containerName="main" containerID="cri-o://a0e8ae6a381b563368474de75a43ac754f1409ff828d8b88b9883f5666b65d65" gracePeriod=45
Sep 05 06:43:22.063611 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.063586    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:43:22.185222 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.185153    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-tmp-dir\") pod \"391f7a17-6d78-4152-9da9-557fc5e41a01\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") "
Sep 05 06:43:22.185376 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.185232    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-dshm\") pod \"391f7a17-6d78-4152-9da9-557fc5e41a01\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") "
Sep 05 06:43:22.185376 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.185259    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-model-cache\") pod \"391f7a17-6d78-4152-9da9-557fc5e41a01\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") "
Sep 05 06:43:22.185376 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.185275    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/391f7a17-6d78-4152-9da9-557fc5e41a01-tls-certs\") pod \"391f7a17-6d78-4152-9da9-557fc5e41a01\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") "
Sep 05 06:43:22.185376 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.185298    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-home\") pod \"391f7a17-6d78-4152-9da9-557fc5e41a01\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") "
Sep 05 06:43:22.185376 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.185323    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2q26\" (UniqueName: \"kubernetes.io/projected/391f7a17-6d78-4152-9da9-557fc5e41a01-kube-api-access-h2q26\") pod \"391f7a17-6d78-4152-9da9-557fc5e41a01\" (UID: \"391f7a17-6d78-4152-9da9-557fc5e41a01\") "
Sep 05 06:43:22.185660 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.185455    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "391f7a17-6d78-4152-9da9-557fc5e41a01" (UID: "391f7a17-6d78-4152-9da9-557fc5e41a01"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:22.185660 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.185486    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-model-cache" (OuterVolumeSpecName: "model-cache") pod "391f7a17-6d78-4152-9da9-557fc5e41a01" (UID: "391f7a17-6d78-4152-9da9-557fc5e41a01"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:22.185660 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.185552    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-home" (OuterVolumeSpecName: "home") pod "391f7a17-6d78-4152-9da9-557fc5e41a01" (UID: "391f7a17-6d78-4152-9da9-557fc5e41a01"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:22.187553 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.187523    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/391f7a17-6d78-4152-9da9-557fc5e41a01-kube-api-access-h2q26" (OuterVolumeSpecName: "kube-api-access-h2q26") pod "391f7a17-6d78-4152-9da9-557fc5e41a01" (UID: "391f7a17-6d78-4152-9da9-557fc5e41a01"). InnerVolumeSpecName "kube-api-access-h2q26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:43:22.187553 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.187533    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/391f7a17-6d78-4152-9da9-557fc5e41a01-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "391f7a17-6d78-4152-9da9-557fc5e41a01" (UID: "391f7a17-6d78-4152-9da9-557fc5e41a01"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:43:22.187694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.187529    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-dshm" (OuterVolumeSpecName: "dshm") pod "391f7a17-6d78-4152-9da9-557fc5e41a01" (UID: "391f7a17-6d78-4152-9da9-557fc5e41a01"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:22.286050 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.286020    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:43:22.286050 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.286045    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:43:22.286050 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.286056    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/391f7a17-6d78-4152-9da9-557fc5e41a01-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:43:22.286263 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.286063    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:43:22.286263 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.286071    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2q26\" (UniqueName: \"kubernetes.io/projected/391f7a17-6d78-4152-9da9-557fc5e41a01-kube-api-access-h2q26\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:43:22.286263 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.286079    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/391f7a17-6d78-4152-9da9-557fc5e41a01-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:43:22.697016 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.696976    2583 generic.go:356] "Generic (PLEG): container finished" podID="391f7a17-6d78-4152-9da9-557fc5e41a01" containerID="a0e8ae6a381b563368474de75a43ac754f1409ff828d8b88b9883f5666b65d65" exitCode=0
Sep 05 06:43:22.697016 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.697021    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"
Sep 05 06:43:22.697296 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.697058    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk" event={"ID":"391f7a17-6d78-4152-9da9-557fc5e41a01","Type":"ContainerDied","Data":"a0e8ae6a381b563368474de75a43ac754f1409ff828d8b88b9883f5666b65d65"}
Sep 05 06:43:22.697296 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.697108    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk" event={"ID":"391f7a17-6d78-4152-9da9-557fc5e41a01","Type":"ContainerDied","Data":"f68c214c6fbdfcaac2b7adfc8d749f5212f5fe2b27d89dfa588fbbbea6595d63"}
Sep 05 06:43:22.697296 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.697130    2583 scope.go:117] "RemoveContainer" containerID="a0e8ae6a381b563368474de75a43ac754f1409ff828d8b88b9883f5666b65d65"
Sep 05 06:43:22.707642 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.707619    2583 scope.go:117] "RemoveContainer" containerID="a0e8ae6a381b563368474de75a43ac754f1409ff828d8b88b9883f5666b65d65"
Sep 05 06:43:22.707939 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:43:22.707921    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0e8ae6a381b563368474de75a43ac754f1409ff828d8b88b9883f5666b65d65\": container with ID starting with a0e8ae6a381b563368474de75a43ac754f1409ff828d8b88b9883f5666b65d65 not found: ID does not exist" containerID="a0e8ae6a381b563368474de75a43ac754f1409ff828d8b88b9883f5666b65d65"
Sep 05 06:43:22.707991 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.707946    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0e8ae6a381b563368474de75a43ac754f1409ff828d8b88b9883f5666b65d65"} err="failed to get container status \"a0e8ae6a381b563368474de75a43ac754f1409ff828d8b88b9883f5666b65d65\": rpc error: code = NotFound desc = could not find container \"a0e8ae6a381b563368474de75a43ac754f1409ff828d8b88b9883f5666b65d65\": container with ID starting with a0e8ae6a381b563368474de75a43ac754f1409ff828d8b88b9883f5666b65d65 not found: ID does not exist"
Sep 05 06:43:22.720210 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.720190    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"]
Sep 05 06:43:22.725045 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.725026    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-a092eb/explicit-model-a092eb-kserve-57578f6d75-8qvkk"]
Sep 05 06:43:22.914679 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:22.914646    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="391f7a17-6d78-4152-9da9-557fc5e41a01" path="/var/lib/kubelet/pods/391f7a17-6d78-4152-9da9-557fc5e41a01/volumes"
Sep 05 06:43:25.043545 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:25.043508    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:25.146477 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:25.146446    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:25.304743 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:25.304663    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:25.777829 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:25.777793    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:26.088108 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:26.088003    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:26.404892 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:26.404779    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:28.039262 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:28.039223    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:28.136446 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:28.136412    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:28.294767 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:28.294673    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:31.667825 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:31.667791    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:43:33.171598 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:33.171566    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:33.235715 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:33.235685    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:40.157803 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.157771    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"]
Sep 05 06:43:40.158181 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.158130    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3" containerName="payload-pre-processing"
Sep 05 06:43:40.158181 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.158142    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3" containerName="payload-pre-processing"
Sep 05 06:43:40.158181 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.158160    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391f7a17-6d78-4152-9da9-557fc5e41a01" containerName="main"
Sep 05 06:43:40.158181 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.158165    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="391f7a17-6d78-4152-9da9-557fc5e41a01" containerName="main"
Sep 05 06:43:40.158181 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.158176    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc51fe9f-4e04-4ca3-b2d3-00027ac77081" containerName="payload-pre-processing"
Sep 05 06:43:40.158181 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.158181    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc51fe9f-4e04-4ca3-b2d3-00027ac77081" containerName="payload-pre-processing"
Sep 05 06:43:40.158371 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.158268    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc51fe9f-4e04-4ca3-b2d3-00027ac77081" containerName="payload-pre-processing"
Sep 05 06:43:40.158371 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.158295    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9592eca7-0b3a-4d0e-b8a8-02d723c3d3b3" containerName="payload-pre-processing"
Sep 05 06:43:40.158371 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.158302    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="391f7a17-6d78-4152-9da9-557fc5e41a01" containerName="main"
Sep 05 06:43:40.161359 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.161340    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.165269 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.165246    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-3f08e4\"/\"openshift-service-ca.crt\""
Sep 05 06:43:40.165408 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.165288    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-3f08e4\"/\"kube-root-ca.crt\""
Sep 05 06:43:40.165408 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.165318    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-3f08e4\"/\"default-dockercfg-mvfn2\""
Sep 05 06:43:40.165549 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.165530    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-3f08e4\"/\"noten-model-3f08e4-kserve-self-signed-certs\""
Sep 05 06:43:40.170315 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.170293    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"]
Sep 05 06:43:40.196486 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.196451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:40.237556 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.237525    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-dshm\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.237732 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.237582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m58w7\" (UniqueName: \"kubernetes.io/projected/97b3a2f6-2f50-403d-affb-de20a96101ab-kube-api-access-m58w7\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.237732 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.237648    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97b3a2f6-2f50-403d-affb-de20a96101ab-tls-certs\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.237732 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.237718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-home\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.237885 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.237749    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-model-cache\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.237885 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.237774    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-tmp-dir\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.296807 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.296769    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:40.339033 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.339001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-home\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.339033 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.339034    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-model-cache\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.339237 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.339055    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-tmp-dir\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.339237 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.339120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-dshm\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.339237 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.339160    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m58w7\" (UniqueName: \"kubernetes.io/projected/97b3a2f6-2f50-403d-affb-de20a96101ab-kube-api-access-m58w7\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.339237 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.339204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97b3a2f6-2f50-403d-affb-de20a96101ab-tls-certs\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.339403 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.339386    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-home\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.339476 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.339456    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-model-cache\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.339615 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.339596    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-tmp-dir\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.341392 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.341373    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-dshm\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.341789 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.341772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97b3a2f6-2f50-403d-affb-de20a96101ab-tls-certs\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.348041 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.348019    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m58w7\" (UniqueName: \"kubernetes.io/projected/97b3a2f6-2f50-403d-affb-de20a96101ab-kube-api-access-m58w7\") pod \"noten-model-3f08e4-kserve-6f55675c47-lxlln\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") " pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.470941 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.470905    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:40.744941 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.744915    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"]
Sep 05 06:43:40.746403 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:43:40.746375    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97b3a2f6_2f50_403d_affb_de20a96101ab.slice/crio-9e8d0d3b5a850fec9d5e84fed288b07db40d3e6060e3ed0a5f23efcf3befdc55 WatchSource:0}: Error finding container 9e8d0d3b5a850fec9d5e84fed288b07db40d3e6060e3ed0a5f23efcf3befdc55: Status 404 returned error can't find the container with id 9e8d0d3b5a850fec9d5e84fed288b07db40d3e6060e3ed0a5f23efcf3befdc55
Sep 05 06:43:40.785912 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:40.785882    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln" event={"ID":"97b3a2f6-2f50-403d-affb-de20a96101ab","Type":"ContainerStarted","Data":"9e8d0d3b5a850fec9d5e84fed288b07db40d3e6060e3ed0a5f23efcf3befdc55"}
Sep 05 06:43:41.792475 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:41.792432    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln" event={"ID":"97b3a2f6-2f50-403d-affb-de20a96101ab","Type":"ContainerStarted","Data":"1cb3914af02a49fe4529ba911035517d3781e1e8c98a53392abb66be1364076f"}
Sep 05 06:43:41.815364 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:41.815303    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln" podStartSLOduration=1.815281014 podStartE2EDuration="1.815281014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:43:41.813064815 +0000 UTC m=+1119.417613655" watchObservedRunningTime="2026-09-05 06:43:41.815281014 +0000 UTC m=+1119.419829853"
Sep 05 06:43:44.080328 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:44.080287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:44.182942 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:44.182904    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:44.857669 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:44.857635    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:43:45.737094 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:45.737058    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:50.472032 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:50.471992    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:50.472032 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:50.472040    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:50.484550 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:50.484526    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:50.851925 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:50.851820    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:43:52.278349 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:52.278296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:52.382148 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:52.382115    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:52.476216 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:52.476182    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:53.545052 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:53.545021    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"]
Sep 05 06:43:53.565399 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:53.565370    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:53.702196 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:53.702144    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:53.963702 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:53.963673    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:54.079810 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:54.079772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:59.096633 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:59.096600    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:43:59.281417 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:59.281382    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"]
Sep 05 06:43:59.315341 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:43:59.315308    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:00.361763 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:00.361732    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:00.582101 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:00.582073    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:05.052641 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:05.052605    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:44:08.366846 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.366812    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:08.564908 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.564834    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln" podUID="97b3a2f6-2f50-403d-affb-de20a96101ab" containerName="main" containerID="cri-o://1cb3914af02a49fe4529ba911035517d3781e1e8c98a53392abb66be1364076f" gracePeriod=45
Sep 05 06:44:08.804418 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.804390    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:44:08.865788 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.865760    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-dshm\") pod \"97b3a2f6-2f50-403d-affb-de20a96101ab\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") "
Sep 05 06:44:08.865972 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.865801    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-home\") pod \"97b3a2f6-2f50-403d-affb-de20a96101ab\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") "
Sep 05 06:44:08.865972 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.865847    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-model-cache\") pod \"97b3a2f6-2f50-403d-affb-de20a96101ab\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") "
Sep 05 06:44:08.865972 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.865903    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m58w7\" (UniqueName: \"kubernetes.io/projected/97b3a2f6-2f50-403d-affb-de20a96101ab-kube-api-access-m58w7\") pod \"97b3a2f6-2f50-403d-affb-de20a96101ab\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") "
Sep 05 06:44:08.865972 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.865949    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97b3a2f6-2f50-403d-affb-de20a96101ab-tls-certs\") pod \"97b3a2f6-2f50-403d-affb-de20a96101ab\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") "
Sep 05 06:44:08.866183 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.865974    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-tmp-dir\") pod \"97b3a2f6-2f50-403d-affb-de20a96101ab\" (UID: \"97b3a2f6-2f50-403d-affb-de20a96101ab\") "
Sep 05 06:44:08.866183 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.866108    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-model-cache" (OuterVolumeSpecName: "model-cache") pod "97b3a2f6-2f50-403d-affb-de20a96101ab" (UID: "97b3a2f6-2f50-403d-affb-de20a96101ab"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:08.866183 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.866122    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-home" (OuterVolumeSpecName: "home") pod "97b3a2f6-2f50-403d-affb-de20a96101ab" (UID: "97b3a2f6-2f50-403d-affb-de20a96101ab"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:08.866314 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.866213    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:08.866314 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.866232    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:08.866423 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.866314    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "97b3a2f6-2f50-403d-affb-de20a96101ab" (UID: "97b3a2f6-2f50-403d-affb-de20a96101ab"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:08.868079 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.868048    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-dshm" (OuterVolumeSpecName: "dshm") pod "97b3a2f6-2f50-403d-affb-de20a96101ab" (UID: "97b3a2f6-2f50-403d-affb-de20a96101ab"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:08.868185 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.868070    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b3a2f6-2f50-403d-affb-de20a96101ab-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "97b3a2f6-2f50-403d-affb-de20a96101ab" (UID: "97b3a2f6-2f50-403d-affb-de20a96101ab"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:44:08.868185 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.868106    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b3a2f6-2f50-403d-affb-de20a96101ab-kube-api-access-m58w7" (OuterVolumeSpecName: "kube-api-access-m58w7") pod "97b3a2f6-2f50-403d-affb-de20a96101ab" (UID: "97b3a2f6-2f50-403d-affb-de20a96101ab"). InnerVolumeSpecName "kube-api-access-m58w7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:44:08.935555 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.935490    2583 generic.go:356] "Generic (PLEG): container finished" podID="97b3a2f6-2f50-403d-affb-de20a96101ab" containerID="1cb3914af02a49fe4529ba911035517d3781e1e8c98a53392abb66be1364076f" exitCode=0
Sep 05 06:44:08.935555 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.935526    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"
Sep 05 06:44:08.935555 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.935547    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln" event={"ID":"97b3a2f6-2f50-403d-affb-de20a96101ab","Type":"ContainerDied","Data":"1cb3914af02a49fe4529ba911035517d3781e1e8c98a53392abb66be1364076f"}
Sep 05 06:44:08.935779 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.935573    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln" event={"ID":"97b3a2f6-2f50-403d-affb-de20a96101ab","Type":"ContainerDied","Data":"9e8d0d3b5a850fec9d5e84fed288b07db40d3e6060e3ed0a5f23efcf3befdc55"}
Sep 05 06:44:08.935779 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.935589    2583 scope.go:117] "RemoveContainer" containerID="1cb3914af02a49fe4529ba911035517d3781e1e8c98a53392abb66be1364076f"
Sep 05 06:44:08.944247 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.944230    2583 scope.go:117] "RemoveContainer" containerID="1cb3914af02a49fe4529ba911035517d3781e1e8c98a53392abb66be1364076f"
Sep 05 06:44:08.944515 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:44:08.944497    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cb3914af02a49fe4529ba911035517d3781e1e8c98a53392abb66be1364076f\": container with ID starting with 1cb3914af02a49fe4529ba911035517d3781e1e8c98a53392abb66be1364076f not found: ID does not exist" containerID="1cb3914af02a49fe4529ba911035517d3781e1e8c98a53392abb66be1364076f"
Sep 05 06:44:08.944595 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.944525    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cb3914af02a49fe4529ba911035517d3781e1e8c98a53392abb66be1364076f"} err="failed to get container status \"1cb3914af02a49fe4529ba911035517d3781e1e8c98a53392abb66be1364076f\": rpc error: code = NotFound desc = could not find container \"1cb3914af02a49fe4529ba911035517d3781e1e8c98a53392abb66be1364076f\": container with ID starting with 1cb3914af02a49fe4529ba911035517d3781e1e8c98a53392abb66be1364076f not found: ID does not exist"
Sep 05 06:44:08.954207 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.954186    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"]
Sep 05 06:44:08.958095 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.958077    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-3f08e4/noten-model-3f08e4-kserve-6f55675c47-lxlln"]
Sep 05 06:44:08.966773 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.966751    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:08.966773 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.966770    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m58w7\" (UniqueName: \"kubernetes.io/projected/97b3a2f6-2f50-403d-affb-de20a96101ab-kube-api-access-m58w7\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:08.966969 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.966780    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97b3a2f6-2f50-403d-affb-de20a96101ab-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:08.966969 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:08.966796    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97b3a2f6-2f50-403d-affb-de20a96101ab-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:10.915612 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:10.915578    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97b3a2f6-2f50-403d-affb-de20a96101ab" path="/var/lib/kubelet/pods/97b3a2f6-2f50-403d-affb-de20a96101ab/volumes"
Sep 05 06:44:11.032731 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.032700    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:11.069591 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.069554    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"]
Sep 05 06:44:11.069912 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.069880    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt" podUID="140dd883-f7f6-4cec-9d47-8d0448b7aaa3" containerName="payload-processing" containerID="cri-o://bab7d038af17243efdd14b7d3478a030ab02f3107a1fe6c6b0db3cc83d639ce0" gracePeriod=30
Sep 05 06:44:11.079856 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.079829    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"]
Sep 05 06:44:11.080089 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.080065    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6" podUID="c69c9092-d8e3-49a0-8416-a0a2368668e1" containerName="payload-pre-processing" containerID="cri-o://b3859916213edc017d7fdbf3eb6b515df83f51eeb98be4ff883b320dc9978c24" gracePeriod=30
Sep 05 06:44:11.119759 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.119731    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:11.193219 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.193188    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:11.288555 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.288524    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:11.334424 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.334399    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"
Sep 05 06:44:11.355467 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.355440    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"
Sep 05 06:44:11.359855 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.359830    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:11.383963 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.383938    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzczw\" (UniqueName: \"kubernetes.io/projected/140dd883-f7f6-4cec-9d47-8d0448b7aaa3-kube-api-access-nzczw\") pod \"140dd883-f7f6-4cec-9d47-8d0448b7aaa3\" (UID: \"140dd883-f7f6-4cec-9d47-8d0448b7aaa3\") "
Sep 05 06:44:11.384099 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.383971    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/140dd883-f7f6-4cec-9d47-8d0448b7aaa3-plugins-config-volume\") pod \"140dd883-f7f6-4cec-9d47-8d0448b7aaa3\" (UID: \"140dd883-f7f6-4cec-9d47-8d0448b7aaa3\") "
Sep 05 06:44:11.384099 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.383996    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c69c9092-d8e3-49a0-8416-a0a2368668e1-plugins-config-volume\") pod \"c69c9092-d8e3-49a0-8416-a0a2368668e1\" (UID: \"c69c9092-d8e3-49a0-8416-a0a2368668e1\") "
Sep 05 06:44:11.384238 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.384111    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2xwj\" (UniqueName: \"kubernetes.io/projected/c69c9092-d8e3-49a0-8416-a0a2368668e1-kube-api-access-z2xwj\") pod \"c69c9092-d8e3-49a0-8416-a0a2368668e1\" (UID: \"c69c9092-d8e3-49a0-8416-a0a2368668e1\") "
Sep 05 06:44:11.384371 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.384348    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c69c9092-d8e3-49a0-8416-a0a2368668e1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c69c9092-d8e3-49a0-8416-a0a2368668e1" (UID: "c69c9092-d8e3-49a0-8416-a0a2368668e1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:44:11.384445 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.384366    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/140dd883-f7f6-4cec-9d47-8d0448b7aaa3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "140dd883-f7f6-4cec-9d47-8d0448b7aaa3" (UID: "140dd883-f7f6-4cec-9d47-8d0448b7aaa3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:44:11.386059 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.386036    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/140dd883-f7f6-4cec-9d47-8d0448b7aaa3-kube-api-access-nzczw" (OuterVolumeSpecName: "kube-api-access-nzczw") pod "140dd883-f7f6-4cec-9d47-8d0448b7aaa3" (UID: "140dd883-f7f6-4cec-9d47-8d0448b7aaa3"). InnerVolumeSpecName "kube-api-access-nzczw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:44:11.386170 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.386093    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69c9092-d8e3-49a0-8416-a0a2368668e1-kube-api-access-z2xwj" (OuterVolumeSpecName: "kube-api-access-z2xwj") pod "c69c9092-d8e3-49a0-8416-a0a2368668e1" (UID: "c69c9092-d8e3-49a0-8416-a0a2368668e1"). InnerVolumeSpecName "kube-api-access-z2xwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:44:11.484908 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.484847    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzczw\" (UniqueName: \"kubernetes.io/projected/140dd883-f7f6-4cec-9d47-8d0448b7aaa3-kube-api-access-nzczw\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:11.484908 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.484903    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/140dd883-f7f6-4cec-9d47-8d0448b7aaa3-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:11.484908 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.484913    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c69c9092-d8e3-49a0-8416-a0a2368668e1-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:11.485123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.484921    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2xwj\" (UniqueName: \"kubernetes.io/projected/c69c9092-d8e3-49a0-8416-a0a2368668e1-kube-api-access-z2xwj\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:11.744370 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.744287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:11.955062 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.955030    2583 generic.go:356] "Generic (PLEG): container finished" podID="140dd883-f7f6-4cec-9d47-8d0448b7aaa3" containerID="bab7d038af17243efdd14b7d3478a030ab02f3107a1fe6c6b0db3cc83d639ce0" exitCode=0
Sep 05 06:44:11.955567 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.955073    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"
Sep 05 06:44:11.955567 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.955118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt" event={"ID":"140dd883-f7f6-4cec-9d47-8d0448b7aaa3","Type":"ContainerDied","Data":"bab7d038af17243efdd14b7d3478a030ab02f3107a1fe6c6b0db3cc83d639ce0"}
Sep 05 06:44:11.955567 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.955186    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt" event={"ID":"140dd883-f7f6-4cec-9d47-8d0448b7aaa3","Type":"ContainerDied","Data":"23796127d50948ddc07d42c202a44def84a1c1bda10add2a238bd6476bc60759"}
Sep 05 06:44:11.955567 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.955226    2583 scope.go:117] "RemoveContainer" containerID="bab7d038af17243efdd14b7d3478a030ab02f3107a1fe6c6b0db3cc83d639ce0"
Sep 05 06:44:11.956480 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.956458    2583 generic.go:356] "Generic (PLEG): container finished" podID="c69c9092-d8e3-49a0-8416-a0a2368668e1" containerID="b3859916213edc017d7fdbf3eb6b515df83f51eeb98be4ff883b320dc9978c24" exitCode=0
Sep 05 06:44:11.956588 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.956501    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"
Sep 05 06:44:11.956588 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.956524    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6" event={"ID":"c69c9092-d8e3-49a0-8416-a0a2368668e1","Type":"ContainerDied","Data":"b3859916213edc017d7fdbf3eb6b515df83f51eeb98be4ff883b320dc9978c24"}
Sep 05 06:44:11.956588 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.956558    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6" event={"ID":"c69c9092-d8e3-49a0-8416-a0a2368668e1","Type":"ContainerDied","Data":"20138ecb64214fefcb9ed16d920680a7c5ec51892af11a885bdb4a2f613883a8"}
Sep 05 06:44:11.963942 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.963922    2583 scope.go:117] "RemoveContainer" containerID="bab7d038af17243efdd14b7d3478a030ab02f3107a1fe6c6b0db3cc83d639ce0"
Sep 05 06:44:11.964245 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:44:11.964219    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab7d038af17243efdd14b7d3478a030ab02f3107a1fe6c6b0db3cc83d639ce0\": container with ID starting with bab7d038af17243efdd14b7d3478a030ab02f3107a1fe6c6b0db3cc83d639ce0 not found: ID does not exist" containerID="bab7d038af17243efdd14b7d3478a030ab02f3107a1fe6c6b0db3cc83d639ce0"
Sep 05 06:44:11.964324 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.964249    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab7d038af17243efdd14b7d3478a030ab02f3107a1fe6c6b0db3cc83d639ce0"} err="failed to get container status \"bab7d038af17243efdd14b7d3478a030ab02f3107a1fe6c6b0db3cc83d639ce0\": rpc error: code = NotFound desc = could not find container \"bab7d038af17243efdd14b7d3478a030ab02f3107a1fe6c6b0db3cc83d639ce0\": container with ID starting with bab7d038af17243efdd14b7d3478a030ab02f3107a1fe6c6b0db3cc83d639ce0 not found: ID does not exist"
Sep 05 06:44:11.964324 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.964270    2583 scope.go:117] "RemoveContainer" containerID="b3859916213edc017d7fdbf3eb6b515df83f51eeb98be4ff883b320dc9978c24"
Sep 05 06:44:11.972133 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.972119    2583 scope.go:117] "RemoveContainer" containerID="b3859916213edc017d7fdbf3eb6b515df83f51eeb98be4ff883b320dc9978c24"
Sep 05 06:44:11.972407 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:44:11.972377    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3859916213edc017d7fdbf3eb6b515df83f51eeb98be4ff883b320dc9978c24\": container with ID starting with b3859916213edc017d7fdbf3eb6b515df83f51eeb98be4ff883b320dc9978c24 not found: ID does not exist" containerID="b3859916213edc017d7fdbf3eb6b515df83f51eeb98be4ff883b320dc9978c24"
Sep 05 06:44:11.972467 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.972417    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3859916213edc017d7fdbf3eb6b515df83f51eeb98be4ff883b320dc9978c24"} err="failed to get container status \"b3859916213edc017d7fdbf3eb6b515df83f51eeb98be4ff883b320dc9978c24\": rpc error: code = NotFound desc = could not find container \"b3859916213edc017d7fdbf3eb6b515df83f51eeb98be4ff883b320dc9978c24\": container with ID starting with b3859916213edc017d7fdbf3eb6b515df83f51eeb98be4ff883b320dc9978c24 not found: ID does not exist"
Sep 05 06:44:11.980635 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.980613    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"]
Sep 05 06:44:11.988464 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:11.988445    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt"]
Sep 05 06:44:12.007245 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:12.005826    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"]
Sep 05 06:44:12.007245 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:12.005904    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6"]
Sep 05 06:44:12.914614 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:12.914566    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="140dd883-f7f6-4cec-9d47-8d0448b7aaa3" path="/var/lib/kubelet/pods/140dd883-f7f6-4cec-9d47-8d0448b7aaa3/volumes"
Sep 05 06:44:12.915059 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:12.915038    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c69c9092-d8e3-49a0-8416-a0a2368668e1" path="/var/lib/kubelet/pods/c69c9092-d8e3-49a0-8416-a0a2368668e1/volumes"
Sep 05 06:44:13.565248 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:13.565205    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:44:14.302584 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.302520    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4" podUID="0933122f-9f68-4bbe-9620-09c653705d52" containerName="main" containerID="cri-o://58c39d528ec32311ecddb1cb4a132c1ecc61e59363596e8e651c79376637aedb" gracePeriod=45
Sep 05 06:44:14.552446 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.552424    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:44:14.608228 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.608141    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-tmp-dir\") pod \"0933122f-9f68-4bbe-9620-09c653705d52\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") "
Sep 05 06:44:14.608228 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.608189    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-home\") pod \"0933122f-9f68-4bbe-9620-09c653705d52\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") "
Sep 05 06:44:14.608719 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.608244    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47jxl\" (UniqueName: \"kubernetes.io/projected/0933122f-9f68-4bbe-9620-09c653705d52-kube-api-access-47jxl\") pod \"0933122f-9f68-4bbe-9620-09c653705d52\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") "
Sep 05 06:44:14.608719 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.608270    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-dshm\") pod \"0933122f-9f68-4bbe-9620-09c653705d52\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") "
Sep 05 06:44:14.608719 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.608300    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0933122f-9f68-4bbe-9620-09c653705d52-tls-certs\") pod \"0933122f-9f68-4bbe-9620-09c653705d52\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") "
Sep 05 06:44:14.608719 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.608324    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-model-cache\") pod \"0933122f-9f68-4bbe-9620-09c653705d52\" (UID: \"0933122f-9f68-4bbe-9620-09c653705d52\") "
Sep 05 06:44:14.608719 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.608469    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-home" (OuterVolumeSpecName: "home") pod "0933122f-9f68-4bbe-9620-09c653705d52" (UID: "0933122f-9f68-4bbe-9620-09c653705d52"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:14.608719 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.608485    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0933122f-9f68-4bbe-9620-09c653705d52" (UID: "0933122f-9f68-4bbe-9620-09c653705d52"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:14.608719 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.608553    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:14.608719 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.608573    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:14.608719 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.608645    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-model-cache" (OuterVolumeSpecName: "model-cache") pod "0933122f-9f68-4bbe-9620-09c653705d52" (UID: "0933122f-9f68-4bbe-9620-09c653705d52"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:14.610455 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.610432    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0933122f-9f68-4bbe-9620-09c653705d52-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0933122f-9f68-4bbe-9620-09c653705d52" (UID: "0933122f-9f68-4bbe-9620-09c653705d52"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:44:14.610537 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.610514    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0933122f-9f68-4bbe-9620-09c653705d52-kube-api-access-47jxl" (OuterVolumeSpecName: "kube-api-access-47jxl") pod "0933122f-9f68-4bbe-9620-09c653705d52" (UID: "0933122f-9f68-4bbe-9620-09c653705d52"). InnerVolumeSpecName "kube-api-access-47jxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:44:14.610537 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.610521    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-dshm" (OuterVolumeSpecName: "dshm") pod "0933122f-9f68-4bbe-9620-09c653705d52" (UID: "0933122f-9f68-4bbe-9620-09c653705d52"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:14.709203 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.709171    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47jxl\" (UniqueName: \"kubernetes.io/projected/0933122f-9f68-4bbe-9620-09c653705d52-kube-api-access-47jxl\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:14.709203 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.709199    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:14.709203 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.709209    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0933122f-9f68-4bbe-9620-09c653705d52-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:14.709405 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.709219    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0933122f-9f68-4bbe-9620-09c653705d52-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:14.754735 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.754707    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:14.820064 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.820028    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:14.907234 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.907140    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:14.972683 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.972650    2583 generic.go:356] "Generic (PLEG): container finished" podID="0933122f-9f68-4bbe-9620-09c653705d52" containerID="58c39d528ec32311ecddb1cb4a132c1ecc61e59363596e8e651c79376637aedb" exitCode=0
Sep 05 06:44:14.972809 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.972690    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"
Sep 05 06:44:14.972809 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.972736    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4" event={"ID":"0933122f-9f68-4bbe-9620-09c653705d52","Type":"ContainerDied","Data":"58c39d528ec32311ecddb1cb4a132c1ecc61e59363596e8e651c79376637aedb"}
Sep 05 06:44:14.972809 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.972776    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4" event={"ID":"0933122f-9f68-4bbe-9620-09c653705d52","Type":"ContainerDied","Data":"0b9256af264444d275b515a43d25a36368249d53b95e80a3a08712f9d9f27f10"}
Sep 05 06:44:14.972809 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.972795    2583 scope.go:117] "RemoveContainer" containerID="58c39d528ec32311ecddb1cb4a132c1ecc61e59363596e8e651c79376637aedb"
Sep 05 06:44:14.981132 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.981116    2583 scope.go:117] "RemoveContainer" containerID="58c39d528ec32311ecddb1cb4a132c1ecc61e59363596e8e651c79376637aedb"
Sep 05 06:44:14.981404 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:44:14.981386    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c39d528ec32311ecddb1cb4a132c1ecc61e59363596e8e651c79376637aedb\": container with ID starting with 58c39d528ec32311ecddb1cb4a132c1ecc61e59363596e8e651c79376637aedb not found: ID does not exist" containerID="58c39d528ec32311ecddb1cb4a132c1ecc61e59363596e8e651c79376637aedb"
Sep 05 06:44:14.981497 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.981412    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c39d528ec32311ecddb1cb4a132c1ecc61e59363596e8e651c79376637aedb"} err="failed to get container status \"58c39d528ec32311ecddb1cb4a132c1ecc61e59363596e8e651c79376637aedb\": rpc error: code = NotFound desc = could not find container \"58c39d528ec32311ecddb1cb4a132c1ecc61e59363596e8e651c79376637aedb\": container with ID starting with 58c39d528ec32311ecddb1cb4a132c1ecc61e59363596e8e651c79376637aedb not found: ID does not exist"
Sep 05 06:44:14.991482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.991463    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"]
Sep 05 06:44:14.996268 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.996245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:14.996798 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:14.996780    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-6efc3a/test-model-6efc3a-kserve-d4f9dd5c7-jdcc4"]
Sep 05 06:44:16.914517 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:16.914481    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0933122f-9f68-4bbe-9620-09c653705d52" path="/var/lib/kubelet/pods/0933122f-9f68-4bbe-9620-09c653705d52/volumes"
Sep 05 06:44:18.270259 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:18.270228    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:18.372805 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:18.372769    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:18.532282 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:18.532202    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:19.108356 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:19.108322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:25.456609 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:25.456522    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:26.254381 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:26.254346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:29.513406 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:29.513368    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:29.545559 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:29.545531    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"]
Sep 05 06:44:29.545788 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:29.545733    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8" podUID="e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec" containerName="payload-pre-processing" containerID="cri-o://ff1026be96c1d0d8a94fe3d927f9ee09da8af2767268f21c431ce10758a6f680" gracePeriod=30
Sep 05 06:44:29.614885 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:29.614836    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:29.714222 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:29.713898    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:29.790971 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:29.790949    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"
Sep 05 06:44:29.813593 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:29.813563    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:29.831570 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:29.831539    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec-plugins-config-volume\") pod \"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec\" (UID: \"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec\") "
Sep 05 06:44:29.831677 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:29.831663    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lm7xf\" (UniqueName: \"kubernetes.io/projected/e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec-kube-api-access-lm7xf\") pod \"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec\" (UID: \"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec\") "
Sep 05 06:44:29.831948 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:29.831931    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec" (UID: "e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:44:29.833753 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:29.833728    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec-kube-api-access-lm7xf" (OuterVolumeSpecName: "kube-api-access-lm7xf") pod "e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec" (UID: "e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec"). InnerVolumeSpecName "kube-api-access-lm7xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:44:29.932519 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:29.932487    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:29.932519 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:29.932514    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm7xf\" (UniqueName: \"kubernetes.io/projected/e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec-kube-api-access-lm7xf\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:44:30.045385 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:30.045294    2583 generic.go:356] "Generic (PLEG): container finished" podID="e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec" containerID="ff1026be96c1d0d8a94fe3d927f9ee09da8af2767268f21c431ce10758a6f680" exitCode=0
Sep 05 06:44:30.045385 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:30.045340    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"
Sep 05 06:44:30.045574 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:30.045342    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8" event={"ID":"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec","Type":"ContainerDied","Data":"ff1026be96c1d0d8a94fe3d927f9ee09da8af2767268f21c431ce10758a6f680"}
Sep 05 06:44:30.045574 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:30.045466    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8" event={"ID":"e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec","Type":"ContainerDied","Data":"098920531db390789ae728245071d9b7a0db3a1f8967231b7d850b41453a78bb"}
Sep 05 06:44:30.045574 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:30.045499    2583 scope.go:117] "RemoveContainer" containerID="ff1026be96c1d0d8a94fe3d927f9ee09da8af2767268f21c431ce10758a6f680"
Sep 05 06:44:30.055628 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:30.055598    2583 scope.go:117] "RemoveContainer" containerID="ff1026be96c1d0d8a94fe3d927f9ee09da8af2767268f21c431ce10758a6f680"
Sep 05 06:44:30.056818 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:44:30.056788    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1026be96c1d0d8a94fe3d927f9ee09da8af2767268f21c431ce10758a6f680\": container with ID starting with ff1026be96c1d0d8a94fe3d927f9ee09da8af2767268f21c431ce10758a6f680 not found: ID does not exist" containerID="ff1026be96c1d0d8a94fe3d927f9ee09da8af2767268f21c431ce10758a6f680"
Sep 05 06:44:30.057221 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:30.056828    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1026be96c1d0d8a94fe3d927f9ee09da8af2767268f21c431ce10758a6f680"} err="failed to get container status \"ff1026be96c1d0d8a94fe3d927f9ee09da8af2767268f21c431ce10758a6f680\": rpc error: code = NotFound desc = could not find container \"ff1026be96c1d0d8a94fe3d927f9ee09da8af2767268f21c431ce10758a6f680\": container with ID starting with ff1026be96c1d0d8a94fe3d927f9ee09da8af2767268f21c431ce10758a6f680 not found: ID does not exist"
Sep 05 06:44:30.076012 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:30.075988    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"]
Sep 05 06:44:30.080827 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:30.080806    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8"]
Sep 05 06:44:30.195663 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:30.195630    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:30.914255 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:30.914223    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec" path="/var/lib/kubelet/pods/e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec/volumes"
Sep 05 06:44:32.674142 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:32.674103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:32.778905 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:32.778876    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:32.874462 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:32.874426    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:32.974669 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:32.974638    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:33.663107 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:33.663075    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:44:33.668060 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:33.668031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:33.736954 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:33.736921    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:33.837820 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:33.837784    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:35.386026 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:35.385991    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:36.601262 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:36.601221    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:36.672137 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:36.672103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:36.874087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:36.874005    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:37.114807 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:37.114772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:37.466072 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:37.466036    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:37.779528 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:37.779440    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:38.144142 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:38.144063    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:41.066353 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:41.066315    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:44:41.115044 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:41.115002    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:41.215791 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:41.215754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:41.921119 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:41.921083    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:42.022086 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.022052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:42.326624 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.326590    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:42.405733 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.405695    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:42.516512 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.516474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:42.639786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.639703    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:42.840561 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.840534    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:42.938365 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.938289    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:42.983967 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.983936    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"]
Sep 05 06:44:42.984314 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984296    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0933122f-9f68-4bbe-9620-09c653705d52" containerName="main"
Sep 05 06:44:42.984403 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984316    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0933122f-9f68-4bbe-9620-09c653705d52" containerName="main"
Sep 05 06:44:42.984403 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984329    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69c9092-d8e3-49a0-8416-a0a2368668e1" containerName="payload-pre-processing"
Sep 05 06:44:42.984403 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984338    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69c9092-d8e3-49a0-8416-a0a2368668e1" containerName="payload-pre-processing"
Sep 05 06:44:42.984403 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984350    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec" containerName="payload-pre-processing"
Sep 05 06:44:42.984403 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984358    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec" containerName="payload-pre-processing"
Sep 05 06:44:42.984403 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984379    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97b3a2f6-2f50-403d-affb-de20a96101ab" containerName="main"
Sep 05 06:44:42.984403 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984387    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="97b3a2f6-2f50-403d-affb-de20a96101ab" containerName="main"
Sep 05 06:44:42.984403 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984399    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="140dd883-f7f6-4cec-9d47-8d0448b7aaa3" containerName="payload-processing"
Sep 05 06:44:42.984782 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984407    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="140dd883-f7f6-4cec-9d47-8d0448b7aaa3" containerName="payload-processing"
Sep 05 06:44:42.984782 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984501    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2e8dc8d-1fe7-449f-aa8a-05a0f54b90ec" containerName="payload-pre-processing"
Sep 05 06:44:42.984782 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984512    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0933122f-9f68-4bbe-9620-09c653705d52" containerName="main"
Sep 05 06:44:42.984782 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984523    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c69c9092-d8e3-49a0-8416-a0a2368668e1" containerName="payload-pre-processing"
Sep 05 06:44:42.984782 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984533    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="140dd883-f7f6-4cec-9d47-8d0448b7aaa3" containerName="payload-processing"
Sep 05 06:44:42.984782 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.984543    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="97b3a2f6-2f50-403d-affb-de20a96101ab" containerName="main"
Sep 05 06:44:42.987655 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.987634    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"
Sep 05 06:44:42.991762 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.991743    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-ef54fd-dockercfg-6h62q\""
Sep 05 06:44:42.991994 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.991776    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-ef54fd\""
Sep 05 06:44:42.998116 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:42.998091    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"]
Sep 05 06:44:43.039792 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:43.039766    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9819c766-c012-4594-a4be-21488bb4a706-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv\" (UID: \"9819c766-c012-4594-a4be-21488bb4a706\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"
Sep 05 06:44:43.039927 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:43.039822    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h986x\" (UniqueName: \"kubernetes.io/projected/9819c766-c012-4594-a4be-21488bb4a706-kube-api-access-h986x\") pod \"payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv\" (UID: \"9819c766-c012-4594-a4be-21488bb4a706\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"
Sep 05 06:44:43.142795 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:43.142708    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h986x\" (UniqueName: \"kubernetes.io/projected/9819c766-c012-4594-a4be-21488bb4a706-kube-api-access-h986x\") pod \"payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv\" (UID: \"9819c766-c012-4594-a4be-21488bb4a706\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"
Sep 05 06:44:43.143105 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:43.143082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9819c766-c012-4594-a4be-21488bb4a706-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv\" (UID: \"9819c766-c012-4594-a4be-21488bb4a706\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"
Sep 05 06:44:43.144065 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:43.144028    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9819c766-c012-4594-a4be-21488bb4a706-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv\" (UID: \"9819c766-c012-4594-a4be-21488bb4a706\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"
Sep 05 06:44:43.151707 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:43.151680    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h986x\" (UniqueName: \"kubernetes.io/projected/9819c766-c012-4594-a4be-21488bb4a706-kube-api-access-h986x\") pod \"payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv\" (UID: \"9819c766-c012-4594-a4be-21488bb4a706\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"
Sep 05 06:44:43.299633 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:43.299593    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"
Sep 05 06:44:43.583343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:43.583314    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"]
Sep 05 06:44:43.584878 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:44:43.584838    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9819c766_c012_4594_a4be_21488bb4a706.slice/crio-4a4d87427c1e31105e56074ad7570be7ef12ebe81cc77cc3c587b05287f9fe7a WatchSource:0}: Error finding container 4a4d87427c1e31105e56074ad7570be7ef12ebe81cc77cc3c587b05287f9fe7a: Status 404 returned error can't find the container with id 4a4d87427c1e31105e56074ad7570be7ef12ebe81cc77cc3c587b05287f9fe7a
Sep 05 06:44:44.115818 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:44.115777    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv" event={"ID":"9819c766-c012-4594-a4be-21488bb4a706","Type":"ContainerStarted","Data":"87ebd12b3a0164b4200c1ee9d16c2a0d9a894439b85988ef78e10661a43a0f0c"}
Sep 05 06:44:44.116045 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:44.115843    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv" event={"ID":"9819c766-c012-4594-a4be-21488bb4a706","Type":"ContainerStarted","Data":"4a4d87427c1e31105e56074ad7570be7ef12ebe81cc77cc3c587b05287f9fe7a"}
Sep 05 06:44:44.116045 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:44.116004    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"
Sep 05 06:44:44.135285 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:44.135230    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv" podStartSLOduration=2.13521546 podStartE2EDuration="2.13521546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:44:44.134317317 +0000 UTC m=+1181.738866158" watchObservedRunningTime="2026-09-05 06:44:44.13521546 +0000 UTC m=+1181.739764289"
Sep 05 06:44:48.675510 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:48.675468    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:48.773981 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:48.773944    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:48.909621 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:48.909579    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:49.243241 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:49.243204    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:49.658150 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:49.658068    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:44:49.666270 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:49.666234    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:52.210341 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:52.210290    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:52.300631 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:52.300588    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:53.521320 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:53.521286    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:53.621811 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:53.621777    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:53.721361 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:53.721322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:54.122122 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.122087    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:54.217279 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.217247    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:44:54.235161 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.235130    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"]
Sep 05 06:44:54.238506 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.238489    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"
Sep 05 06:44:54.241536 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.241520    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-01e18c68-dockercfg-khnk2\""
Sep 05 06:44:54.241610 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.241558    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-01e18c68\""
Sep 05 06:44:54.249094 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.249070    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"]
Sep 05 06:44:54.340732 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.340704    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/928ff3fe-8194-4372-a42a-a417a55d1774-plugins-config-volume\") pod \"payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs\" (UID: \"928ff3fe-8194-4372-a42a-a417a55d1774\") " pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"
Sep 05 06:44:54.340910 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.340743    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f2hx\" (UniqueName: \"kubernetes.io/projected/928ff3fe-8194-4372-a42a-a417a55d1774-kube-api-access-5f2hx\") pod \"payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs\" (UID: \"928ff3fe-8194-4372-a42a-a417a55d1774\") " pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"
Sep 05 06:44:54.441216 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.441137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/928ff3fe-8194-4372-a42a-a417a55d1774-plugins-config-volume\") pod \"payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs\" (UID: \"928ff3fe-8194-4372-a42a-a417a55d1774\") " pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"
Sep 05 06:44:54.441216 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.441182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f2hx\" (UniqueName: \"kubernetes.io/projected/928ff3fe-8194-4372-a42a-a417a55d1774-kube-api-access-5f2hx\") pod \"payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs\" (UID: \"928ff3fe-8194-4372-a42a-a417a55d1774\") " pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"
Sep 05 06:44:54.441935 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.441913    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/928ff3fe-8194-4372-a42a-a417a55d1774-plugins-config-volume\") pod \"payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs\" (UID: \"928ff3fe-8194-4372-a42a-a417a55d1774\") " pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"
Sep 05 06:44:54.450227 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.450200    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f2hx\" (UniqueName: \"kubernetes.io/projected/928ff3fe-8194-4372-a42a-a417a55d1774-kube-api-access-5f2hx\") pod \"payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs\" (UID: \"928ff3fe-8194-4372-a42a-a417a55d1774\") " pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"
Sep 05 06:44:54.549403 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.549374    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"
Sep 05 06:44:54.822983 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:54.822949    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"]
Sep 05 06:44:54.825720 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:44:54.825688    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod928ff3fe_8194_4372_a42a_a417a55d1774.slice/crio-ed8a9374e0a3590749e8defcfa6598af770c28b030fb970886151d700e839d65 WatchSource:0}: Error finding container ed8a9374e0a3590749e8defcfa6598af770c28b030fb970886151d700e839d65: Status 404 returned error can't find the container with id ed8a9374e0a3590749e8defcfa6598af770c28b030fb970886151d700e839d65
Sep 05 06:44:55.123480 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:55.123388    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"
Sep 05 06:44:55.168546 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:55.168511    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs" event={"ID":"928ff3fe-8194-4372-a42a-a417a55d1774","Type":"ContainerStarted","Data":"f546d9ec9f4dc99feca9a31fa4b4eacfeb39a3135821eb16fbcdf546360bc4fb"}
Sep 05 06:44:55.168722 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:55.168567    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs" event={"ID":"928ff3fe-8194-4372-a42a-a417a55d1774","Type":"ContainerStarted","Data":"ed8a9374e0a3590749e8defcfa6598af770c28b030fb970886151d700e839d65"}
Sep 05 06:44:55.168722 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:55.168605    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"
Sep 05 06:44:57.254368 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:57.254313    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs" podStartSLOduration=3.254293435 podStartE2EDuration="3.254293435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:44:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:44:55.188422621 +0000 UTC m=+1192.792971458" watchObservedRunningTime="2026-09-05 06:44:57.254293435 +0000 UTC m=+1194.858842273"
Sep 05 06:44:57.255366 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:44:57.255343    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:45:00.139624 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:00.139589    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29809845-7xll4"]
Sep 05 06:45:00.145076 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:00.145041    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25"]
Sep 05 06:45:00.145661 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:00.145635    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809845-7xll4"
Sep 05 06:45:00.148696 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:00.148673    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:45:00.150515 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:00.150495    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25"
Sep 05 06:45:00.156816 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:00.156795    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29809845-7xll4"]
Sep 05 06:45:00.158939 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:00.158914    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25"]
Sep 05 06:45:00.159240 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:00.159222    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809845-7xll4"
Sep 05 06:45:00.166872 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:00.166837    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25"
Sep 05 06:45:00.441541 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:00.441512    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29809845-7xll4"]
Sep 05 06:45:00.444135 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:45:00.444103    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50cc870_a11a_41a0_8f9b_01b569752fcd.slice/crio-ef2b9475225ec7ef4911521abb3087cf95019ae2d0a45b98f6ea5a39d59bd6ff WatchSource:0}: Error finding container ef2b9475225ec7ef4911521abb3087cf95019ae2d0a45b98f6ea5a39d59bd6ff: Status 404 returned error can't find the container with id ef2b9475225ec7ef4911521abb3087cf95019ae2d0a45b98f6ea5a39d59bd6ff
Sep 05 06:45:00.445596 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:00.445575    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25"]
Sep 05 06:45:00.447352 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:45:00.447328    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4018a3f_b0c8_4aa2_b260_665a5f7aa917.slice/crio-a51a5c250b02da2929053a5df15abfa7671e50f40c89d57528af43200c6061e5 WatchSource:0}: Error finding container a51a5c250b02da2929053a5df15abfa7671e50f40c89d57528af43200c6061e5: Status 404 returned error can't find the container with id a51a5c250b02da2929053a5df15abfa7671e50f40c89d57528af43200c6061e5
Sep 05 06:45:01.202029 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:01.201993    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25" event={"ID":"e4018a3f-b0c8-4aa2-b260-665a5f7aa917","Type":"ContainerStarted","Data":"df6e407cb76e57025aecb5126442243e45cf487b8d84305f5035ede9e4a184a6"}
Sep 05 06:45:01.202453 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:01.202061    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25" event={"ID":"e4018a3f-b0c8-4aa2-b260-665a5f7aa917","Type":"ContainerStarted","Data":"a51a5c250b02da2929053a5df15abfa7671e50f40c89d57528af43200c6061e5"}
Sep 05 06:45:01.204467 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:01.204439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809845-7xll4" event={"ID":"e50cc870-a11a-41a0-8f9b-01b569752fcd","Type":"ContainerStarted","Data":"58d6d2cbcd3d3fd383a47afc3f27c333b6f9e5780df87073f9ca871d85832608"}
Sep 05 06:45:01.204593 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:01.204506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809845-7xll4" event={"ID":"e50cc870-a11a-41a0-8f9b-01b569752fcd","Type":"ContainerStarted","Data":"ef2b9475225ec7ef4911521abb3087cf95019ae2d0a45b98f6ea5a39d59bd6ff"}
Sep 05 06:45:01.219432 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:01.219378    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25" podStartSLOduration=1.219362905 podStartE2EDuration="1.219362905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:45:01.217337067 +0000 UTC m=+1198.821885905" watchObservedRunningTime="2026-09-05 06:45:01.219362905 +0000 UTC m=+1198.823911737"
Sep 05 06:45:01.232916 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:01.232846    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809845-7xll4" podStartSLOduration=1.232832785 podStartE2EDuration="1.232832785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:45:01.232023049 +0000 UTC m=+1198.836571889" watchObservedRunningTime="2026-09-05 06:45:01.232832785 +0000 UTC m=+1198.837381623"
Sep 05 06:45:02.210942 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:02.210903    2583 generic.go:356] "Generic (PLEG): container finished" podID="e4018a3f-b0c8-4aa2-b260-665a5f7aa917" containerID="df6e407cb76e57025aecb5126442243e45cf487b8d84305f5035ede9e4a184a6" exitCode=7
Sep 05 06:45:02.211415 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:02.210987    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25" event={"ID":"e4018a3f-b0c8-4aa2-b260-665a5f7aa917","Type":"ContainerDied","Data":"df6e407cb76e57025aecb5126442243e45cf487b8d84305f5035ede9e4a184a6"}
Sep 05 06:45:02.211415 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:02.211128    2583 scope.go:117] "RemoveContainer" containerID="df6e407cb76e57025aecb5126442243e45cf487b8d84305f5035ede9e4a184a6"
Sep 05 06:45:02.212723 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:02.212702    2583 generic.go:356] "Generic (PLEG): container finished" podID="e50cc870-a11a-41a0-8f9b-01b569752fcd" containerID="58d6d2cbcd3d3fd383a47afc3f27c333b6f9e5780df87073f9ca871d85832608" exitCode=0
Sep 05 06:45:02.212825 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:02.212762    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809845-7xll4" event={"ID":"e50cc870-a11a-41a0-8f9b-01b569752fcd","Type":"ContainerDied","Data":"58d6d2cbcd3d3fd383a47afc3f27c333b6f9e5780df87073f9ca871d85832608"}
Sep 05 06:45:03.221676 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:03.221637    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25" event={"ID":"e4018a3f-b0c8-4aa2-b260-665a5f7aa917","Type":"ContainerStarted","Data":"edda833bd073ddcadf2f10424de9c08c2ba37a2b5d96b339641c5b3df78d8fed"}
Sep 05 06:45:03.290334 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:03.290290    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:03.376284 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:03.376260    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809845-7xll4"
Sep 05 06:45:04.227846 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:04.227817    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809845-7xll4"
Sep 05 06:45:04.228300 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:04.227857    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809845-7xll4" event={"ID":"e50cc870-a11a-41a0-8f9b-01b569752fcd","Type":"ContainerDied","Data":"ef2b9475225ec7ef4911521abb3087cf95019ae2d0a45b98f6ea5a39d59bd6ff"}
Sep 05 06:45:04.228300 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:04.227933    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef2b9475225ec7ef4911521abb3087cf95019ae2d0a45b98f6ea5a39d59bd6ff"
Sep 05 06:45:04.229797 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:04.229767    2583 generic.go:356] "Generic (PLEG): container finished" podID="e4018a3f-b0c8-4aa2-b260-665a5f7aa917" containerID="edda833bd073ddcadf2f10424de9c08c2ba37a2b5d96b339641c5b3df78d8fed" exitCode=0
Sep 05 06:45:04.229918 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:04.229813    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25" event={"ID":"e4018a3f-b0c8-4aa2-b260-665a5f7aa917","Type":"ContainerDied","Data":"edda833bd073ddcadf2f10424de9c08c2ba37a2b5d96b339641c5b3df78d8fed"}
Sep 05 06:45:04.229918 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:04.229882    2583 scope.go:117] "RemoveContainer" containerID="df6e407cb76e57025aecb5126442243e45cf487b8d84305f5035ede9e4a184a6"
Sep 05 06:45:05.375414 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:05.375392    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25"
Sep 05 06:45:06.128980 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:06.128943    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:06.175667 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:06.175638    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"
Sep 05 06:45:06.242076 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:06.242035    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25" event={"ID":"e4018a3f-b0c8-4aa2-b260-665a5f7aa917","Type":"ContainerDied","Data":"a51a5c250b02da2929053a5df15abfa7671e50f40c89d57528af43200c6061e5"}
Sep 05 06:45:06.242076 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:06.242073    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25"
Sep 05 06:45:06.242289 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:06.242094    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a51a5c250b02da2929053a5df15abfa7671e50f40c89d57528af43200c6061e5"
Sep 05 06:45:06.471890 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:06.471818    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:06.791041 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:06.790954    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:06.944665 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:06.944633    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:10.403602 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:10.403569    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:10.500917 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:10.500882    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:11.560912 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:11.560857    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:11.662612 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:11.662576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:11.775580 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:11.775545    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:12.064434 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:12.064402    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:12.164107 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:12.164077    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:15.166943 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:15.166902    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:45:15.667416 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:15.667383    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:17.229008 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:17.228969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:17.923260 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:17.923226    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:18.022046 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:18.022012    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:18.379592 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:18.379555    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:24.452835 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.452786    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:24.555081 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.555042    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:24.846391 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.846300    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t"]
Sep 05 06:45:24.846749 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.846728    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4018a3f-b0c8-4aa2-b260-665a5f7aa917" containerName="cleanup"
Sep 05 06:45:24.846844 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.846751    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4018a3f-b0c8-4aa2-b260-665a5f7aa917" containerName="cleanup"
Sep 05 06:45:24.846844 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.846776    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4018a3f-b0c8-4aa2-b260-665a5f7aa917" containerName="cleanup"
Sep 05 06:45:24.846844 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.846787    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4018a3f-b0c8-4aa2-b260-665a5f7aa917" containerName="cleanup"
Sep 05 06:45:24.846844 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.846803    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50cc870-a11a-41a0-8f9b-01b569752fcd" containerName="cleanup"
Sep 05 06:45:24.846844 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.846811    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50cc870-a11a-41a0-8f9b-01b569752fcd" containerName="cleanup"
Sep 05 06:45:24.847112 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.846927    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e50cc870-a11a-41a0-8f9b-01b569752fcd" containerName="cleanup"
Sep 05 06:45:24.847112 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.846942    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4018a3f-b0c8-4aa2-b260-665a5f7aa917" containerName="cleanup"
Sep 05 06:45:24.850048 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.850027    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t"
Sep 05 06:45:24.853299 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.853279    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:45:24.853601 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.853586    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:45:24.865554 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.865534    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t"]
Sep 05 06:45:24.881506 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.881483    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86cc08e6-169b-464c-97f2-8581baebb54f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-01e18c68-qx85t\" (UID: \"86cc08e6-169b-464c-97f2-8581baebb54f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t"
Sep 05 06:45:24.982222 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.982185    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86cc08e6-169b-464c-97f2-8581baebb54f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-01e18c68-qx85t\" (UID: \"86cc08e6-169b-464c-97f2-8581baebb54f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t"
Sep 05 06:45:24.982830 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:24.982800    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86cc08e6-169b-464c-97f2-8581baebb54f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-01e18c68-qx85t\" (UID: \"86cc08e6-169b-464c-97f2-8581baebb54f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t"
Sep 05 06:45:25.159695 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:25.159600    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t"
Sep 05 06:45:25.429112 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:25.429081    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t"]
Sep 05 06:45:25.431322 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:45:25.431298    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86cc08e6_169b_464c_97f2_8581baebb54f.slice/crio-95c24448cae5e8b96fb5bb210dfdba93eed80def896f93eebe114a8c4ea0bd82 WatchSource:0}: Error finding container 95c24448cae5e8b96fb5bb210dfdba93eed80def896f93eebe114a8c4ea0bd82: Status 404 returned error can't find the container with id 95c24448cae5e8b96fb5bb210dfdba93eed80def896f93eebe114a8c4ea0bd82
Sep 05 06:45:26.346882 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:26.346772    2583 generic.go:356] "Generic (PLEG): container finished" podID="86cc08e6-169b-464c-97f2-8581baebb54f" containerID="f315ce603ba5e2cf27c94bc832856a0592ec5358d9073f40f403fdec8fd493e6" exitCode=0
Sep 05 06:45:26.347282 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:26.346883    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t" event={"ID":"86cc08e6-169b-464c-97f2-8581baebb54f","Type":"ContainerDied","Data":"f315ce603ba5e2cf27c94bc832856a0592ec5358d9073f40f403fdec8fd493e6"}
Sep 05 06:45:26.347282 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:26.346944    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t" event={"ID":"86cc08e6-169b-464c-97f2-8581baebb54f","Type":"ContainerStarted","Data":"95c24448cae5e8b96fb5bb210dfdba93eed80def896f93eebe114a8c4ea0bd82"}
Sep 05 06:45:27.483565 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:27.483539    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t"
Sep 05 06:45:27.503617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:27.503577    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86cc08e6-169b-464c-97f2-8581baebb54f-maas-api-service-ca\") pod \"86cc08e6-169b-464c-97f2-8581baebb54f\" (UID: \"86cc08e6-169b-464c-97f2-8581baebb54f\") "
Sep 05 06:45:27.503939 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:27.503917    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86cc08e6-169b-464c-97f2-8581baebb54f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "86cc08e6-169b-464c-97f2-8581baebb54f" (UID: "86cc08e6-169b-464c-97f2-8581baebb54f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:45:27.604439 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:27.604355    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86cc08e6-169b-464c-97f2-8581baebb54f-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:45:28.358152 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:28.358120    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t"
Sep 05 06:45:28.358419 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:28.358149    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t" event={"ID":"86cc08e6-169b-464c-97f2-8581baebb54f","Type":"ContainerDied","Data":"95c24448cae5e8b96fb5bb210dfdba93eed80def896f93eebe114a8c4ea0bd82"}
Sep 05 06:45:28.358419 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:28.358214    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95c24448cae5e8b96fb5bb210dfdba93eed80def896f93eebe114a8c4ea0bd82"
Sep 05 06:45:32.501131 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:32.501099    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:34.972581 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:34.972547    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:35.447000 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:35.446917    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:35.694092 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:35.694053    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25"]
Sep 05 06:45:35.699286 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:35.699255    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:35.700320 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:35.700296    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-01e18c68-29809845-6fj25"]
Sep 05 06:45:35.727008 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:35.726980    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"]
Sep 05 06:45:35.727336 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:35.727308    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs" podUID="928ff3fe-8194-4372-a42a-a417a55d1774" containerName="payload-processing" containerID="cri-o://f546d9ec9f4dc99feca9a31fa4b4eacfeb39a3135821eb16fbcdf546360bc4fb" gracePeriod=30
Sep 05 06:45:35.797386 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:35.797345    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:35.901740 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:35.901660    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:35.903595 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:35.903461    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t"]
Sep 05 06:45:35.906044 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:35.906017    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01e18c68-qx85t"]
Sep 05 06:45:35.995197 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:35.995162    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"
Sep 05 06:45:35.999714 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:35.999680    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:36.073353 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.073317    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f2hx\" (UniqueName: \"kubernetes.io/projected/928ff3fe-8194-4372-a42a-a417a55d1774-kube-api-access-5f2hx\") pod \"928ff3fe-8194-4372-a42a-a417a55d1774\" (UID: \"928ff3fe-8194-4372-a42a-a417a55d1774\") "
Sep 05 06:45:36.073507 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.073365    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/928ff3fe-8194-4372-a42a-a417a55d1774-plugins-config-volume\") pod \"928ff3fe-8194-4372-a42a-a417a55d1774\" (UID: \"928ff3fe-8194-4372-a42a-a417a55d1774\") "
Sep 05 06:45:36.073734 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.073704    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/928ff3fe-8194-4372-a42a-a417a55d1774-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "928ff3fe-8194-4372-a42a-a417a55d1774" (UID: "928ff3fe-8194-4372-a42a-a417a55d1774"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:45:36.075354 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.075334    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/928ff3fe-8194-4372-a42a-a417a55d1774-kube-api-access-5f2hx" (OuterVolumeSpecName: "kube-api-access-5f2hx") pod "928ff3fe-8194-4372-a42a-a417a55d1774" (UID: "928ff3fe-8194-4372-a42a-a417a55d1774"). InnerVolumeSpecName "kube-api-access-5f2hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:45:36.175025 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.174990    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f2hx\" (UniqueName: \"kubernetes.io/projected/928ff3fe-8194-4372-a42a-a417a55d1774-kube-api-access-5f2hx\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:45:36.175025 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.175018    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/928ff3fe-8194-4372-a42a-a417a55d1774-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:45:36.284825 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.284736    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:36.402109 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.402072    2583 generic.go:356] "Generic (PLEG): container finished" podID="928ff3fe-8194-4372-a42a-a417a55d1774" containerID="f546d9ec9f4dc99feca9a31fa4b4eacfeb39a3135821eb16fbcdf546360bc4fb" exitCode=0
Sep 05 06:45:36.402283 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.402115    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"
Sep 05 06:45:36.402283 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.402150    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs" event={"ID":"928ff3fe-8194-4372-a42a-a417a55d1774","Type":"ContainerDied","Data":"f546d9ec9f4dc99feca9a31fa4b4eacfeb39a3135821eb16fbcdf546360bc4fb"}
Sep 05 06:45:36.402283 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.402217    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs" event={"ID":"928ff3fe-8194-4372-a42a-a417a55d1774","Type":"ContainerDied","Data":"ed8a9374e0a3590749e8defcfa6598af770c28b030fb970886151d700e839d65"}
Sep 05 06:45:36.402283 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.402255    2583 scope.go:117] "RemoveContainer" containerID="f546d9ec9f4dc99feca9a31fa4b4eacfeb39a3135821eb16fbcdf546360bc4fb"
Sep 05 06:45:36.411936 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.411916    2583 scope.go:117] "RemoveContainer" containerID="f546d9ec9f4dc99feca9a31fa4b4eacfeb39a3135821eb16fbcdf546360bc4fb"
Sep 05 06:45:36.412216 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:45:36.412196    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f546d9ec9f4dc99feca9a31fa4b4eacfeb39a3135821eb16fbcdf546360bc4fb\": container with ID starting with f546d9ec9f4dc99feca9a31fa4b4eacfeb39a3135821eb16fbcdf546360bc4fb not found: ID does not exist" containerID="f546d9ec9f4dc99feca9a31fa4b4eacfeb39a3135821eb16fbcdf546360bc4fb"
Sep 05 06:45:36.412309 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.412225    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f546d9ec9f4dc99feca9a31fa4b4eacfeb39a3135821eb16fbcdf546360bc4fb"} err="failed to get container status \"f546d9ec9f4dc99feca9a31fa4b4eacfeb39a3135821eb16fbcdf546360bc4fb\": rpc error: code = NotFound desc = could not find container \"f546d9ec9f4dc99feca9a31fa4b4eacfeb39a3135821eb16fbcdf546360bc4fb\": container with ID starting with f546d9ec9f4dc99feca9a31fa4b4eacfeb39a3135821eb16fbcdf546360bc4fb not found: ID does not exist"
Sep 05 06:45:36.425356 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.425326    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"]
Sep 05 06:45:36.429593 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.429564    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs"]
Sep 05 06:45:36.914977 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.914944    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86cc08e6-169b-464c-97f2-8581baebb54f" path="/var/lib/kubelet/pods/86cc08e6-169b-464c-97f2-8581baebb54f/volumes"
Sep 05 06:45:36.915423 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.915404    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="928ff3fe-8194-4372-a42a-a417a55d1774" path="/var/lib/kubelet/pods/928ff3fe-8194-4372-a42a-a417a55d1774/volumes"
Sep 05 06:45:36.915673 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:36.915660    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4018a3f-b0c8-4aa2-b260-665a5f7aa917" path="/var/lib/kubelet/pods/e4018a3f-b0c8-4aa2-b260-665a5f7aa917/volumes"
Sep 05 06:45:39.075110 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:39.075074    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:45:42.292286 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:42.292250    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:42.391759 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:42.391680    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:42.566804 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:42.566717    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:42.907535 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:42.907448    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:43.007571 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:43.007533    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:43.149020 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:43.148981    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:49.486803 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:49.486772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:49.591678 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:49.591630    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:49.685036 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:49.685004    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:49.818146 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:49.818066    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:53.459226 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.459190    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"]
Sep 05 06:45:53.459713 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.459530    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86cc08e6-169b-464c-97f2-8581baebb54f" containerName="revoke-keys"
Sep 05 06:45:53.459713 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.459545    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="86cc08e6-169b-464c-97f2-8581baebb54f" containerName="revoke-keys"
Sep 05 06:45:53.459713 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.459571    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="928ff3fe-8194-4372-a42a-a417a55d1774" containerName="payload-processing"
Sep 05 06:45:53.459713 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.459578    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="928ff3fe-8194-4372-a42a-a417a55d1774" containerName="payload-processing"
Sep 05 06:45:53.459713 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.459649    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4018a3f-b0c8-4aa2-b260-665a5f7aa917" containerName="cleanup"
Sep 05 06:45:53.459713 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.459659    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="928ff3fe-8194-4372-a42a-a417a55d1774" containerName="payload-processing"
Sep 05 06:45:53.459713 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.459667    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="86cc08e6-169b-464c-97f2-8581baebb54f" containerName="revoke-keys"
Sep 05 06:45:53.463819 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.463797    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.467977 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.467956    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-ef54fd\"/\"kube-root-ca.crt\""
Sep 05 06:45:53.468222 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.468205    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-ef54fd\"/\"default-dockercfg-8pxrt\""
Sep 05 06:45:53.468323 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.468209    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-ef54fd\"/\"auth-test-model-ef54fd-kserve-self-signed-certs\""
Sep 05 06:45:53.468435 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.468418    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-ef54fd\"/\"openshift-service-ca.crt\""
Sep 05 06:45:53.473249 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.473226    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"]
Sep 05 06:45:53.491462 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.491432    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:53.522226 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.522196    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-dshm\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.522363 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.522243    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-tmp-dir\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.522363 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.522270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-tls-certs\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.522363 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.522347    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-model-cache\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.522497 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.522406    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-home\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.522497 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.522431    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzqkb\" (UniqueName: \"kubernetes.io/projected/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-kube-api-access-dzqkb\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.622947 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.622913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-home\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.622947 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.622948    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzqkb\" (UniqueName: \"kubernetes.io/projected/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-kube-api-access-dzqkb\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.623187 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.622986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-dshm\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.623187 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.623006    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-tmp-dir\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.623187 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.623027    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-tls-certs\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.623187 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.623058    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-model-cache\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.623397 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.623365    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-home\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.623460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.623427    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-model-cache\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.623522 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.623503    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-tmp-dir\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.625383 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.625360    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-dshm\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.625647 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.625630    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-tls-certs\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.631559 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.631536    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzqkb\" (UniqueName: \"kubernetes.io/projected/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-kube-api-access-dzqkb\") pod \"auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:53.773912 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:53.773811    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:45:54.065804 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:54.065779    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"]
Sep 05 06:45:54.068557 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:45:54.068526    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7eb1c74d_c70a_4f7e_a9fd_a4d9a5df2847.slice/crio-ab327a3d75e4d320ead14e8a1004d745d465a85dc5cf47d41121f13ee97b048e WatchSource:0}: Error finding container ab327a3d75e4d320ead14e8a1004d745d465a85dc5cf47d41121f13ee97b048e: Status 404 returned error can't find the container with id ab327a3d75e4d320ead14e8a1004d745d465a85dc5cf47d41121f13ee97b048e
Sep 05 06:45:54.494636 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:54.494598    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl" event={"ID":"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847","Type":"ContainerStarted","Data":"59259ceb37e0f8699c2b31929ea8c4cecf9d4d21ff568b5b46b8751a954466df"}
Sep 05 06:45:54.495038 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:54.494649    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl" event={"ID":"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847","Type":"ContainerStarted","Data":"ab327a3d75e4d320ead14e8a1004d745d465a85dc5cf47d41121f13ee97b048e"}
Sep 05 06:45:54.514857 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:54.514803    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl" podStartSLOduration=1.514788507 podStartE2EDuration="1.514788507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:45:54.513933221 +0000 UTC m=+1252.118482061" watchObservedRunningTime="2026-09-05 06:45:54.514788507 +0000 UTC m=+1252.119337345"
Sep 05 06:45:56.615062 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:56.614978    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:56.716919 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:56.716853    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:56.762386 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:56.762349    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:45:57.571555 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:57.571516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:57.888751 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:57.888656    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:45:58.154656 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:45:58.154571    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:00.681466 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:00.681429    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:00.777970 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:00.777934    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:01.894968 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:01.894919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:01.968742 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:01.968707    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:02.436377 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.436346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:02.531134 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.531091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:02.552813 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.552779    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"]
Sep 05 06:46:02.556167 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.556150    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"
Sep 05 06:46:02.559274 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.559247    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-eac764-dockercfg-n8r7d\""
Sep 05 06:46:02.559274 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.559267    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-eac764\""
Sep 05 06:46:02.569342 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.569318    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"]
Sep 05 06:46:02.701940 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.701912    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8dj4\" (UniqueName: \"kubernetes.io/projected/fdcb0142-d6db-4dc6-95e3-31f9d33129b9-kube-api-access-n8dj4\") pod \"payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c\" (UID: \"fdcb0142-d6db-4dc6-95e3-31f9d33129b9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"
Sep 05 06:46:02.702114 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.701960    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdcb0142-d6db-4dc6-95e3-31f9d33129b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c\" (UID: \"fdcb0142-d6db-4dc6-95e3-31f9d33129b9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"
Sep 05 06:46:02.802453 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.802409    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdcb0142-d6db-4dc6-95e3-31f9d33129b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c\" (UID: \"fdcb0142-d6db-4dc6-95e3-31f9d33129b9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"
Sep 05 06:46:02.802647 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.802532    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8dj4\" (UniqueName: \"kubernetes.io/projected/fdcb0142-d6db-4dc6-95e3-31f9d33129b9-kube-api-access-n8dj4\") pod \"payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c\" (UID: \"fdcb0142-d6db-4dc6-95e3-31f9d33129b9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"
Sep 05 06:46:02.805341 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.805319    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-eac764\""
Sep 05 06:46:02.813527 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.813495    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdcb0142-d6db-4dc6-95e3-31f9d33129b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c\" (UID: \"fdcb0142-d6db-4dc6-95e3-31f9d33129b9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"
Sep 05 06:46:02.815634 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.815610    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8dj4\" (UniqueName: \"kubernetes.io/projected/fdcb0142-d6db-4dc6-95e3-31f9d33129b9-kube-api-access-n8dj4\") pod \"payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c\" (UID: \"fdcb0142-d6db-4dc6-95e3-31f9d33129b9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"
Sep 05 06:46:02.869976 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.869940    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-eac764-dockercfg-n8r7d\""
Sep 05 06:46:02.877314 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:02.877295    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"
Sep 05 06:46:03.163105 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:03.163074    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"]
Sep 05 06:46:03.165029 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:46:03.165004    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdcb0142_d6db_4dc6_95e3_31f9d33129b9.slice/crio-4b1d3a3227b330baefb4241934378ebb173888d8fb88a6cef29839f9fd594972 WatchSource:0}: Error finding container 4b1d3a3227b330baefb4241934378ebb173888d8fb88a6cef29839f9fd594972: Status 404 returned error can't find the container with id 4b1d3a3227b330baefb4241934378ebb173888d8fb88a6cef29839f9fd594972
Sep 05 06:46:03.541318 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:03.541283    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c" event={"ID":"fdcb0142-d6db-4dc6-95e3-31f9d33129b9","Type":"ContainerStarted","Data":"991deb8da9d3e3017cfb7f8efcaad83fd98713e1581854e54e65abcc370eaf10"}
Sep 05 06:46:03.541492 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:03.541345    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c" event={"ID":"fdcb0142-d6db-4dc6-95e3-31f9d33129b9","Type":"ContainerStarted","Data":"4b1d3a3227b330baefb4241934378ebb173888d8fb88a6cef29839f9fd594972"}
Sep 05 06:46:03.541574 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:03.541506    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"
Sep 05 06:46:03.562376 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:03.562329    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c" podStartSLOduration=1.562314469 podStartE2EDuration="1.562314469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:46:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:46:03.561195142 +0000 UTC m=+1261.165743980" watchObservedRunningTime="2026-09-05 06:46:03.562314469 +0000 UTC m=+1261.166863307"
Sep 05 06:46:03.774543 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:03.774500    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:46:03.774737 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:03.774556    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:46:03.787124 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:03.787092    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:46:04.557463 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:04.557434    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:46:07.352144 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:07.352112    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:46:14.548103 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:14.548072    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"
Sep 05 06:46:24.978094 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:24.978060    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"]
Sep 05 06:46:24.981602 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:24.981584    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:24.985428 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:24.985389    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-5b1d24\"/\"default-dockercfg-b4rwk\""
Sep 05 06:46:24.985727 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:24.985706    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-5b1d24\"/\"openshift-service-ca.crt\""
Sep 05 06:46:24.986811 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:24.986791    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-5b1d24\"/\"kube-root-ca.crt\""
Sep 05 06:46:24.986958 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:24.986942    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-5b1d24\"/\"auth-test-model-5b1d24-kserve-self-signed-certs\""
Sep 05 06:46:24.997916 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:24.997887    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-home\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:24.998011 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:24.997959    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jshkd\" (UniqueName: \"kubernetes.io/projected/85715f59-8953-49ee-9708-6b43917c83e6-kube-api-access-jshkd\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:24.998011 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:24.997992    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-dshm\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:24.998091 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:24.998018    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-tmp-dir\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:24.998091 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:24.998055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85715f59-8953-49ee-9708-6b43917c83e6-tls-certs\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:24.998161 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:24.998094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-model-cache\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:24.998284 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:24.998262    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"]
Sep 05 06:46:25.024018 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.023988    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:25.098847 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.098816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-model-cache\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:25.099024 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.098888    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-home\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:25.099024 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.098922    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jshkd\" (UniqueName: \"kubernetes.io/projected/85715f59-8953-49ee-9708-6b43917c83e6-kube-api-access-jshkd\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:25.099024 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.098943    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-dshm\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:25.099024 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.098960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-tmp-dir\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:25.099263 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.099093    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85715f59-8953-49ee-9708-6b43917c83e6-tls-certs\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:25.099263 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.099237    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-model-cache\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:25.099388 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.099376    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-tmp-dir\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:25.099465 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.099447    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-home\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:25.101380 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.101350    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-dshm\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:25.101605 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.101587    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85715f59-8953-49ee-9708-6b43917c83e6-tls-certs\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:25.107291 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.107269    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jshkd\" (UniqueName: \"kubernetes.io/projected/85715f59-8953-49ee-9708-6b43917c83e6-kube-api-access-jshkd\") pod \"auth-test-model-5b1d24-kserve-658587544c-b6hm4\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:25.291284 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.291192    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:25.572834 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.572808    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"]
Sep 05 06:46:25.574554 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:46:25.574526    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85715f59_8953_49ee_9708_6b43917c83e6.slice/crio-ea80a6128071f164c885c5edd3cd96022e9ba05c670afa26c4ca3682f130b3b9 WatchSource:0}: Error finding container ea80a6128071f164c885c5edd3cd96022e9ba05c670afa26c4ca3682f130b3b9: Status 404 returned error can't find the container with id ea80a6128071f164c885c5edd3cd96022e9ba05c670afa26c4ca3682f130b3b9
Sep 05 06:46:25.652037 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.651997    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4" event={"ID":"85715f59-8953-49ee-9708-6b43917c83e6","Type":"ContainerStarted","Data":"1649a8bf570c07f10dd5351672f57345cfb1e25fea8e201eed654b4df7e0c00d"}
Sep 05 06:46:25.652220 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.652047    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4" event={"ID":"85715f59-8953-49ee-9708-6b43917c83e6","Type":"ContainerStarted","Data":"ea80a6128071f164c885c5edd3cd96022e9ba05c670afa26c4ca3682f130b3b9"}
Sep 05 06:46:25.669790 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.669738    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4" podStartSLOduration=1.669723953 podStartE2EDuration="1.669723953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:46:25.669562096 +0000 UTC m=+1283.274110936" watchObservedRunningTime="2026-09-05 06:46:25.669723953 +0000 UTC m=+1283.274272791"
Sep 05 06:46:25.722269 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:25.722233    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:26.079940 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:26.079908    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:26.416114 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:26.416019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:26.665509 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:26.665474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:29.827591 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:29.827551    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:29.916092 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:29.916061    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:30.659224 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:30.659171    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:46:30.999986 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:30.999950    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:31.074526 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.074497    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:31.174200 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.174136    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:31.522667 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.522634    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:31.644096 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.644058    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:31.773919 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.773834    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"]
Sep 05 06:46:31.777217 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.777200    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"
Sep 05 06:46:31.780758 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.780738    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-32e859\""
Sep 05 06:46:31.781831 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.781815    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-32e859-dockercfg-7rqbn\""
Sep 05 06:46:31.801717 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.801692    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"]
Sep 05 06:46:31.826273 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.826246    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"]
Sep 05 06:46:31.829598 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.829580    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"
Sep 05 06:46:31.840778 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.840756    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"]
Sep 05 06:46:31.857342 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.857295    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e8a0c6-a5df-4435-8b19-f8a79f86981a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk\" (UID: \"48e8a0c6-a5df-4435-8b19-f8a79f86981a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"
Sep 05 06:46:31.857504 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.857383    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pcdw\" (UniqueName: \"kubernetes.io/projected/48e8a0c6-a5df-4435-8b19-f8a79f86981a-kube-api-access-9pcdw\") pod \"payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk\" (UID: \"48e8a0c6-a5df-4435-8b19-f8a79f86981a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"
Sep 05 06:46:31.857504 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.857415    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c90f226-2248-416e-8bd1-a6d1c41629a0-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f\" (UID: \"5c90f226-2248-416e-8bd1-a6d1c41629a0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"
Sep 05 06:46:31.857620 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.857496    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd47x\" (UniqueName: \"kubernetes.io/projected/5c90f226-2248-416e-8bd1-a6d1c41629a0-kube-api-access-bd47x\") pod \"payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f\" (UID: \"5c90f226-2248-416e-8bd1-a6d1c41629a0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"
Sep 05 06:46:31.957952 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.957913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e8a0c6-a5df-4435-8b19-f8a79f86981a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk\" (UID: \"48e8a0c6-a5df-4435-8b19-f8a79f86981a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"
Sep 05 06:46:31.958154 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.958004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pcdw\" (UniqueName: \"kubernetes.io/projected/48e8a0c6-a5df-4435-8b19-f8a79f86981a-kube-api-access-9pcdw\") pod \"payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk\" (UID: \"48e8a0c6-a5df-4435-8b19-f8a79f86981a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"
Sep 05 06:46:31.958154 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.958039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c90f226-2248-416e-8bd1-a6d1c41629a0-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f\" (UID: \"5c90f226-2248-416e-8bd1-a6d1c41629a0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"
Sep 05 06:46:31.958154 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.958082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd47x\" (UniqueName: \"kubernetes.io/projected/5c90f226-2248-416e-8bd1-a6d1c41629a0-kube-api-access-bd47x\") pod \"payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f\" (UID: \"5c90f226-2248-416e-8bd1-a6d1c41629a0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"
Sep 05 06:46:31.958857 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.958826    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e8a0c6-a5df-4435-8b19-f8a79f86981a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk\" (UID: \"48e8a0c6-a5df-4435-8b19-f8a79f86981a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"
Sep 05 06:46:31.958967 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.958891    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c90f226-2248-416e-8bd1-a6d1c41629a0-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f\" (UID: \"5c90f226-2248-416e-8bd1-a6d1c41629a0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"
Sep 05 06:46:31.968507 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.968487    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd47x\" (UniqueName: \"kubernetes.io/projected/5c90f226-2248-416e-8bd1-a6d1c41629a0-kube-api-access-bd47x\") pod \"payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f\" (UID: \"5c90f226-2248-416e-8bd1-a6d1c41629a0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"
Sep 05 06:46:31.968984 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:31.968962    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pcdw\" (UniqueName: \"kubernetes.io/projected/48e8a0c6-a5df-4435-8b19-f8a79f86981a-kube-api-access-9pcdw\") pod \"payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk\" (UID: \"48e8a0c6-a5df-4435-8b19-f8a79f86981a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"
Sep 05 06:46:32.087974 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:32.087885    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"
Sep 05 06:46:32.140212 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:32.140032    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"
Sep 05 06:46:32.360494 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:32.360468    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"]
Sep 05 06:46:32.362433 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:46:32.362401    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e8a0c6_a5df_4435_8b19_f8a79f86981a.slice/crio-56b8535871fd768b51cf225acb92cea9ddadeb1188429bf59029b298bc3eba6e WatchSource:0}: Error finding container 56b8535871fd768b51cf225acb92cea9ddadeb1188429bf59029b298bc3eba6e: Status 404 returned error can't find the container with id 56b8535871fd768b51cf225acb92cea9ddadeb1188429bf59029b298bc3eba6e
Sep 05 06:46:32.423956 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:32.423932    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"]
Sep 05 06:46:32.425470 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:46:32.425451    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c90f226_2248_416e_8bd1_a6d1c41629a0.slice/crio-1d8e3a42fa7386b4bb1b943f8421a5be52010e47126f71867b88a201cfa98350 WatchSource:0}: Error finding container 1d8e3a42fa7386b4bb1b943f8421a5be52010e47126f71867b88a201cfa98350: Status 404 returned error can't find the container with id 1d8e3a42fa7386b4bb1b943f8421a5be52010e47126f71867b88a201cfa98350
Sep 05 06:46:32.687756 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:32.687648    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk" event={"ID":"48e8a0c6-a5df-4435-8b19-f8a79f86981a","Type":"ContainerStarted","Data":"190dcd67fb883373d22ad5bb44dab6cb08e971ba49546da29c5508ab0044d28d"}
Sep 05 06:46:32.687756 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:32.687713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk" event={"ID":"48e8a0c6-a5df-4435-8b19-f8a79f86981a","Type":"ContainerStarted","Data":"56b8535871fd768b51cf225acb92cea9ddadeb1188429bf59029b298bc3eba6e"}
Sep 05 06:46:32.688013 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:32.687808    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"
Sep 05 06:46:32.689348 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:32.689323    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f" event={"ID":"5c90f226-2248-416e-8bd1-a6d1c41629a0","Type":"ContainerStarted","Data":"b38af6dc6dfed10b2876e09e4664a0abdc59061159f14a787e2f3412a5bdd970"}
Sep 05 06:46:32.689483 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:32.689363    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f" event={"ID":"5c90f226-2248-416e-8bd1-a6d1c41629a0","Type":"ContainerStarted","Data":"1d8e3a42fa7386b4bb1b943f8421a5be52010e47126f71867b88a201cfa98350"}
Sep 05 06:46:32.689483 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:32.689409    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"
Sep 05 06:46:32.706523 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:32.706478    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk" podStartSLOduration=1.7064642650000001 podStartE2EDuration="1.706464265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:46:32.704937074 +0000 UTC m=+1290.309485913" watchObservedRunningTime="2026-09-05 06:46:32.706464265 +0000 UTC m=+1290.311013096"
Sep 05 06:46:32.723687 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:32.723648    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f" podStartSLOduration=1.7236359559999999 podStartE2EDuration="1.723635956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:46:32.7230468 +0000 UTC m=+1290.327595635" watchObservedRunningTime="2026-09-05 06:46:32.723635956 +0000 UTC m=+1290.328184793"
Sep 05 06:46:35.291979 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:35.291943    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:35.292382 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:35.292000    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:35.307795 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:35.307763    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:35.716971 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:35.716930    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:46:37.274108 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:37.274074    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:43.696759 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:43.696721    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"
Sep 05 06:46:43.697228 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:43.696813    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"
Sep 05 06:46:43.859980 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:43.859949    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:46:54.889890 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:54.889825    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:56.636657 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:56.636626    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:46:59.297055 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:46:59.297025    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:47:07.895184 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:07.895143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:47:08.230464 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:08.230435    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:47:08.374279 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:08.374238    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:47:11.065035 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:11.064989    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:47:11.163583 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:11.163548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:47:12.292296 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.292264    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:47:12.393832 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.393800    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:47:12.715636 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.715604    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:47:12.813727 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.813692    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:47:12.831858 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.831828    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"]
Sep 05 06:47:12.836222 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.836198    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"
Sep 05 06:47:12.838892 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.838849    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-c36aacf1\""
Sep 05 06:47:12.839022 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.838893    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-c36aacf1-dockercfg-v6742\""
Sep 05 06:47:12.846922 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.846896    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"]
Sep 05 06:47:12.864495 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.864468    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"]
Sep 05 06:47:12.868003 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.867985    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"
Sep 05 06:47:12.877654 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.877632    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"]
Sep 05 06:47:12.917418 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.917386    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6-plugins-config-volume\") pod \"payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn\" (UID: \"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6\") " pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"
Sep 05 06:47:12.917614 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:12.917510    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxvbc\" (UniqueName: \"kubernetes.io/projected/9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6-kube-api-access-mxvbc\") pod \"payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn\" (UID: \"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6\") " pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"
Sep 05 06:47:13.018329 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.018248    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxvbc\" (UniqueName: \"kubernetes.io/projected/9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6-kube-api-access-mxvbc\") pod \"payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn\" (UID: \"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6\") " pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"
Sep 05 06:47:13.018329 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.018291    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76c98864-35df-4a65-a2c3-bcd87b943e35-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq\" (UID: \"76c98864-35df-4a65-a2c3-bcd87b943e35\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"
Sep 05 06:47:13.018558 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.018347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6-plugins-config-volume\") pod \"payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn\" (UID: \"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6\") " pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"
Sep 05 06:47:13.018558 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.018368    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvpq4\" (UniqueName: \"kubernetes.io/projected/76c98864-35df-4a65-a2c3-bcd87b943e35-kube-api-access-zvpq4\") pod \"payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq\" (UID: \"76c98864-35df-4a65-a2c3-bcd87b943e35\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"
Sep 05 06:47:13.019122 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.019098    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6-plugins-config-volume\") pod \"payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn\" (UID: \"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6\") " pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"
Sep 05 06:47:13.026623 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.026604    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxvbc\" (UniqueName: \"kubernetes.io/projected/9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6-kube-api-access-mxvbc\") pod \"payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn\" (UID: \"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6\") " pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"
Sep 05 06:47:13.118876 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.118822    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvpq4\" (UniqueName: \"kubernetes.io/projected/76c98864-35df-4a65-a2c3-bcd87b943e35-kube-api-access-zvpq4\") pod \"payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq\" (UID: \"76c98864-35df-4a65-a2c3-bcd87b943e35\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"
Sep 05 06:47:13.119117 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.118921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76c98864-35df-4a65-a2c3-bcd87b943e35-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq\" (UID: \"76c98864-35df-4a65-a2c3-bcd87b943e35\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"
Sep 05 06:47:13.119669 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.119649    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76c98864-35df-4a65-a2c3-bcd87b943e35-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq\" (UID: \"76c98864-35df-4a65-a2c3-bcd87b943e35\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"
Sep 05 06:47:13.127220 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.127184    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvpq4\" (UniqueName: \"kubernetes.io/projected/76c98864-35df-4a65-a2c3-bcd87b943e35-kube-api-access-zvpq4\") pod \"payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq\" (UID: \"76c98864-35df-4a65-a2c3-bcd87b943e35\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"
Sep 05 06:47:13.147664 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.147638    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"
Sep 05 06:47:13.178016 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.177988    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"
Sep 05 06:47:13.426008 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.425983    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"]
Sep 05 06:47:13.427249 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:47:13.427219    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c98864_35df_4a65_a2c3_bcd87b943e35.slice/crio-8e7fe1ca52aae78ffd92a67681c3a7fc4ea84594c785f4a15ea8653449ad526e WatchSource:0}: Error finding container 8e7fe1ca52aae78ffd92a67681c3a7fc4ea84594c785f4a15ea8653449ad526e: Status 404 returned error can't find the container with id 8e7fe1ca52aae78ffd92a67681c3a7fc4ea84594c785f4a15ea8653449ad526e
Sep 05 06:47:13.461422 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.461397    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"]
Sep 05 06:47:13.462399 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:47:13.462379    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2a5df5_f7ca_4ca7_83e8_630bf168c4b6.slice/crio-c8be66b16bd031f00dd75ee779ac9168f41f3adefe00116c0a3b7cf3d0404d8d WatchSource:0}: Error finding container c8be66b16bd031f00dd75ee779ac9168f41f3adefe00116c0a3b7cf3d0404d8d: Status 404 returned error can't find the container with id c8be66b16bd031f00dd75ee779ac9168f41f3adefe00116c0a3b7cf3d0404d8d
Sep 05 06:47:13.907251 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.907207    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn" event={"ID":"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6","Type":"ContainerStarted","Data":"9664f2c8589bdd2559517436b33dab97b03f5470437b98027ae71cc5817a892e"}
Sep 05 06:47:13.907464 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.907280    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"
Sep 05 06:47:13.907464 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.907304    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn" event={"ID":"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6","Type":"ContainerStarted","Data":"c8be66b16bd031f00dd75ee779ac9168f41f3adefe00116c0a3b7cf3d0404d8d"}
Sep 05 06:47:13.908814 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.908790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq" event={"ID":"76c98864-35df-4a65-a2c3-bcd87b943e35","Type":"ContainerStarted","Data":"4a741395990a720f867f26c5295ce5d4ad12935665ceb3d66cc225594d65bb30"}
Sep 05 06:47:13.908929 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.908831    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq" event={"ID":"76c98864-35df-4a65-a2c3-bcd87b943e35","Type":"ContainerStarted","Data":"8e7fe1ca52aae78ffd92a67681c3a7fc4ea84594c785f4a15ea8653449ad526e"}
Sep 05 06:47:13.908929 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.908885    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"
Sep 05 06:47:13.927677 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.927633    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn" podStartSLOduration=1.927618684 podStartE2EDuration="1.927618684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:47:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:47:13.925296915 +0000 UTC m=+1331.529845759" watchObservedRunningTime="2026-09-05 06:47:13.927618684 +0000 UTC m=+1331.532167518"
Sep 05 06:47:13.948060 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:13.948000    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq" podStartSLOduration=1.94797997 podStartE2EDuration="1.94797997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:47:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:47:13.945360982 +0000 UTC m=+1331.549909820" watchObservedRunningTime="2026-09-05 06:47:13.94797997 +0000 UTC m=+1331.552528809"
Sep 05 06:47:15.062878 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:15.062825    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:47:23.999129 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:23.999095    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:47:24.111551 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:24.111516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:47:24.917227 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:24.917190    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"
Sep 05 06:47:24.917376 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:24.917362    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"
Sep 05 06:47:33.052089 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:33.052051    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:47:36.083511 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:36.083467    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:47:47.488564 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:47.488527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:47:49.253975 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:49.253935    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:47:49.398043 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:47:49.398007    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:48:03.045825 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:03.045795    2583 scope.go:117] "RemoveContainer" containerID="d9ad92a21a62f1c3bc836857739cc9b420f2d74a5a44a4c1d087bd091dd946c5"
Sep 05 06:48:05.050628 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:05.050584    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:48:20.825542 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:20.825505    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr"]
Sep 05 06:48:20.830626 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:20.830606    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr"
Sep 05 06:48:20.834521 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:20.834312    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:48:20.834521 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:20.834314    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:48:20.835931 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:20.835899    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr"]
Sep 05 06:48:20.893463 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:20.893439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2421781b-a3a3-42dd-b869-0ee882b78c5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr\" (UID: \"2421781b-a3a3-42dd-b869-0ee882b78c5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr"
Sep 05 06:48:20.994156 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:20.994122    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2421781b-a3a3-42dd-b869-0ee882b78c5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr\" (UID: \"2421781b-a3a3-42dd-b869-0ee882b78c5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr"
Sep 05 06:48:20.994798 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:20.994775    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2421781b-a3a3-42dd-b869-0ee882b78c5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr\" (UID: \"2421781b-a3a3-42dd-b869-0ee882b78c5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr"
Sep 05 06:48:21.126473 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:21.126396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:48:21.141972 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:21.141943    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr"
Sep 05 06:48:21.413794 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:21.413767    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr"]
Sep 05 06:48:21.415939 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:48:21.415913    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2421781b_a3a3_42dd_b869_0ee882b78c5f.slice/crio-4fe47582f8e0b55261165a8a44f340a60370e2a5492ef336080ab86f12f4f34d WatchSource:0}: Error finding container 4fe47582f8e0b55261165a8a44f340a60370e2a5492ef336080ab86f12f4f34d: Status 404 returned error can't find the container with id 4fe47582f8e0b55261165a8a44f340a60370e2a5492ef336080ab86f12f4f34d
Sep 05 06:48:22.278770 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:22.278731    2583 generic.go:356] "Generic (PLEG): container finished" podID="2421781b-a3a3-42dd-b869-0ee882b78c5f" containerID="29ad3fd427e755e9e5fd2498b6f9f87312954d97a005cbdddd28c1e411cfc7a9" exitCode=0
Sep 05 06:48:22.279228 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:22.278787    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr" event={"ID":"2421781b-a3a3-42dd-b869-0ee882b78c5f","Type":"ContainerDied","Data":"29ad3fd427e755e9e5fd2498b6f9f87312954d97a005cbdddd28c1e411cfc7a9"}
Sep 05 06:48:22.279228 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:22.278994    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr" event={"ID":"2421781b-a3a3-42dd-b869-0ee882b78c5f","Type":"ContainerStarted","Data":"4fe47582f8e0b55261165a8a44f340a60370e2a5492ef336080ab86f12f4f34d"}
Sep 05 06:48:23.416462 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:23.416439    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr"
Sep 05 06:48:23.518000 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:23.517968    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2421781b-a3a3-42dd-b869-0ee882b78c5f-maas-api-service-ca\") pod \"2421781b-a3a3-42dd-b869-0ee882b78c5f\" (UID: \"2421781b-a3a3-42dd-b869-0ee882b78c5f\") "
Sep 05 06:48:23.518328 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:23.518302    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2421781b-a3a3-42dd-b869-0ee882b78c5f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2421781b-a3a3-42dd-b869-0ee882b78c5f" (UID: "2421781b-a3a3-42dd-b869-0ee882b78c5f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:48:23.618566 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:23.618485    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2421781b-a3a3-42dd-b869-0ee882b78c5f-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:24.289537 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:24.289503    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr" event={"ID":"2421781b-a3a3-42dd-b869-0ee882b78c5f","Type":"ContainerDied","Data":"4fe47582f8e0b55261165a8a44f340a60370e2a5492ef336080ab86f12f4f34d"}
Sep 05 06:48:24.289537 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:24.289534    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr"
Sep 05 06:48:24.289756 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:24.289557    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fe47582f8e0b55261165a8a44f340a60370e2a5492ef336080ab86f12f4f34d"
Sep 05 06:48:24.449411 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:24.449373    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:48:36.449165 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.449133    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:48:36.487592 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.487561    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"]
Sep 05 06:48:36.487791 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.487762    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn" podUID="9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6" containerName="payload-processing" containerID="cri-o://9664f2c8589bdd2559517436b33dab97b03f5470437b98027ae71cc5817a892e" gracePeriod=30
Sep 05 06:48:36.492779 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.492750    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"]
Sep 05 06:48:36.493073 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.493003    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq" podUID="76c98864-35df-4a65-a2c3-bcd87b943e35" containerName="payload-pre-processing" containerID="cri-o://4a741395990a720f867f26c5295ce5d4ad12935665ceb3d66cc225594d65bb30" gracePeriod=30
Sep 05 06:48:36.519036 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.519010    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:48:36.590822 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.590793    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:48:36.667902 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.667778    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr"]
Sep 05 06:48:36.668929 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.668856    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:48:36.670916 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.670893    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c36aacf1-dp2wr"]
Sep 05 06:48:36.733383 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.733286    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:48:36.753522 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.753498    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"
Sep 05 06:48:36.769401 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.769383    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"
Sep 05 06:48:36.832783 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.832759    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxvbc\" (UniqueName: \"kubernetes.io/projected/9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6-kube-api-access-mxvbc\") pod \"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6\" (UID: \"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6\") "
Sep 05 06:48:36.833026 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.832811    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6-plugins-config-volume\") pod \"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6\" (UID: \"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6\") "
Sep 05 06:48:36.833026 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.832851    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76c98864-35df-4a65-a2c3-bcd87b943e35-plugins-config-volume\") pod \"76c98864-35df-4a65-a2c3-bcd87b943e35\" (UID: \"76c98864-35df-4a65-a2c3-bcd87b943e35\") "
Sep 05 06:48:36.833026 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.832894    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvpq4\" (UniqueName: \"kubernetes.io/projected/76c98864-35df-4a65-a2c3-bcd87b943e35-kube-api-access-zvpq4\") pod \"76c98864-35df-4a65-a2c3-bcd87b943e35\" (UID: \"76c98864-35df-4a65-a2c3-bcd87b943e35\") "
Sep 05 06:48:36.833225 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.833203    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76c98864-35df-4a65-a2c3-bcd87b943e35-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "76c98864-35df-4a65-a2c3-bcd87b943e35" (UID: "76c98864-35df-4a65-a2c3-bcd87b943e35"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:48:36.833293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.833239    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6" (UID: "9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:48:36.834872 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.834842    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6-kube-api-access-mxvbc" (OuterVolumeSpecName: "kube-api-access-mxvbc") pod "9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6" (UID: "9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6"). InnerVolumeSpecName "kube-api-access-mxvbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:48:36.834942 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.834897    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76c98864-35df-4a65-a2c3-bcd87b943e35-kube-api-access-zvpq4" (OuterVolumeSpecName: "kube-api-access-zvpq4") pod "76c98864-35df-4a65-a2c3-bcd87b943e35" (UID: "76c98864-35df-4a65-a2c3-bcd87b943e35"). InnerVolumeSpecName "kube-api-access-zvpq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:48:36.914223 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.914193    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2421781b-a3a3-42dd-b869-0ee882b78c5f" path="/var/lib/kubelet/pods/2421781b-a3a3-42dd-b869-0ee882b78c5f/volumes"
Sep 05 06:48:36.934170 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.934147    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxvbc\" (UniqueName: \"kubernetes.io/projected/9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6-kube-api-access-mxvbc\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:36.934170 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.934170    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:36.934293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.934179    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76c98864-35df-4a65-a2c3-bcd87b943e35-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:36.934293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:36.934188    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvpq4\" (UniqueName: \"kubernetes.io/projected/76c98864-35df-4a65-a2c3-bcd87b943e35-kube-api-access-zvpq4\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:37.358357 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.358312    2583 generic.go:356] "Generic (PLEG): container finished" podID="9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6" containerID="9664f2c8589bdd2559517436b33dab97b03f5470437b98027ae71cc5817a892e" exitCode=0
Sep 05 06:48:37.358565 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.358376    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"
Sep 05 06:48:37.358565 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.358397    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn" event={"ID":"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6","Type":"ContainerDied","Data":"9664f2c8589bdd2559517436b33dab97b03f5470437b98027ae71cc5817a892e"}
Sep 05 06:48:37.358565 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.358457    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn" event={"ID":"9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6","Type":"ContainerDied","Data":"c8be66b16bd031f00dd75ee779ac9168f41f3adefe00116c0a3b7cf3d0404d8d"}
Sep 05 06:48:37.358565 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.358489    2583 scope.go:117] "RemoveContainer" containerID="9664f2c8589bdd2559517436b33dab97b03f5470437b98027ae71cc5817a892e"
Sep 05 06:48:37.359795 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.359770    2583 generic.go:356] "Generic (PLEG): container finished" podID="76c98864-35df-4a65-a2c3-bcd87b943e35" containerID="4a741395990a720f867f26c5295ce5d4ad12935665ceb3d66cc225594d65bb30" exitCode=0
Sep 05 06:48:37.359912 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.359856    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq" event={"ID":"76c98864-35df-4a65-a2c3-bcd87b943e35","Type":"ContainerDied","Data":"4a741395990a720f867f26c5295ce5d4ad12935665ceb3d66cc225594d65bb30"}
Sep 05 06:48:37.359978 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.359915    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"
Sep 05 06:48:37.360032 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.359921    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq" event={"ID":"76c98864-35df-4a65-a2c3-bcd87b943e35","Type":"ContainerDied","Data":"8e7fe1ca52aae78ffd92a67681c3a7fc4ea84594c785f4a15ea8653449ad526e"}
Sep 05 06:48:37.367871 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.367843    2583 scope.go:117] "RemoveContainer" containerID="9664f2c8589bdd2559517436b33dab97b03f5470437b98027ae71cc5817a892e"
Sep 05 06:48:37.368158 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:48:37.368137    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9664f2c8589bdd2559517436b33dab97b03f5470437b98027ae71cc5817a892e\": container with ID starting with 9664f2c8589bdd2559517436b33dab97b03f5470437b98027ae71cc5817a892e not found: ID does not exist" containerID="9664f2c8589bdd2559517436b33dab97b03f5470437b98027ae71cc5817a892e"
Sep 05 06:48:37.368212 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.368165    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9664f2c8589bdd2559517436b33dab97b03f5470437b98027ae71cc5817a892e"} err="failed to get container status \"9664f2c8589bdd2559517436b33dab97b03f5470437b98027ae71cc5817a892e\": rpc error: code = NotFound desc = could not find container \"9664f2c8589bdd2559517436b33dab97b03f5470437b98027ae71cc5817a892e\": container with ID starting with 9664f2c8589bdd2559517436b33dab97b03f5470437b98027ae71cc5817a892e not found: ID does not exist"
Sep 05 06:48:37.368212 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.368185    2583 scope.go:117] "RemoveContainer" containerID="4a741395990a720f867f26c5295ce5d4ad12935665ceb3d66cc225594d65bb30"
Sep 05 06:48:37.375827 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.375810    2583 scope.go:117] "RemoveContainer" containerID="4a741395990a720f867f26c5295ce5d4ad12935665ceb3d66cc225594d65bb30"
Sep 05 06:48:37.376145 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:48:37.376127    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a741395990a720f867f26c5295ce5d4ad12935665ceb3d66cc225594d65bb30\": container with ID starting with 4a741395990a720f867f26c5295ce5d4ad12935665ceb3d66cc225594d65bb30 not found: ID does not exist" containerID="4a741395990a720f867f26c5295ce5d4ad12935665ceb3d66cc225594d65bb30"
Sep 05 06:48:37.376201 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.376151    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a741395990a720f867f26c5295ce5d4ad12935665ceb3d66cc225594d65bb30"} err="failed to get container status \"4a741395990a720f867f26c5295ce5d4ad12935665ceb3d66cc225594d65bb30\": rpc error: code = NotFound desc = could not find container \"4a741395990a720f867f26c5295ce5d4ad12935665ceb3d66cc225594d65bb30\": container with ID starting with 4a741395990a720f867f26c5295ce5d4ad12935665ceb3d66cc225594d65bb30 not found: ID does not exist"
Sep 05 06:48:37.380075 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.380054    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"]
Sep 05 06:48:37.386426 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.386406    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq"]
Sep 05 06:48:37.401474 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.401450    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"]
Sep 05 06:48:37.406203 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:37.406183    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn"]
Sep 05 06:48:38.408878 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.408834    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-8083-7c6d26"]
Sep 05 06:48:38.409253 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.409201    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6" containerName="payload-processing"
Sep 05 06:48:38.409253 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.409212    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6" containerName="payload-processing"
Sep 05 06:48:38.409253 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.409225    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c98864-35df-4a65-a2c3-bcd87b943e35" containerName="payload-pre-processing"
Sep 05 06:48:38.409253 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.409230    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c98864-35df-4a65-a2c3-bcd87b943e35" containerName="payload-pre-processing"
Sep 05 06:48:38.409253 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.409242    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2421781b-a3a3-42dd-b869-0ee882b78c5f" containerName="revoke-keys"
Sep 05 06:48:38.409253 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.409248    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2421781b-a3a3-42dd-b869-0ee882b78c5f" containerName="revoke-keys"
Sep 05 06:48:38.409443 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.409304    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2421781b-a3a3-42dd-b869-0ee882b78c5f" containerName="revoke-keys"
Sep 05 06:48:38.409443 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.409312    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6" containerName="payload-processing"
Sep 05 06:48:38.409443 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.409322    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="76c98864-35df-4a65-a2c3-bcd87b943e35" containerName="payload-pre-processing"
Sep 05 06:48:38.413713 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.413696    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8083-7c6d26"
Sep 05 06:48:38.416285 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.416268    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jntms\""
Sep 05 06:48:38.420085 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.420055    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-8083-7c6d26"]
Sep 05 06:48:38.547081 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.547044    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcw8m\" (UniqueName: \"kubernetes.io/projected/75855c7f-3f72-4567-8cfa-9e5117349b24-kube-api-access-fcw8m\") pod \"mt-curl-8083-7c6d26\" (UID: \"75855c7f-3f72-4567-8cfa-9e5117349b24\") " pod="opendatahub/mt-curl-8083-7c6d26"
Sep 05 06:48:38.648541 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.648503    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcw8m\" (UniqueName: \"kubernetes.io/projected/75855c7f-3f72-4567-8cfa-9e5117349b24-kube-api-access-fcw8m\") pod \"mt-curl-8083-7c6d26\" (UID: \"75855c7f-3f72-4567-8cfa-9e5117349b24\") " pod="opendatahub/mt-curl-8083-7c6d26"
Sep 05 06:48:38.660641 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.660576    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcw8m\" (UniqueName: \"kubernetes.io/projected/75855c7f-3f72-4567-8cfa-9e5117349b24-kube-api-access-fcw8m\") pod \"mt-curl-8083-7c6d26\" (UID: \"75855c7f-3f72-4567-8cfa-9e5117349b24\") " pod="opendatahub/mt-curl-8083-7c6d26"
Sep 05 06:48:38.723968 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.723937    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8083-7c6d26"
Sep 05 06:48:38.915532 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.915450    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76c98864-35df-4a65-a2c3-bcd87b943e35" path="/var/lib/kubelet/pods/76c98864-35df-4a65-a2c3-bcd87b943e35/volumes"
Sep 05 06:48:38.915826 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.915813    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6" path="/var/lib/kubelet/pods/9a2a5df5-f7ca-4ca7-83e8-630bf168c4b6/volumes"
Sep 05 06:48:38.994787 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.994756    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-8083-7c6d26"]
Sep 05 06:48:38.997077 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:48:38.997034    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75855c7f_3f72_4567_8cfa_9e5117349b24.slice/crio-771be51d7d13519460e8ca88e8ad6eaafa663efb0b3c2704a3f632810ac9b4a0 WatchSource:0}: Error finding container 771be51d7d13519460e8ca88e8ad6eaafa663efb0b3c2704a3f632810ac9b4a0: Status 404 returned error can't find the container with id 771be51d7d13519460e8ca88e8ad6eaafa663efb0b3c2704a3f632810ac9b4a0
Sep 05 06:48:38.998495 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:38.998475    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 05 06:48:39.374364 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:39.374330    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-8083-7c6d26" event={"ID":"75855c7f-3f72-4567-8cfa-9e5117349b24","Type":"ContainerStarted","Data":"771be51d7d13519460e8ca88e8ad6eaafa663efb0b3c2704a3f632810ac9b4a0"}
Sep 05 06:48:40.124990 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:40.124954    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:48:40.381276 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:40.381186    2583 generic.go:356] "Generic (PLEG): container finished" podID="75855c7f-3f72-4567-8cfa-9e5117349b24" containerID="c7e699702f7fcb29a88828a20a6f9c0b2848dcb33804e9c32a16e4212ee72c69" exitCode=0
Sep 05 06:48:40.381276 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:40.381253    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-8083-7c6d26" event={"ID":"75855c7f-3f72-4567-8cfa-9e5117349b24","Type":"ContainerDied","Data":"c7e699702f7fcb29a88828a20a6f9c0b2848dcb33804e9c32a16e4212ee72c69"}
Sep 05 06:48:41.515254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:41.515225    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8083-7c6d26"
Sep 05 06:48:41.536668 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:41.536637    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-8083-7c6d26_75855c7f-3f72-4567-8cfa-9e5117349b24/mt-curl-8083-7c6d26/0.log"
Sep 05 06:48:41.562017 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:41.561990    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-8083-7c6d26"]
Sep 05 06:48:41.568475 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:41.568450    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-8083-7c6d26"]
Sep 05 06:48:41.576048 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:41.576026    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcw8m\" (UniqueName: \"kubernetes.io/projected/75855c7f-3f72-4567-8cfa-9e5117349b24-kube-api-access-fcw8m\") pod \"75855c7f-3f72-4567-8cfa-9e5117349b24\" (UID: \"75855c7f-3f72-4567-8cfa-9e5117349b24\") "
Sep 05 06:48:41.578202 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:41.578177    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75855c7f-3f72-4567-8cfa-9e5117349b24-kube-api-access-fcw8m" (OuterVolumeSpecName: "kube-api-access-fcw8m") pod "75855c7f-3f72-4567-8cfa-9e5117349b24" (UID: "75855c7f-3f72-4567-8cfa-9e5117349b24"). InnerVolumeSpecName "kube-api-access-fcw8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:48:41.677153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:41.677070    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcw8m\" (UniqueName: \"kubernetes.io/projected/75855c7f-3f72-4567-8cfa-9e5117349b24-kube-api-access-fcw8m\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:42.393249 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:42.393217    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="771be51d7d13519460e8ca88e8ad6eaafa663efb0b3c2704a3f632810ac9b4a0"
Sep 05 06:48:42.393249 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:42.393234    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8083-7c6d26"
Sep 05 06:48:42.404138 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:48:42.404108    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-8083-7c6d26\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="75855c7f-3f72-4567-8cfa-9e5117349b24" pod="opendatahub/mt-curl-8083-7c6d26"
Sep 05 06:48:42.904948 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:42.904912    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"]
Sep 05 06:48:42.915888 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:42.915843    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75855c7f-3f72-4567-8cfa-9e5117349b24" path="/var/lib/kubelet/pods/75855c7f-3f72-4567-8cfa-9e5117349b24/volumes"
Sep 05 06:48:42.924789 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:42.924745    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:48:42.924937 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:48:42.924896    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-8083-7c6d26\" is forbidden: User \"system:node:ip-10-0-137-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-250.ec2.internal' and this object" podUID="75855c7f-3f72-4567-8cfa-9e5117349b24" pod="opendatahub/mt-curl-8083-7c6d26"
Sep 05 06:48:44.043002 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:44.042963    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"]
Sep 05 06:48:44.067403 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:44.067370    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:48:45.203212 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:45.203159    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:48:47.959242 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:47.959209    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:48:57.925262 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:57.925180    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl" podUID="7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847" containerName="main" containerID="cri-o://59259ceb37e0f8699c2b31929ea8c4cecf9d4d21ff568b5b46b8751a954466df" gracePeriod=45
Sep 05 06:48:58.188236 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.188180    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:48:58.320064 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.320028    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-tmp-dir\") pod \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") "
Sep 05 06:48:58.320064 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.320071    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-dshm\") pod \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") "
Sep 05 06:48:58.320273 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.320117    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-home\") pod \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") "
Sep 05 06:48:58.320273 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.320157    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-model-cache\") pod \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") "
Sep 05 06:48:58.320273 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.320183    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzqkb\" (UniqueName: \"kubernetes.io/projected/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-kube-api-access-dzqkb\") pod \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") "
Sep 05 06:48:58.320273 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.320226    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-tls-certs\") pod \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\" (UID: \"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847\") "
Sep 05 06:48:58.320473 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.320343    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847" (UID: "7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:48:58.320473 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.320395    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-home" (OuterVolumeSpecName: "home") pod "7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847" (UID: "7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:48:58.320473 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.320456    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:58.320615 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.320502    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-model-cache" (OuterVolumeSpecName: "model-cache") pod "7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847" (UID: "7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:48:58.322453 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.322428    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-dshm" (OuterVolumeSpecName: "dshm") pod "7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847" (UID: "7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:48:58.322453 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.322434    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847" (UID: "7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:48:58.322453 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.322428    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-kube-api-access-dzqkb" (OuterVolumeSpecName: "kube-api-access-dzqkb") pod "7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847" (UID: "7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847"). InnerVolumeSpecName "kube-api-access-dzqkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:48:58.421590 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.421556    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:58.421590 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.421584    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:58.421758 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.421596    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:58.421758 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.421610    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzqkb\" (UniqueName: \"kubernetes.io/projected/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-kube-api-access-dzqkb\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:58.421758 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.421623    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:58.477290 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.477260    2583 generic.go:356] "Generic (PLEG): container finished" podID="7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847" containerID="59259ceb37e0f8699c2b31929ea8c4cecf9d4d21ff568b5b46b8751a954466df" exitCode=0
Sep 05 06:48:58.477444 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.477310    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"
Sep 05 06:48:58.477444 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.477353    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl" event={"ID":"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847","Type":"ContainerDied","Data":"59259ceb37e0f8699c2b31929ea8c4cecf9d4d21ff568b5b46b8751a954466df"}
Sep 05 06:48:58.477444 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.477402    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl" event={"ID":"7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847","Type":"ContainerDied","Data":"ab327a3d75e4d320ead14e8a1004d745d465a85dc5cf47d41121f13ee97b048e"}
Sep 05 06:48:58.477444 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.477424    2583 scope.go:117] "RemoveContainer" containerID="59259ceb37e0f8699c2b31929ea8c4cecf9d4d21ff568b5b46b8751a954466df"
Sep 05 06:48:58.486723 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.486708    2583 scope.go:117] "RemoveContainer" containerID="59259ceb37e0f8699c2b31929ea8c4cecf9d4d21ff568b5b46b8751a954466df"
Sep 05 06:48:58.487003 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:48:58.486986    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59259ceb37e0f8699c2b31929ea8c4cecf9d4d21ff568b5b46b8751a954466df\": container with ID starting with 59259ceb37e0f8699c2b31929ea8c4cecf9d4d21ff568b5b46b8751a954466df not found: ID does not exist" containerID="59259ceb37e0f8699c2b31929ea8c4cecf9d4d21ff568b5b46b8751a954466df"
Sep 05 06:48:58.487066 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.487008    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59259ceb37e0f8699c2b31929ea8c4cecf9d4d21ff568b5b46b8751a954466df"} err="failed to get container status \"59259ceb37e0f8699c2b31929ea8c4cecf9d4d21ff568b5b46b8751a954466df\": rpc error: code = NotFound desc = could not find container \"59259ceb37e0f8699c2b31929ea8c4cecf9d4d21ff568b5b46b8751a954466df\": container with ID starting with 59259ceb37e0f8699c2b31929ea8c4cecf9d4d21ff568b5b46b8751a954466df not found: ID does not exist"
Sep 05 06:48:58.499061 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.499042    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"]
Sep 05 06:48:58.509141 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.509122    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/auth-test-model-ef54fd-kserve-7cd7cf8fc9-x9nnl"]
Sep 05 06:48:58.915338 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:58.915254    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847" path="/var/lib/kubelet/pods/7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847/volumes"
Sep 05 06:48:59.061971 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.061922    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4" podUID="85715f59-8953-49ee-9708-6b43917c83e6" containerName="main" containerID="cri-o://1649a8bf570c07f10dd5351672f57345cfb1e25fea8e201eed654b4df7e0c00d" gracePeriod=45
Sep 05 06:48:59.273796 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.273763    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"]
Sep 05 06:48:59.274220 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.274205    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847" containerName="main"
Sep 05 06:48:59.274280 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.274222    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847" containerName="main"
Sep 05 06:48:59.274280 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.274235    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75855c7f-3f72-4567-8cfa-9e5117349b24" containerName="mt-curl-8083-7c6d26"
Sep 05 06:48:59.274280 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.274241    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="75855c7f-3f72-4567-8cfa-9e5117349b24" containerName="mt-curl-8083-7c6d26"
Sep 05 06:48:59.274379 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.274307    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eb1c74d-c70a-4f7e-a9fd-a4d9a5df2847" containerName="main"
Sep 05 06:48:59.274379 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.274318    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="75855c7f-3f72-4567-8cfa-9e5117349b24" containerName="mt-curl-8083-7c6d26"
Sep 05 06:48:59.277343 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.277322    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.280178 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.280146    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-ef54fd\"/\"kube-root-ca.crt\""
Sep 05 06:48:59.281545 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.281338    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-ef54fd\"/\"sub-test-model-ef54fd-kserve-self-signed-certs\""
Sep 05 06:48:59.281545 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.281410    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-ef54fd\"/\"openshift-service-ca.crt\""
Sep 05 06:48:59.282000 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.281978    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-ef54fd\"/\"default-dockercfg-8pxrt\""
Sep 05 06:48:59.288816 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.288791    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"]
Sep 05 06:48:59.317900 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.317849    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:48:59.324771 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.324753    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:48:59.430568 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.430488    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-model-cache\") pod \"85715f59-8953-49ee-9708-6b43917c83e6\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") "
Sep 05 06:48:59.430568 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.430522    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85715f59-8953-49ee-9708-6b43917c83e6-tls-certs\") pod \"85715f59-8953-49ee-9708-6b43917c83e6\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") "
Sep 05 06:48:59.430568 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.430555    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jshkd\" (UniqueName: \"kubernetes.io/projected/85715f59-8953-49ee-9708-6b43917c83e6-kube-api-access-jshkd\") pod \"85715f59-8953-49ee-9708-6b43917c83e6\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") "
Sep 05 06:48:59.430886 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.430573    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-home\") pod \"85715f59-8953-49ee-9708-6b43917c83e6\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") "
Sep 05 06:48:59.430886 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.430614    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-dshm\") pod \"85715f59-8953-49ee-9708-6b43917c83e6\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") "
Sep 05 06:48:59.430886 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.430633    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-tmp-dir\") pod \"85715f59-8953-49ee-9708-6b43917c83e6\" (UID: \"85715f59-8953-49ee-9708-6b43917c83e6\") "
Sep 05 06:48:59.430886 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.430766    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-model-cache" (OuterVolumeSpecName: "model-cache") pod "85715f59-8953-49ee-9708-6b43917c83e6" (UID: "85715f59-8953-49ee-9708-6b43917c83e6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:48:59.430886 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.430822    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-tmp-dir\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.431156 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.430895    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-home" (OuterVolumeSpecName: "home") pod "85715f59-8953-49ee-9708-6b43917c83e6" (UID: "85715f59-8953-49ee-9708-6b43917c83e6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:48:59.431156 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.430897    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d649fa28-14c3-4fa1-a200-ff50fa913ddd-tls-certs\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.431156 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.430982    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-home\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.431156 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.431019    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-model-cache\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.431156 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.431031    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "85715f59-8953-49ee-9708-6b43917c83e6" (UID: "85715f59-8953-49ee-9708-6b43917c83e6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:48:59.431156 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.431043    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrmj5\" (UniqueName: \"kubernetes.io/projected/d649fa28-14c3-4fa1-a200-ff50fa913ddd-kube-api-access-wrmj5\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.431156 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.431116    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-dshm\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.431540 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.431170    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:59.431540 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.431184    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:59.431540 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.431203    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:59.432836 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.432813    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85715f59-8953-49ee-9708-6b43917c83e6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "85715f59-8953-49ee-9708-6b43917c83e6" (UID: "85715f59-8953-49ee-9708-6b43917c83e6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:48:59.432962 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.432905    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-dshm" (OuterVolumeSpecName: "dshm") pod "85715f59-8953-49ee-9708-6b43917c83e6" (UID: "85715f59-8953-49ee-9708-6b43917c83e6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:48:59.433006 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.432962    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85715f59-8953-49ee-9708-6b43917c83e6-kube-api-access-jshkd" (OuterVolumeSpecName: "kube-api-access-jshkd") pod "85715f59-8953-49ee-9708-6b43917c83e6" (UID: "85715f59-8953-49ee-9708-6b43917c83e6"). InnerVolumeSpecName "kube-api-access-jshkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:48:59.484435 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.484399    2583 generic.go:356] "Generic (PLEG): container finished" podID="85715f59-8953-49ee-9708-6b43917c83e6" containerID="1649a8bf570c07f10dd5351672f57345cfb1e25fea8e201eed654b4df7e0c00d" exitCode=0
Sep 05 06:48:59.484617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.484445    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"
Sep 05 06:48:59.484617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.484490    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4" event={"ID":"85715f59-8953-49ee-9708-6b43917c83e6","Type":"ContainerDied","Data":"1649a8bf570c07f10dd5351672f57345cfb1e25fea8e201eed654b4df7e0c00d"}
Sep 05 06:48:59.484617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.484543    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4" event={"ID":"85715f59-8953-49ee-9708-6b43917c83e6","Type":"ContainerDied","Data":"ea80a6128071f164c885c5edd3cd96022e9ba05c670afa26c4ca3682f130b3b9"}
Sep 05 06:48:59.484617 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.484568    2583 scope.go:117] "RemoveContainer" containerID="1649a8bf570c07f10dd5351672f57345cfb1e25fea8e201eed654b4df7e0c00d"
Sep 05 06:48:59.493257 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.493240    2583 scope.go:117] "RemoveContainer" containerID="1649a8bf570c07f10dd5351672f57345cfb1e25fea8e201eed654b4df7e0c00d"
Sep 05 06:48:59.493524 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:48:59.493505    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1649a8bf570c07f10dd5351672f57345cfb1e25fea8e201eed654b4df7e0c00d\": container with ID starting with 1649a8bf570c07f10dd5351672f57345cfb1e25fea8e201eed654b4df7e0c00d not found: ID does not exist" containerID="1649a8bf570c07f10dd5351672f57345cfb1e25fea8e201eed654b4df7e0c00d"
Sep 05 06:48:59.493589 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.493538    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1649a8bf570c07f10dd5351672f57345cfb1e25fea8e201eed654b4df7e0c00d"} err="failed to get container status \"1649a8bf570c07f10dd5351672f57345cfb1e25fea8e201eed654b4df7e0c00d\": rpc error: code = NotFound desc = could not find container \"1649a8bf570c07f10dd5351672f57345cfb1e25fea8e201eed654b4df7e0c00d\": container with ID starting with 1649a8bf570c07f10dd5351672f57345cfb1e25fea8e201eed654b4df7e0c00d not found: ID does not exist"
Sep 05 06:48:59.508733 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.508710    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"]
Sep 05 06:48:59.512412 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.512392    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/auth-test-model-5b1d24-kserve-658587544c-b6hm4"]
Sep 05 06:48:59.532053 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.532029    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-dshm\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.532140 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.532075    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-tmp-dir\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.532140 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.532116    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d649fa28-14c3-4fa1-a200-ff50fa913ddd-tls-certs\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.532209 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.532161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-home\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.532319 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.532295    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-model-cache\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.532368 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.532339    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrmj5\" (UniqueName: \"kubernetes.io/projected/d649fa28-14c3-4fa1-a200-ff50fa913ddd-kube-api-access-wrmj5\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.532439 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.532419    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85715f59-8953-49ee-9708-6b43917c83e6-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:59.532498 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.532440    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jshkd\" (UniqueName: \"kubernetes.io/projected/85715f59-8953-49ee-9708-6b43917c83e6-kube-api-access-jshkd\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:59.532498 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.532455    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85715f59-8953-49ee-9708-6b43917c83e6-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:48:59.532606 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.532492    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-tmp-dir\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.532606 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.532543    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-home\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.532750 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.532728    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-model-cache\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.534187 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.534172    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-dshm\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.534446 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.534427    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d649fa28-14c3-4fa1-a200-ff50fa913ddd-tls-certs\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.545008 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.544980    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrmj5\" (UniqueName: \"kubernetes.io/projected/d649fa28-14c3-4fa1-a200-ff50fa913ddd-kube-api-access-wrmj5\") pod \"sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.590982 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.590951    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:48:59.868572 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:48:59.868542    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"]
Sep 05 06:48:59.870650 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:48:59.870624    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd649fa28_14c3_4fa1_a200_ff50fa913ddd.slice/crio-e4ebceb0b0da6038400e77272e7f0ccecceba187cca1a3632bf7bb98734461dd WatchSource:0}: Error finding container e4ebceb0b0da6038400e77272e7f0ccecceba187cca1a3632bf7bb98734461dd: Status 404 returned error can't find the container with id e4ebceb0b0da6038400e77272e7f0ccecceba187cca1a3632bf7bb98734461dd
Sep 05 06:49:00.491878 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:00.491822    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l" event={"ID":"d649fa28-14c3-4fa1-a200-ff50fa913ddd","Type":"ContainerStarted","Data":"6cc3d66fa7eac8d7b752dc578fe879539f4c7a0375993c9d4de51b8afb9f0098"}
Sep 05 06:49:00.492341 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:00.491887    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l" event={"ID":"d649fa28-14c3-4fa1-a200-ff50fa913ddd","Type":"ContainerStarted","Data":"e4ebceb0b0da6038400e77272e7f0ccecceba187cca1a3632bf7bb98734461dd"}
Sep 05 06:49:00.508694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:00.508647    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l" podStartSLOduration=1.508626954 podStartE2EDuration="1.508626954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:48:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:49:00.508099188 +0000 UTC m=+1438.112648025" watchObservedRunningTime="2026-09-05 06:49:00.508626954 +0000 UTC m=+1438.113175839"
Sep 05 06:49:00.915682 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:00.915602    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85715f59-8953-49ee-9708-6b43917c83e6" path="/var/lib/kubelet/pods/85715f59-8953-49ee-9708-6b43917c83e6/volumes"
Sep 05 06:49:02.853976 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:02.853940    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:49:09.591909 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:09.591837    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:49:09.592307 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:09.591926    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:49:09.608637 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:09.608614    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:49:10.556961 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:10.556932    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:49:21.758734 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:21.758700    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:22.374035 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:22.373997    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:30.028180 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:30.028134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:30.101093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:30.101058    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:30.325678 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:30.325578    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:31.602644 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:31.602609    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:31.705454 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:31.705424    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:31.807125 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:31.807093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:32.408110 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:32.408078    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:32.505694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:32.505662    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:32.608244 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:32.608210    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:33.881697 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:33.881657    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:33.957734 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:33.957702    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"]
Sep 05 06:49:33.958156 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:33.958129    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85715f59-8953-49ee-9708-6b43917c83e6" containerName="main"
Sep 05 06:49:33.958156 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:33.958149    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="85715f59-8953-49ee-9708-6b43917c83e6" containerName="main"
Sep 05 06:49:33.958337 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:33.958254    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="85715f59-8953-49ee-9708-6b43917c83e6" containerName="main"
Sep 05 06:49:33.960845 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:33.960829    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:33.963757 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:33.963738    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-5b1d24\"/\"kube-root-ca.crt\""
Sep 05 06:49:33.963856 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:33.963740    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-5b1d24\"/\"openshift-service-ca.crt\""
Sep 05 06:49:33.965196 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:33.965175    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-5b1d24\"/\"sub-test-model-5b1d24-kserve-self-signed-certs\""
Sep 05 06:49:33.965196 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:33.965194    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-5b1d24\"/\"default-dockercfg-b4rwk\""
Sep 05 06:49:33.971725 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:33.971703    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"]
Sep 05 06:49:33.988158 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:33.988136    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:34.001253 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.001231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-tmp-dir\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.001352 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.001260    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9t6g\" (UniqueName: \"kubernetes.io/projected/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-kube-api-access-m9t6g\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.001352 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.001297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-dshm\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.001438 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.001371    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-model-cache\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.001480 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.001442    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-tls-certs\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.001480 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.001467    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-home\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.102189 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.102159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-dshm\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.102314 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.102196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-model-cache\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.102314 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.102241    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-tls-certs\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.102314 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.102266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-home\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.102461 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.102318    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-tmp-dir\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.102505 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.102449    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9t6g\" (UniqueName: \"kubernetes.io/projected/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-kube-api-access-m9t6g\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.102698 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.102669    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-model-cache\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.102806 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.102681    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-tmp-dir\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.102851 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.102837    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-home\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.104389 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.104369    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-dshm\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.105155 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.105136    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-tls-certs\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.113319 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.113292    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9t6g\" (UniqueName: \"kubernetes.io/projected/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-kube-api-access-m9t6g\") pod \"sub-test-model-5b1d24-kserve-6785d895-hg5m9\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.272043 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.272006    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:34.546098 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.546012    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"]
Sep 05 06:49:34.549497 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:49:34.549464    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ebd7ad2_b4d7_4e29_88ff_9b8f7829f71c.slice/crio-b6260af5e745a7f720c2a86f2c65ca014486a884735033da3a5e22432f2effd2 WatchSource:0}: Error finding container b6260af5e745a7f720c2a86f2c65ca014486a884735033da3a5e22432f2effd2: Status 404 returned error can't find the container with id b6260af5e745a7f720c2a86f2c65ca014486a884735033da3a5e22432f2effd2
Sep 05 06:49:34.676369 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.676315    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9" event={"ID":"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c","Type":"ContainerStarted","Data":"b995f88146ad9045fda9dcec97283eafc3c493883f4d39d301fbcf8d072e423c"}
Sep 05 06:49:34.676369 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.676370    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9" event={"ID":"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c","Type":"ContainerStarted","Data":"b6260af5e745a7f720c2a86f2c65ca014486a884735033da3a5e22432f2effd2"}
Sep 05 06:49:34.695723 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:34.695668    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9" podStartSLOduration=1.695652002 podStartE2EDuration="1.695652002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:49:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:49:34.694077223 +0000 UTC m=+1472.298626063" watchObservedRunningTime="2026-09-05 06:49:34.695652002 +0000 UTC m=+1472.300200842"
Sep 05 06:49:36.847517 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:36.847473    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:49:39.770350 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:39.770299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:39.831735 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:39.831697    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:40.437076 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:40.437035    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:44.273176 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:44.273131    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:44.273603 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:44.273200    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:44.285917 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:44.285889    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:44.743205 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:44.743170    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:49:46.320406 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:46.320373    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:46.392158 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:46.392133    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:46.490030 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:46.489994    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:46.593075 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:46.592995    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:52.946494 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:52.946463    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:49:57.026984 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:57.026946    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:49:57.266955 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:49:57.266926    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:04.022521 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:04.022490    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:14.862165 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:14.862130    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:50:18.238743 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:18.238706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:23.936667 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:23.936632    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:24.036662 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:24.036631    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:24.260249 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:24.260218    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:24.557519 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:24.557423    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:25.328022 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:25.327923    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:28.109518 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:28.109490    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:28.201981 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:28.201949    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:29.279180 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.279148    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:29.379428 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.379378    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:29.748161 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.748133    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:29.835019 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.834986    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:29.862814 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.862778    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"]
Sep 05 06:50:29.866615 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.866593    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"
Sep 05 06:50:29.869271 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.869251    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-73c192\""
Sep 05 06:50:29.877559 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.877533    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"]
Sep 05 06:50:29.898709 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.898681    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"]
Sep 05 06:50:29.902196 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.902176    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"
Sep 05 06:50:29.904877 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.904845    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-73c192-dockercfg-jz5hs\""
Sep 05 06:50:29.910996 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.910974    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"]
Sep 05 06:50:29.974254 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.974220    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46e80dc3-8fd1-49d9-90f5-17f22987d1c9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv\" (UID: \"46e80dc3-8fd1-49d9-90f5-17f22987d1c9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"
Sep 05 06:50:29.974430 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.974272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp7qs\" (UniqueName: \"kubernetes.io/projected/ae925270-c6cc-453c-91a0-d8206a6c0596-kube-api-access-wp7qs\") pod \"payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc\" (UID: \"ae925270-c6cc-453c-91a0-d8206a6c0596\") " pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"
Sep 05 06:50:29.974430 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.974334    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkgd9\" (UniqueName: \"kubernetes.io/projected/46e80dc3-8fd1-49d9-90f5-17f22987d1c9-kube-api-access-fkgd9\") pod \"payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv\" (UID: \"46e80dc3-8fd1-49d9-90f5-17f22987d1c9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"
Sep 05 06:50:29.974430 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:29.974354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae925270-c6cc-453c-91a0-d8206a6c0596-plugins-config-volume\") pod \"payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc\" (UID: \"ae925270-c6cc-453c-91a0-d8206a6c0596\") " pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"
Sep 05 06:50:30.075140 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.075061    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae925270-c6cc-453c-91a0-d8206a6c0596-plugins-config-volume\") pod \"payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc\" (UID: \"ae925270-c6cc-453c-91a0-d8206a6c0596\") " pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"
Sep 05 06:50:30.075292 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.075145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46e80dc3-8fd1-49d9-90f5-17f22987d1c9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv\" (UID: \"46e80dc3-8fd1-49d9-90f5-17f22987d1c9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"
Sep 05 06:50:30.075292 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.075212    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp7qs\" (UniqueName: \"kubernetes.io/projected/ae925270-c6cc-453c-91a0-d8206a6c0596-kube-api-access-wp7qs\") pod \"payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc\" (UID: \"ae925270-c6cc-453c-91a0-d8206a6c0596\") " pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"
Sep 05 06:50:30.075292 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.075280    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkgd9\" (UniqueName: \"kubernetes.io/projected/46e80dc3-8fd1-49d9-90f5-17f22987d1c9-kube-api-access-fkgd9\") pod \"payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv\" (UID: \"46e80dc3-8fd1-49d9-90f5-17f22987d1c9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"
Sep 05 06:50:30.075849 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.075828    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46e80dc3-8fd1-49d9-90f5-17f22987d1c9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv\" (UID: \"46e80dc3-8fd1-49d9-90f5-17f22987d1c9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"
Sep 05 06:50:30.075917 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.075882    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae925270-c6cc-453c-91a0-d8206a6c0596-plugins-config-volume\") pod \"payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc\" (UID: \"ae925270-c6cc-453c-91a0-d8206a6c0596\") " pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"
Sep 05 06:50:30.086225 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.086199    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkgd9\" (UniqueName: \"kubernetes.io/projected/46e80dc3-8fd1-49d9-90f5-17f22987d1c9-kube-api-access-fkgd9\") pod \"payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv\" (UID: \"46e80dc3-8fd1-49d9-90f5-17f22987d1c9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"
Sep 05 06:50:30.086734 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.086712    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp7qs\" (UniqueName: \"kubernetes.io/projected/ae925270-c6cc-453c-91a0-d8206a6c0596-kube-api-access-wp7qs\") pod \"payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc\" (UID: \"ae925270-c6cc-453c-91a0-d8206a6c0596\") " pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"
Sep 05 06:50:30.176874 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.176836    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"
Sep 05 06:50:30.213820 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.213791    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"
Sep 05 06:50:30.450333 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.450307    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"]
Sep 05 06:50:30.452606 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:50:30.452578    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e80dc3_8fd1_49d9_90f5_17f22987d1c9.slice/crio-42de837a8d53c1246ffd9632b134ee6480888b5ac43b5f321a76e99340c01255 WatchSource:0}: Error finding container 42de837a8d53c1246ffd9632b134ee6480888b5ac43b5f321a76e99340c01255: Status 404 returned error can't find the container with id 42de837a8d53c1246ffd9632b134ee6480888b5ac43b5f321a76e99340c01255
Sep 05 06:50:30.492681 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.492656    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"]
Sep 05 06:50:30.501073 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:50:30.501036    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae925270_c6cc_453c_91a0_d8206a6c0596.slice/crio-b5dc9f3eddcf73149a2b7645f8616381fe71d484e49191b8128319aa08959ed5 WatchSource:0}: Error finding container b5dc9f3eddcf73149a2b7645f8616381fe71d484e49191b8128319aa08959ed5: Status 404 returned error can't find the container with id b5dc9f3eddcf73149a2b7645f8616381fe71d484e49191b8128319aa08959ed5
Sep 05 06:50:30.549989 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.549959    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:50:30.967187 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.967147    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc" event={"ID":"ae925270-c6cc-453c-91a0-d8206a6c0596","Type":"ContainerStarted","Data":"ce822b2c11e19736260fe85304154a51256b60bf7d9ba618324141bad35e856c"}
Sep 05 06:50:30.967381 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.967222    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc" event={"ID":"ae925270-c6cc-453c-91a0-d8206a6c0596","Type":"ContainerStarted","Data":"b5dc9f3eddcf73149a2b7645f8616381fe71d484e49191b8128319aa08959ed5"}
Sep 05 06:50:30.967381 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.967252    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"
Sep 05 06:50:30.968929 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.968891    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv" event={"ID":"46e80dc3-8fd1-49d9-90f5-17f22987d1c9","Type":"ContainerStarted","Data":"9f0b53d01c9d62698493ef5fddac710f7623d102aced932e95d38086ec1a15bb"}
Sep 05 06:50:30.969036 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.968950    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"
Sep 05 06:50:30.969036 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.968968    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv" event={"ID":"46e80dc3-8fd1-49d9-90f5-17f22987d1c9","Type":"ContainerStarted","Data":"42de837a8d53c1246ffd9632b134ee6480888b5ac43b5f321a76e99340c01255"}
Sep 05 06:50:30.990980 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:30.990938    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc" podStartSLOduration=1.990925644 podStartE2EDuration="1.990925644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:50:30.989068924 +0000 UTC m=+1528.593617765" watchObservedRunningTime="2026-09-05 06:50:30.990925644 +0000 UTC m=+1528.595474482"
Sep 05 06:50:31.007149 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:31.007106    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv" podStartSLOduration=2.007091974 podStartE2EDuration="2.007091974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:50:31.005169013 +0000 UTC m=+1528.609717845" watchObservedRunningTime="2026-09-05 06:50:31.007091974 +0000 UTC m=+1528.611640841"
Sep 05 06:50:33.361079 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:33.361050    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:41.540523 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:41.540487    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"]
Sep 05 06:50:41.560229 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:41.560197    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:41.976310 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:41.976278    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"
Sep 05 06:50:41.976508 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:41.976488    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"
Sep 05 06:50:42.440030 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:42.439948    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"]
Sep 05 06:50:42.457764 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:42.457734    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:44.658560 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:44.658525    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:50:50.389719 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:50.389682    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:50.842790 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:50.842755    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"]
Sep 05 06:50:50.846563 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:50.846544    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:50.849080 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:50.849061    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-ef54fd\"/\"rate-test-model-ef54fd-kserve-self-signed-certs\""
Sep 05 06:50:50.857682 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:50.857664    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"]
Sep 05 06:50:50.873430 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:50.873407    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:50.953275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:50.953246    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/612d9e0c-699b-461e-929e-b183a177dd85-tls-certs\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:50.953275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:50.953276    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v58nf\" (UniqueName: \"kubernetes.io/projected/612d9e0c-699b-461e-929e-b183a177dd85-kube-api-access-v58nf\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:50.953459 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:50.953299    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-home\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:50.953459 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:50.953369    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-model-cache\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:50.953459 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:50.953428    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-dshm\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:50.953459 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:50.953456    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-tmp-dir\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.054282 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.054248    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-dshm\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.054282 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.054287    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-tmp-dir\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.054471 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.054338    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/612d9e0c-699b-461e-929e-b183a177dd85-tls-certs\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.054471 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.054435    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v58nf\" (UniqueName: \"kubernetes.io/projected/612d9e0c-699b-461e-929e-b183a177dd85-kube-api-access-v58nf\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.054569 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.054474    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-home\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.054569 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.054524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-model-cache\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.054731 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.054710    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-tmp-dir\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.054883 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.054846    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-home\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.054958 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.054914    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-model-cache\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.056576 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.056550    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-dshm\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.056987 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.056967    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/612d9e0c-699b-461e-929e-b183a177dd85-tls-certs\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.063060 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.063040    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v58nf\" (UniqueName: \"kubernetes.io/projected/612d9e0c-699b-461e-929e-b183a177dd85-kube-api-access-v58nf\") pod \"rate-test-model-ef54fd-kserve-7d7944474c-ddhmz\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") " pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.156139 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.156050    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:50:51.428354 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:51.428275    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"]
Sep 05 06:50:51.432004 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:50:51.431977    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod612d9e0c_699b_461e_929e_b183a177dd85.slice/crio-ea71ad8895e654b4ae4fb035b442f263755ca180ad30ebb64cfc76d1c98e384c WatchSource:0}: Error finding container ea71ad8895e654b4ae4fb035b442f263755ca180ad30ebb64cfc76d1c98e384c: Status 404 returned error can't find the container with id ea71ad8895e654b4ae4fb035b442f263755ca180ad30ebb64cfc76d1c98e384c
Sep 05 06:50:52.087696 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:52.087656    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz" event={"ID":"612d9e0c-699b-461e-929e-b183a177dd85","Type":"ContainerStarted","Data":"052d3aff166f4c114437afbf8629f28c01c6d95c35b728ecdba9e96de2b380c1"}
Sep 05 06:50:52.087696 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:52.087700    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz" event={"ID":"612d9e0c-699b-461e-929e-b183a177dd85","Type":"ContainerStarted","Data":"ea71ad8895e654b4ae4fb035b442f263755ca180ad30ebb64cfc76d1c98e384c"}
Sep 05 06:50:52.105012 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:52.104953    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz" podStartSLOduration=2.10493692 podStartE2EDuration="2.10493692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:50:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:50:52.103112322 +0000 UTC m=+1549.707661160" watchObservedRunningTime="2026-09-05 06:50:52.10493692 +0000 UTC m=+1549.709485758"
Sep 05 06:50:53.135920 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:53.135887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:53.620917 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:53.620888    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:53.955569 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:53.955536    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:54.059780 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:54.059750    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:56.560412 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.560371    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l" podUID="d649fa28-14c3-4fa1-a200-ff50fa913ddd" containerName="main" containerID="cri-o://6cc3d66fa7eac8d7b752dc578fe879539f4c7a0375993c9d4de51b8afb9f0098" gracePeriod=45
Sep 05 06:50:56.809542 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.809513    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:50:56.907166 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.907082    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-dshm\") pod \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") "
Sep 05 06:50:56.907166 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.907121    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-model-cache\") pod \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") "
Sep 05 06:50:56.907166 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.907139    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrmj5\" (UniqueName: \"kubernetes.io/projected/d649fa28-14c3-4fa1-a200-ff50fa913ddd-kube-api-access-wrmj5\") pod \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") "
Sep 05 06:50:56.907166 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.907160    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-tmp-dir\") pod \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") "
Sep 05 06:50:56.907513 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.907271    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-home\") pod \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") "
Sep 05 06:50:56.907513 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.907309    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d649fa28-14c3-4fa1-a200-ff50fa913ddd-tls-certs\") pod \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\" (UID: \"d649fa28-14c3-4fa1-a200-ff50fa913ddd\") "
Sep 05 06:50:56.907513 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.907394    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-model-cache" (OuterVolumeSpecName: "model-cache") pod "d649fa28-14c3-4fa1-a200-ff50fa913ddd" (UID: "d649fa28-14c3-4fa1-a200-ff50fa913ddd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:50:56.907513 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.907452    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d649fa28-14c3-4fa1-a200-ff50fa913ddd" (UID: "d649fa28-14c3-4fa1-a200-ff50fa913ddd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:50:56.907728 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.907553    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-home" (OuterVolumeSpecName: "home") pod "d649fa28-14c3-4fa1-a200-ff50fa913ddd" (UID: "d649fa28-14c3-4fa1-a200-ff50fa913ddd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:50:56.907728 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.907634    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:50:56.907728 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.907649    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:50:56.907728 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.907659    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:50:56.909322 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.909287    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-dshm" (OuterVolumeSpecName: "dshm") pod "d649fa28-14c3-4fa1-a200-ff50fa913ddd" (UID: "d649fa28-14c3-4fa1-a200-ff50fa913ddd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:50:56.909425 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.909358    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d649fa28-14c3-4fa1-a200-ff50fa913ddd-kube-api-access-wrmj5" (OuterVolumeSpecName: "kube-api-access-wrmj5") pod "d649fa28-14c3-4fa1-a200-ff50fa913ddd" (UID: "d649fa28-14c3-4fa1-a200-ff50fa913ddd"). InnerVolumeSpecName "kube-api-access-wrmj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:50:56.909636 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:56.909620    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d649fa28-14c3-4fa1-a200-ff50fa913ddd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d649fa28-14c3-4fa1-a200-ff50fa913ddd" (UID: "d649fa28-14c3-4fa1-a200-ff50fa913ddd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:50:57.009119 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.009078    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d649fa28-14c3-4fa1-a200-ff50fa913ddd-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:50:57.009119 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.009115    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrmj5\" (UniqueName: \"kubernetes.io/projected/d649fa28-14c3-4fa1-a200-ff50fa913ddd-kube-api-access-wrmj5\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:50:57.009119 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.009130    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d649fa28-14c3-4fa1-a200-ff50fa913ddd-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:50:57.115809 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.115768    2583 generic.go:356] "Generic (PLEG): container finished" podID="d649fa28-14c3-4fa1-a200-ff50fa913ddd" containerID="6cc3d66fa7eac8d7b752dc578fe879539f4c7a0375993c9d4de51b8afb9f0098" exitCode=0
Sep 05 06:50:57.116019 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.115818    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"
Sep 05 06:50:57.116019 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.115881    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l" event={"ID":"d649fa28-14c3-4fa1-a200-ff50fa913ddd","Type":"ContainerDied","Data":"6cc3d66fa7eac8d7b752dc578fe879539f4c7a0375993c9d4de51b8afb9f0098"}
Sep 05 06:50:57.116019 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.115922    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l" event={"ID":"d649fa28-14c3-4fa1-a200-ff50fa913ddd","Type":"ContainerDied","Data":"e4ebceb0b0da6038400e77272e7f0ccecceba187cca1a3632bf7bb98734461dd"}
Sep 05 06:50:57.116019 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.115940    2583 scope.go:117] "RemoveContainer" containerID="6cc3d66fa7eac8d7b752dc578fe879539f4c7a0375993c9d4de51b8afb9f0098"
Sep 05 06:50:57.125246 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.125229    2583 scope.go:117] "RemoveContainer" containerID="6cc3d66fa7eac8d7b752dc578fe879539f4c7a0375993c9d4de51b8afb9f0098"
Sep 05 06:50:57.125525 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:50:57.125498    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cc3d66fa7eac8d7b752dc578fe879539f4c7a0375993c9d4de51b8afb9f0098\": container with ID starting with 6cc3d66fa7eac8d7b752dc578fe879539f4c7a0375993c9d4de51b8afb9f0098 not found: ID does not exist" containerID="6cc3d66fa7eac8d7b752dc578fe879539f4c7a0375993c9d4de51b8afb9f0098"
Sep 05 06:50:57.125571 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.125528    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc3d66fa7eac8d7b752dc578fe879539f4c7a0375993c9d4de51b8afb9f0098"} err="failed to get container status \"6cc3d66fa7eac8d7b752dc578fe879539f4c7a0375993c9d4de51b8afb9f0098\": rpc error: code = NotFound desc = could not find container \"6cc3d66fa7eac8d7b752dc578fe879539f4c7a0375993c9d4de51b8afb9f0098\": container with ID starting with 6cc3d66fa7eac8d7b752dc578fe879539f4c7a0375993c9d4de51b8afb9f0098 not found: ID does not exist"
Sep 05 06:50:57.132822 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.132795    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"]
Sep 05 06:50:57.141808 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.136974    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/sub-test-model-ef54fd-kserve-7ddc46fc8c-fhn7l"]
Sep 05 06:50:57.331156 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.331121    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:57.428904 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.428871    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:57.459413 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.459384    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9" podUID="6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c" containerName="main" containerID="cri-o://b995f88146ad9045fda9dcec97283eafc3c493883f4d39d301fbcf8d072e423c" gracePeriod=45
Sep 05 06:50:57.724255 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.724226    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:50:57.816096 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.816059    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-model-cache\") pod \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") "
Sep 05 06:50:57.816279 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.816120    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-dshm\") pod \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") "
Sep 05 06:50:57.816279 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.816182    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-tls-certs\") pod \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") "
Sep 05 06:50:57.816279 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.816204    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-home\") pod \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") "
Sep 05 06:50:57.816279 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.816259    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9t6g\" (UniqueName: \"kubernetes.io/projected/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-kube-api-access-m9t6g\") pod \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") "
Sep 05 06:50:57.816497 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.816285    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-tmp-dir\") pod \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\" (UID: \"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c\") "
Sep 05 06:50:57.816497 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.816364    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c" (UID: "6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:50:57.816604 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.816518    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-home" (OuterVolumeSpecName: "home") pod "6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c" (UID: "6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:50:57.816604 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.816578    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:50:57.816683 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.816602    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c" (UID: "6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:50:57.818345 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.818321    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c" (UID: "6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:50:57.818448 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.818357    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-kube-api-access-m9t6g" (OuterVolumeSpecName: "kube-api-access-m9t6g") pod "6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c" (UID: "6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c"). InnerVolumeSpecName "kube-api-access-m9t6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:50:57.818448 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.818390    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-dshm" (OuterVolumeSpecName: "dshm") pod "6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c" (UID: "6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:50:57.917524 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.917449    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:50:57.917524 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.917475    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:50:57.917524 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.917486    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9t6g\" (UniqueName: \"kubernetes.io/projected/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-kube-api-access-m9t6g\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:50:57.917524 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.917495    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:50:57.917524 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:57.917504    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:50:58.123092 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.123056    2583 generic.go:356] "Generic (PLEG): container finished" podID="6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c" containerID="b995f88146ad9045fda9dcec97283eafc3c493883f4d39d301fbcf8d072e423c" exitCode=0
Sep 05 06:50:58.123262 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.123100    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"
Sep 05 06:50:58.123262 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.123124    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9" event={"ID":"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c","Type":"ContainerDied","Data":"b995f88146ad9045fda9dcec97283eafc3c493883f4d39d301fbcf8d072e423c"}
Sep 05 06:50:58.123262 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.123160    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9" event={"ID":"6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c","Type":"ContainerDied","Data":"b6260af5e745a7f720c2a86f2c65ca014486a884735033da3a5e22432f2effd2"}
Sep 05 06:50:58.123262 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.123182    2583 scope.go:117] "RemoveContainer" containerID="b995f88146ad9045fda9dcec97283eafc3c493883f4d39d301fbcf8d072e423c"
Sep 05 06:50:58.132908 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.132884    2583 scope.go:117] "RemoveContainer" containerID="b995f88146ad9045fda9dcec97283eafc3c493883f4d39d301fbcf8d072e423c"
Sep 05 06:50:58.133191 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:50:58.133173    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b995f88146ad9045fda9dcec97283eafc3c493883f4d39d301fbcf8d072e423c\": container with ID starting with b995f88146ad9045fda9dcec97283eafc3c493883f4d39d301fbcf8d072e423c not found: ID does not exist" containerID="b995f88146ad9045fda9dcec97283eafc3c493883f4d39d301fbcf8d072e423c"
Sep 05 06:50:58.133247 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.133199    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b995f88146ad9045fda9dcec97283eafc3c493883f4d39d301fbcf8d072e423c"} err="failed to get container status \"b995f88146ad9045fda9dcec97283eafc3c493883f4d39d301fbcf8d072e423c\": rpc error: code = NotFound desc = could not find container \"b995f88146ad9045fda9dcec97283eafc3c493883f4d39d301fbcf8d072e423c\": container with ID starting with b995f88146ad9045fda9dcec97283eafc3c493883f4d39d301fbcf8d072e423c not found: ID does not exist"
Sep 05 06:50:58.146124 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.146095    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"]
Sep 05 06:50:58.148674 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.148651    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/sub-test-model-5b1d24-kserve-6785d895-hg5m9"]
Sep 05 06:50:58.465683 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.465649    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:58.565638 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.565604    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:58.679157 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.679129    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:58.914830 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.914750    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c" path="/var/lib/kubelet/pods/6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c/volumes"
Sep 05 06:50:58.915208 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.915157    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d649fa28-14c3-4fa1-a200-ff50fa913ddd" path="/var/lib/kubelet/pods/d649fa28-14c3-4fa1-a200-ff50fa913ddd/volumes"
Sep 05 06:50:58.979820 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:58.979793    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:59.076928 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.076900    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:50:59.081206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.081184    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"]
Sep 05 06:50:59.081539 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.081527    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c" containerName="main"
Sep 05 06:50:59.081593 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.081540    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c" containerName="main"
Sep 05 06:50:59.081593 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.081560    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d649fa28-14c3-4fa1-a200-ff50fa913ddd" containerName="main"
Sep 05 06:50:59.081593 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.081566    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d649fa28-14c3-4fa1-a200-ff50fa913ddd" containerName="main"
Sep 05 06:50:59.081701 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.081630    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d649fa28-14c3-4fa1-a200-ff50fa913ddd" containerName="main"
Sep 05 06:50:59.081701 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.081638    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ebd7ad2-b4d7-4e29-88ff-9b8f7829f71c" containerName="main"
Sep 05 06:50:59.085806 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.085791    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"
Sep 05 06:50:59.088536 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.088515    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-d91c81\""
Sep 05 06:50:59.088654 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.088515    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-d91c81-dockercfg-djl9c\""
Sep 05 06:50:59.095846 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.095821    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"]
Sep 05 06:50:59.106070 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.106036    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"]
Sep 05 06:50:59.109500 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.109480    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"
Sep 05 06:50:59.122883 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.122841    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"]
Sep 05 06:50:59.229566 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.229529    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb352efd-35ec-4cb9-9043-89df49c03a2a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b\" (UID: \"cb352efd-35ec-4cb9-9043-89df49c03a2a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"
Sep 05 06:50:59.229737 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.229581    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab13c58-4eff-4402-948d-71bf9d9dd239-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx\" (UID: \"9ab13c58-4eff-4402-948d-71bf9d9dd239\") " pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"
Sep 05 06:50:59.229737 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.229617    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfrn8\" (UniqueName: \"kubernetes.io/projected/cb352efd-35ec-4cb9-9043-89df49c03a2a-kube-api-access-sfrn8\") pod \"payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b\" (UID: \"cb352efd-35ec-4cb9-9043-89df49c03a2a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"
Sep 05 06:50:59.229737 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.229654    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pttqk\" (UniqueName: \"kubernetes.io/projected/9ab13c58-4eff-4402-948d-71bf9d9dd239-kube-api-access-pttqk\") pod \"payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx\" (UID: \"9ab13c58-4eff-4402-948d-71bf9d9dd239\") " pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"
Sep 05 06:50:59.330975 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.330936    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb352efd-35ec-4cb9-9043-89df49c03a2a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b\" (UID: \"cb352efd-35ec-4cb9-9043-89df49c03a2a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"
Sep 05 06:50:59.331157 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.330986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab13c58-4eff-4402-948d-71bf9d9dd239-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx\" (UID: \"9ab13c58-4eff-4402-948d-71bf9d9dd239\") " pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"
Sep 05 06:50:59.331157 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.331024    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfrn8\" (UniqueName: \"kubernetes.io/projected/cb352efd-35ec-4cb9-9043-89df49c03a2a-kube-api-access-sfrn8\") pod \"payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b\" (UID: \"cb352efd-35ec-4cb9-9043-89df49c03a2a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"
Sep 05 06:50:59.331157 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.331052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pttqk\" (UniqueName: \"kubernetes.io/projected/9ab13c58-4eff-4402-948d-71bf9d9dd239-kube-api-access-pttqk\") pod \"payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx\" (UID: \"9ab13c58-4eff-4402-948d-71bf9d9dd239\") " pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"
Sep 05 06:50:59.331689 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.331668    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb352efd-35ec-4cb9-9043-89df49c03a2a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b\" (UID: \"cb352efd-35ec-4cb9-9043-89df49c03a2a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"
Sep 05 06:50:59.331786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.331765    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab13c58-4eff-4402-948d-71bf9d9dd239-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx\" (UID: \"9ab13c58-4eff-4402-948d-71bf9d9dd239\") " pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"
Sep 05 06:50:59.341280 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.341243    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pttqk\" (UniqueName: \"kubernetes.io/projected/9ab13c58-4eff-4402-948d-71bf9d9dd239-kube-api-access-pttqk\") pod \"payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx\" (UID: \"9ab13c58-4eff-4402-948d-71bf9d9dd239\") " pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"
Sep 05 06:50:59.341280 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.341249    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfrn8\" (UniqueName: \"kubernetes.io/projected/cb352efd-35ec-4cb9-9043-89df49c03a2a-kube-api-access-sfrn8\") pod \"payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b\" (UID: \"cb352efd-35ec-4cb9-9043-89df49c03a2a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"
Sep 05 06:50:59.397959 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.397931    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"
Sep 05 06:50:59.420793 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.420763    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"
Sep 05 06:50:59.672114 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.672087    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"]
Sep 05 06:50:59.673986 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:50:59.673960    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb352efd_35ec_4cb9_9043_89df49c03a2a.slice/crio-80aea76c45d7e1621b765dc74536160703726cad5746e1fac30934a7b5335884 WatchSource:0}: Error finding container 80aea76c45d7e1621b765dc74536160703726cad5746e1fac30934a7b5335884: Status 404 returned error can't find the container with id 80aea76c45d7e1621b765dc74536160703726cad5746e1fac30934a7b5335884
Sep 05 06:50:59.702194 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:50:59.702169    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"]
Sep 05 06:50:59.706922 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:50:59.706897    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab13c58_4eff_4402_948d_71bf9d9dd239.slice/crio-cb50436255f811e7866c0adb80860f82e40fd036711321c0d690b0be08faedba WatchSource:0}: Error finding container cb50436255f811e7866c0adb80860f82e40fd036711321c0d690b0be08faedba: Status 404 returned error can't find the container with id cb50436255f811e7866c0adb80860f82e40fd036711321c0d690b0be08faedba
Sep 05 06:51:00.138942 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:00.138340    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx" event={"ID":"9ab13c58-4eff-4402-948d-71bf9d9dd239","Type":"ContainerStarted","Data":"1b35930beb4e557220e08ef2697d80fe54bf83dfee90e513842a2a32c63cf7ab"}
Sep 05 06:51:00.138942 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:00.138420    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx" event={"ID":"9ab13c58-4eff-4402-948d-71bf9d9dd239","Type":"ContainerStarted","Data":"cb50436255f811e7866c0adb80860f82e40fd036711321c0d690b0be08faedba"}
Sep 05 06:51:00.138942 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:00.138454    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"
Sep 05 06:51:00.140997 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:00.140964    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b" event={"ID":"cb352efd-35ec-4cb9-9043-89df49c03a2a","Type":"ContainerStarted","Data":"c719ad1cc9b7fe344e117dcf84f1c130f7ee007c83797dc622d2eaf5f501a818"}
Sep 05 06:51:00.141113 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:00.141018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b" event={"ID":"cb352efd-35ec-4cb9-9043-89df49c03a2a","Type":"ContainerStarted","Data":"80aea76c45d7e1621b765dc74536160703726cad5746e1fac30934a7b5335884"}
Sep 05 06:51:00.141113 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:00.141051    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"
Sep 05 06:51:00.155443 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:00.155397    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx" podStartSLOduration=1.155382798 podStartE2EDuration="1.155382798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:50:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:51:00.153959882 +0000 UTC m=+1557.758508721" watchObservedRunningTime="2026-09-05 06:51:00.155382798 +0000 UTC m=+1557.759931636"
Sep 05 06:51:00.169957 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:00.169744    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b" podStartSLOduration=1.169726624 podStartE2EDuration="1.169726624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:50:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:51:00.168712245 +0000 UTC m=+1557.773261084" watchObservedRunningTime="2026-09-05 06:51:00.169726624 +0000 UTC m=+1557.774275463"
Sep 05 06:51:01.156621 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:01.156590    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:51:01.157020 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:01.156656    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:51:01.169104 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:01.169077    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:51:02.163065 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:02.163040    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:51:03.097730 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:03.097686    2583 scope.go:117] "RemoveContainer" containerID="edda833bd073ddcadf2f10424de9c08c2ba37a2b5d96b339641c5b3df78d8fed"
Sep 05 06:51:03.555181 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:03.555141    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:51:11.148666 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:11.148629    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"
Sep 05 06:51:11.149155 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:11.148704    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"
Sep 05 06:51:22.198847 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:22.198813    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:22.358929 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:22.358893    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:24.904736 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:24.904694    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:25.452768 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:25.452735    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2"]
Sep 05 06:51:25.456453 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:25.456436    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2"
Sep 05 06:51:25.458959 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:25.458936    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:51:25.459080 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:25.459051    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:51:25.462916 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:25.462891    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2"]
Sep 05 06:51:25.544845 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:25.544805    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b3c9ca-40b9-48c5-9463-691cfae43342-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-73c192-qcrz2\" (UID: \"b4b3c9ca-40b9-48c5-9463-691cfae43342\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2"
Sep 05 06:51:25.646148 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:25.646111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b3c9ca-40b9-48c5-9463-691cfae43342-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-73c192-qcrz2\" (UID: \"b4b3c9ca-40b9-48c5-9463-691cfae43342\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2"
Sep 05 06:51:25.646704 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:25.646683    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b3c9ca-40b9-48c5-9463-691cfae43342-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-73c192-qcrz2\" (UID: \"b4b3c9ca-40b9-48c5-9463-691cfae43342\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2"
Sep 05 06:51:25.663123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:25.663098    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:25.768115 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:25.768011    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2"
Sep 05 06:51:26.046016 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:26.045931    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2"]
Sep 05 06:51:26.049406 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:51:26.049381    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b3c9ca_40b9_48c5_9463_691cfae43342.slice/crio-3b9c4cad57295de11a8817112f75f240faff6b5fef5c1e98c994ec4680897494 WatchSource:0}: Error finding container 3b9c4cad57295de11a8817112f75f240faff6b5fef5c1e98c994ec4680897494: Status 404 returned error can't find the container with id 3b9c4cad57295de11a8817112f75f240faff6b5fef5c1e98c994ec4680897494
Sep 05 06:51:26.273593 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:26.273555    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2" event={"ID":"b4b3c9ca-40b9-48c5-9463-691cfae43342","Type":"ContainerStarted","Data":"3e7c0be7ee6539a7077b2fe336a754ed346082650d1a417b908cc3860744b0d1"}
Sep 05 06:51:26.273776 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:26.273631    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2" event={"ID":"b4b3c9ca-40b9-48c5-9463-691cfae43342","Type":"ContainerStarted","Data":"3b9c4cad57295de11a8817112f75f240faff6b5fef5c1e98c994ec4680897494"}
Sep 05 06:51:26.292754 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:26.292703    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2" podStartSLOduration=1.29268998 podStartE2EDuration="1.29268998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:51:26.291100544 +0000 UTC m=+1583.895649381" watchObservedRunningTime="2026-09-05 06:51:26.29268998 +0000 UTC m=+1583.897238815"
Sep 05 06:51:27.280481 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:27.280439    2583 generic.go:356] "Generic (PLEG): container finished" podID="b4b3c9ca-40b9-48c5-9463-691cfae43342" containerID="3e7c0be7ee6539a7077b2fe336a754ed346082650d1a417b908cc3860744b0d1" exitCode=0
Sep 05 06:51:27.280922 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:27.280504    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2" event={"ID":"b4b3c9ca-40b9-48c5-9463-691cfae43342","Type":"ContainerDied","Data":"3e7c0be7ee6539a7077b2fe336a754ed346082650d1a417b908cc3860744b0d1"}
Sep 05 06:51:28.426684 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:28.426661    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2"
Sep 05 06:51:28.468901 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:28.468852    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b3c9ca-40b9-48c5-9463-691cfae43342-maas-api-service-ca\") pod \"b4b3c9ca-40b9-48c5-9463-691cfae43342\" (UID: \"b4b3c9ca-40b9-48c5-9463-691cfae43342\") "
Sep 05 06:51:28.469186 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:28.469164    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4b3c9ca-40b9-48c5-9463-691cfae43342-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b4b3c9ca-40b9-48c5-9463-691cfae43342" (UID: "b4b3c9ca-40b9-48c5-9463-691cfae43342"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:51:28.570528 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:28.570443    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b3c9ca-40b9-48c5-9463-691cfae43342-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:51:29.293467 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:29.293437    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2"
Sep 05 06:51:29.293661 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:29.293476    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2" event={"ID":"b4b3c9ca-40b9-48c5-9463-691cfae43342","Type":"ContainerDied","Data":"3b9c4cad57295de11a8817112f75f240faff6b5fef5c1e98c994ec4680897494"}
Sep 05 06:51:29.293661 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:29.293533    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b9c4cad57295de11a8817112f75f240faff6b5fef5c1e98c994ec4680897494"
Sep 05 06:51:29.547602 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:29.547530    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:51:41.063457 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.063422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:41.125487 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.125444    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"]
Sep 05 06:51:41.125684 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.125661    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc" podUID="ae925270-c6cc-453c-91a0-d8206a6c0596" containerName="payload-processing" containerID="cri-o://ce822b2c11e19736260fe85304154a51256b60bf7d9ba618324141bad35e856c" gracePeriod=30
Sep 05 06:51:41.132926 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.132837    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"]
Sep 05 06:51:41.134005 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.133062    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv" podUID="46e80dc3-8fd1-49d9-90f5-17f22987d1c9" containerName="payload-pre-processing" containerID="cri-o://9f0b53d01c9d62698493ef5fddac710f7623d102aced932e95d38086ec1a15bb" gracePeriod=30
Sep 05 06:51:41.162692 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.162654    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:41.264139 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.264105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:41.309202 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.309174    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2"]
Sep 05 06:51:41.312400 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.312329    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-73c192-qcrz2"]
Sep 05 06:51:41.360671 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.360643    2583 generic.go:356] "Generic (PLEG): container finished" podID="ae925270-c6cc-453c-91a0-d8206a6c0596" containerID="ce822b2c11e19736260fe85304154a51256b60bf7d9ba618324141bad35e856c" exitCode=0
Sep 05 06:51:41.360803 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.360714    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc" event={"ID":"ae925270-c6cc-453c-91a0-d8206a6c0596","Type":"ContainerDied","Data":"ce822b2c11e19736260fe85304154a51256b60bf7d9ba618324141bad35e856c"}
Sep 05 06:51:41.362555 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.362531    2583 generic.go:356] "Generic (PLEG): container finished" podID="46e80dc3-8fd1-49d9-90f5-17f22987d1c9" containerID="9f0b53d01c9d62698493ef5fddac710f7623d102aced932e95d38086ec1a15bb" exitCode=0
Sep 05 06:51:41.362667 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.362609    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv" event={"ID":"46e80dc3-8fd1-49d9-90f5-17f22987d1c9","Type":"ContainerDied","Data":"9f0b53d01c9d62698493ef5fddac710f7623d102aced932e95d38086ec1a15bb"}
Sep 05 06:51:41.363601 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.363538    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:41.381071 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.381055    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"
Sep 05 06:51:41.415506 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.415484    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"
Sep 05 06:51:41.482675 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.482643    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp7qs\" (UniqueName: \"kubernetes.io/projected/ae925270-c6cc-453c-91a0-d8206a6c0596-kube-api-access-wp7qs\") pod \"ae925270-c6cc-453c-91a0-d8206a6c0596\" (UID: \"ae925270-c6cc-453c-91a0-d8206a6c0596\") "
Sep 05 06:51:41.482837 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.482694    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46e80dc3-8fd1-49d9-90f5-17f22987d1c9-plugins-config-volume\") pod \"46e80dc3-8fd1-49d9-90f5-17f22987d1c9\" (UID: \"46e80dc3-8fd1-49d9-90f5-17f22987d1c9\") "
Sep 05 06:51:41.482837 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.482717    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkgd9\" (UniqueName: \"kubernetes.io/projected/46e80dc3-8fd1-49d9-90f5-17f22987d1c9-kube-api-access-fkgd9\") pod \"46e80dc3-8fd1-49d9-90f5-17f22987d1c9\" (UID: \"46e80dc3-8fd1-49d9-90f5-17f22987d1c9\") "
Sep 05 06:51:41.482837 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.482794    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae925270-c6cc-453c-91a0-d8206a6c0596-plugins-config-volume\") pod \"ae925270-c6cc-453c-91a0-d8206a6c0596\" (UID: \"ae925270-c6cc-453c-91a0-d8206a6c0596\") "
Sep 05 06:51:41.483198 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.483158    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46e80dc3-8fd1-49d9-90f5-17f22987d1c9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "46e80dc3-8fd1-49d9-90f5-17f22987d1c9" (UID: "46e80dc3-8fd1-49d9-90f5-17f22987d1c9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:51:41.483306 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.483204    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae925270-c6cc-453c-91a0-d8206a6c0596-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ae925270-c6cc-453c-91a0-d8206a6c0596" (UID: "ae925270-c6cc-453c-91a0-d8206a6c0596"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:51:41.484741 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.484718    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae925270-c6cc-453c-91a0-d8206a6c0596-kube-api-access-wp7qs" (OuterVolumeSpecName: "kube-api-access-wp7qs") pod "ae925270-c6cc-453c-91a0-d8206a6c0596" (UID: "ae925270-c6cc-453c-91a0-d8206a6c0596"). InnerVolumeSpecName "kube-api-access-wp7qs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:51:41.484839 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.484743    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46e80dc3-8fd1-49d9-90f5-17f22987d1c9-kube-api-access-fkgd9" (OuterVolumeSpecName: "kube-api-access-fkgd9") pod "46e80dc3-8fd1-49d9-90f5-17f22987d1c9" (UID: "46e80dc3-8fd1-49d9-90f5-17f22987d1c9"). InnerVolumeSpecName "kube-api-access-fkgd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:51:41.584326 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.584291    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkgd9\" (UniqueName: \"kubernetes.io/projected/46e80dc3-8fd1-49d9-90f5-17f22987d1c9-kube-api-access-fkgd9\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:51:41.584326 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.584321    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae925270-c6cc-453c-91a0-d8206a6c0596-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:51:41.584326 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.584332    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp7qs\" (UniqueName: \"kubernetes.io/projected/ae925270-c6cc-453c-91a0-d8206a6c0596-kube-api-access-wp7qs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:51:41.584540 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.584342    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46e80dc3-8fd1-49d9-90f5-17f22987d1c9-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:51:41.679262 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:41.679165    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:42.369460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:42.369428    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"
Sep 05 06:51:42.369962 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:42.369453    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc" event={"ID":"ae925270-c6cc-453c-91a0-d8206a6c0596","Type":"ContainerDied","Data":"b5dc9f3eddcf73149a2b7645f8616381fe71d484e49191b8128319aa08959ed5"}
Sep 05 06:51:42.369962 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:42.369517    2583 scope.go:117] "RemoveContainer" containerID="ce822b2c11e19736260fe85304154a51256b60bf7d9ba618324141bad35e856c"
Sep 05 06:51:42.370920 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:42.370899    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv" event={"ID":"46e80dc3-8fd1-49d9-90f5-17f22987d1c9","Type":"ContainerDied","Data":"42de837a8d53c1246ffd9632b134ee6480888b5ac43b5f321a76e99340c01255"}
Sep 05 06:51:42.371004 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:42.370917    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"
Sep 05 06:51:42.379597 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:42.379515    2583 scope.go:117] "RemoveContainer" containerID="9f0b53d01c9d62698493ef5fddac710f7623d102aced932e95d38086ec1a15bb"
Sep 05 06:51:42.395380 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:42.395326    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"]
Sep 05 06:51:42.399944 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:42.399921    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc"]
Sep 05 06:51:42.411094 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:42.411072    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"]
Sep 05 06:51:42.414672 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:42.414650    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv"]
Sep 05 06:51:42.915369 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:42.915333    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46e80dc3-8fd1-49d9-90f5-17f22987d1c9" path="/var/lib/kubelet/pods/46e80dc3-8fd1-49d9-90f5-17f22987d1c9/volumes"
Sep 05 06:51:42.915800 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:42.915778    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae925270-c6cc-453c-91a0-d8206a6c0596" path="/var/lib/kubelet/pods/ae925270-c6cc-453c-91a0-d8206a6c0596/volumes"
Sep 05 06:51:42.916153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:42.916134    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4b3c9ca-40b9-48c5-9463-691cfae43342" path="/var/lib/kubelet/pods/b4b3c9ca-40b9-48c5-9463-691cfae43342/volumes"
Sep 05 06:51:43.209628 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:43.209593    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:45.654210 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:45.654172    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:51:47.599000 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:47.598938    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:47.659569 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:47.659539    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:47.875947 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:47.875804    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:48.231033 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.230996    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g"]
Sep 05 06:51:48.231405 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.231392    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46e80dc3-8fd1-49d9-90f5-17f22987d1c9" containerName="payload-pre-processing"
Sep 05 06:51:48.231466 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.231407    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="46e80dc3-8fd1-49d9-90f5-17f22987d1c9" containerName="payload-pre-processing"
Sep 05 06:51:48.231466 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.231417    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4b3c9ca-40b9-48c5-9463-691cfae43342" containerName="revoke-keys"
Sep 05 06:51:48.231466 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.231422    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4b3c9ca-40b9-48c5-9463-691cfae43342" containerName="revoke-keys"
Sep 05 06:51:48.231466 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.231435    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae925270-c6cc-453c-91a0-d8206a6c0596" containerName="payload-processing"
Sep 05 06:51:48.231466 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.231441    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae925270-c6cc-453c-91a0-d8206a6c0596" containerName="payload-processing"
Sep 05 06:51:48.231623 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.231502    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="46e80dc3-8fd1-49d9-90f5-17f22987d1c9" containerName="payload-pre-processing"
Sep 05 06:51:48.231623 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.231512    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4b3c9ca-40b9-48c5-9463-691cfae43342" containerName="revoke-keys"
Sep 05 06:51:48.231623 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.231518    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae925270-c6cc-453c-91a0-d8206a6c0596" containerName="payload-processing"
Sep 05 06:51:48.235592 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.235573    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g"
Sep 05 06:51:48.238123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.238099    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:51:48.238222 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.238101    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:51:48.242257 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.242234    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g"]
Sep 05 06:51:48.328960 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.328926    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:48.343191 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.343156    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/960e3d2b-5b9e-4c21-ac01-e82b203117bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g\" (UID: \"960e3d2b-5b9e-4c21-ac01-e82b203117bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g"
Sep 05 06:51:48.443646 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.443609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/960e3d2b-5b9e-4c21-ac01-e82b203117bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g\" (UID: \"960e3d2b-5b9e-4c21-ac01-e82b203117bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g"
Sep 05 06:51:48.444275 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.444254    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/960e3d2b-5b9e-4c21-ac01-e82b203117bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g\" (UID: \"960e3d2b-5b9e-4c21-ac01-e82b203117bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g"
Sep 05 06:51:48.548037 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.547940    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g"
Sep 05 06:51:48.822965 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:48.822933    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g"]
Sep 05 06:51:48.824972 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:51:48.824943    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960e3d2b_5b9e_4c21_ac01_e82b203117bd.slice/crio-99be4865aa7fcd94d2467e009dd12be83a593113a68ed29320d37ecd067181af WatchSource:0}: Error finding container 99be4865aa7fcd94d2467e009dd12be83a593113a68ed29320d37ecd067181af: Status 404 returned error can't find the container with id 99be4865aa7fcd94d2467e009dd12be83a593113a68ed29320d37ecd067181af
Sep 05 06:51:49.414663 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:49.414570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g" event={"ID":"960e3d2b-5b9e-4c21-ac01-e82b203117bd","Type":"ContainerStarted","Data":"84e565a4fecaadba0c7491979de1c5d6a982c99d4bbe19893c923fb33b94d992"}
Sep 05 06:51:49.414663 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:49.414643    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g" event={"ID":"960e3d2b-5b9e-4c21-ac01-e82b203117bd","Type":"ContainerStarted","Data":"99be4865aa7fcd94d2467e009dd12be83a593113a68ed29320d37ecd067181af"}
Sep 05 06:51:49.429876 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:49.429817    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g" podStartSLOduration=1.429802763 podStartE2EDuration="1.429802763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:51:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:51:49.42806544 +0000 UTC m=+1607.032614278" watchObservedRunningTime="2026-09-05 06:51:49.429802763 +0000 UTC m=+1607.034351600"
Sep 05 06:51:50.421408 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:50.421369    2583 generic.go:356] "Generic (PLEG): container finished" podID="960e3d2b-5b9e-4c21-ac01-e82b203117bd" containerID="84e565a4fecaadba0c7491979de1c5d6a982c99d4bbe19893c923fb33b94d992" exitCode=0
Sep 05 06:51:50.421816 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:50.421451    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g" event={"ID":"960e3d2b-5b9e-4c21-ac01-e82b203117bd","Type":"ContainerDied","Data":"84e565a4fecaadba0c7491979de1c5d6a982c99d4bbe19893c923fb33b94d992"}
Sep 05 06:51:51.560354 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:51.560325    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g"
Sep 05 06:51:51.671445 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:51.671409    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/960e3d2b-5b9e-4c21-ac01-e82b203117bd-maas-api-service-ca\") pod \"960e3d2b-5b9e-4c21-ac01-e82b203117bd\" (UID: \"960e3d2b-5b9e-4c21-ac01-e82b203117bd\") "
Sep 05 06:51:51.671749 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:51.671724    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/960e3d2b-5b9e-4c21-ac01-e82b203117bd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "960e3d2b-5b9e-4c21-ac01-e82b203117bd" (UID: "960e3d2b-5b9e-4c21-ac01-e82b203117bd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:51:51.772323 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:51.772289    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/960e3d2b-5b9e-4c21-ac01-e82b203117bd-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:51:52.432780 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:52.432743    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g"
Sep 05 06:51:52.432950 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:52.432775    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g" event={"ID":"960e3d2b-5b9e-4c21-ac01-e82b203117bd","Type":"ContainerDied","Data":"99be4865aa7fcd94d2467e009dd12be83a593113a68ed29320d37ecd067181af"}
Sep 05 06:51:52.432950 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:52.432830    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99be4865aa7fcd94d2467e009dd12be83a593113a68ed29320d37ecd067181af"
Sep 05 06:51:54.540608 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:54.540573    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:51:58.516960 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:51:58.516889    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:03.129041 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:03.129004    2583 scope.go:117] "RemoveContainer" containerID="f315ce603ba5e2cf27c94bc832856a0592ec5358d9073f40f403fdec8fd493e6"
Sep 05 06:52:04.166632 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.166590    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:04.200967 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.200919    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"]
Sep 05 06:52:04.201468 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.201434    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx" podUID="9ab13c58-4eff-4402-948d-71bf9d9dd239" containerName="payload-processing" containerID="cri-o://1b35930beb4e557220e08ef2697d80fe54bf83dfee90e513842a2a32c63cf7ab" gracePeriod=30
Sep 05 06:52:04.210732 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.210706    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"]
Sep 05 06:52:04.211002 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.210954    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b" podUID="cb352efd-35ec-4cb9-9043-89df49c03a2a" containerName="payload-pre-processing" containerID="cri-o://c719ad1cc9b7fe344e117dcf84f1c130f7ee007c83797dc622d2eaf5f501a818" gracePeriod=30
Sep 05 06:52:04.243240 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.243182    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:04.341918 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.341881    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:04.387432 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.387402    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g"]
Sep 05 06:52:04.389208 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.389186    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d91c81-vnm6g"]
Sep 05 06:52:04.419733 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.419701    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:04.488274 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.488248    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"
Sep 05 06:52:04.490744 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.490727    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"
Sep 05 06:52:04.501167 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.501141    2583 generic.go:356] "Generic (PLEG): container finished" podID="9ab13c58-4eff-4402-948d-71bf9d9dd239" containerID="1b35930beb4e557220e08ef2697d80fe54bf83dfee90e513842a2a32c63cf7ab" exitCode=0
Sep 05 06:52:04.501283 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.501186    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"
Sep 05 06:52:04.501283 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.501215    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx" event={"ID":"9ab13c58-4eff-4402-948d-71bf9d9dd239","Type":"ContainerDied","Data":"1b35930beb4e557220e08ef2697d80fe54bf83dfee90e513842a2a32c63cf7ab"}
Sep 05 06:52:04.501283 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.501260    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx" event={"ID":"9ab13c58-4eff-4402-948d-71bf9d9dd239","Type":"ContainerDied","Data":"cb50436255f811e7866c0adb80860f82e40fd036711321c0d690b0be08faedba"}
Sep 05 06:52:04.501438 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.501286    2583 scope.go:117] "RemoveContainer" containerID="1b35930beb4e557220e08ef2697d80fe54bf83dfee90e513842a2a32c63cf7ab"
Sep 05 06:52:04.502600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.502578    2583 generic.go:356] "Generic (PLEG): container finished" podID="cb352efd-35ec-4cb9-9043-89df49c03a2a" containerID="c719ad1cc9b7fe344e117dcf84f1c130f7ee007c83797dc622d2eaf5f501a818" exitCode=0
Sep 05 06:52:04.502702 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.502616    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"
Sep 05 06:52:04.502702 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.502635    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b" event={"ID":"cb352efd-35ec-4cb9-9043-89df49c03a2a","Type":"ContainerDied","Data":"c719ad1cc9b7fe344e117dcf84f1c130f7ee007c83797dc622d2eaf5f501a818"}
Sep 05 06:52:04.502702 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.502672    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b" event={"ID":"cb352efd-35ec-4cb9-9043-89df49c03a2a","Type":"ContainerDied","Data":"80aea76c45d7e1621b765dc74536160703726cad5746e1fac30934a7b5335884"}
Sep 05 06:52:04.511149 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.511128    2583 scope.go:117] "RemoveContainer" containerID="1b35930beb4e557220e08ef2697d80fe54bf83dfee90e513842a2a32c63cf7ab"
Sep 05 06:52:04.511436 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:52:04.511414    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b35930beb4e557220e08ef2697d80fe54bf83dfee90e513842a2a32c63cf7ab\": container with ID starting with 1b35930beb4e557220e08ef2697d80fe54bf83dfee90e513842a2a32c63cf7ab not found: ID does not exist" containerID="1b35930beb4e557220e08ef2697d80fe54bf83dfee90e513842a2a32c63cf7ab"
Sep 05 06:52:04.511493 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.511449    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b35930beb4e557220e08ef2697d80fe54bf83dfee90e513842a2a32c63cf7ab"} err="failed to get container status \"1b35930beb4e557220e08ef2697d80fe54bf83dfee90e513842a2a32c63cf7ab\": rpc error: code = NotFound desc = could not find container \"1b35930beb4e557220e08ef2697d80fe54bf83dfee90e513842a2a32c63cf7ab\": container with ID starting with 1b35930beb4e557220e08ef2697d80fe54bf83dfee90e513842a2a32c63cf7ab not found: ID does not exist"
Sep 05 06:52:04.511493 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.511473    2583 scope.go:117] "RemoveContainer" containerID="c719ad1cc9b7fe344e117dcf84f1c130f7ee007c83797dc622d2eaf5f501a818"
Sep 05 06:52:04.521294 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.521279    2583 scope.go:117] "RemoveContainer" containerID="c719ad1cc9b7fe344e117dcf84f1c130f7ee007c83797dc622d2eaf5f501a818"
Sep 05 06:52:04.521559 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:52:04.521534    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c719ad1cc9b7fe344e117dcf84f1c130f7ee007c83797dc622d2eaf5f501a818\": container with ID starting with c719ad1cc9b7fe344e117dcf84f1c130f7ee007c83797dc622d2eaf5f501a818 not found: ID does not exist" containerID="c719ad1cc9b7fe344e117dcf84f1c130f7ee007c83797dc622d2eaf5f501a818"
Sep 05 06:52:04.521610 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.521568    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c719ad1cc9b7fe344e117dcf84f1c130f7ee007c83797dc622d2eaf5f501a818"} err="failed to get container status \"c719ad1cc9b7fe344e117dcf84f1c130f7ee007c83797dc622d2eaf5f501a818\": rpc error: code = NotFound desc = could not find container \"c719ad1cc9b7fe344e117dcf84f1c130f7ee007c83797dc622d2eaf5f501a818\": container with ID starting with c719ad1cc9b7fe344e117dcf84f1c130f7ee007c83797dc622d2eaf5f501a818 not found: ID does not exist"
Sep 05 06:52:04.579958 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.579932    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab13c58-4eff-4402-948d-71bf9d9dd239-plugins-config-volume\") pod \"9ab13c58-4eff-4402-948d-71bf9d9dd239\" (UID: \"9ab13c58-4eff-4402-948d-71bf9d9dd239\") "
Sep 05 06:52:04.580128 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.579966    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pttqk\" (UniqueName: \"kubernetes.io/projected/9ab13c58-4eff-4402-948d-71bf9d9dd239-kube-api-access-pttqk\") pod \"9ab13c58-4eff-4402-948d-71bf9d9dd239\" (UID: \"9ab13c58-4eff-4402-948d-71bf9d9dd239\") "
Sep 05 06:52:04.580128 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.580042    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb352efd-35ec-4cb9-9043-89df49c03a2a-plugins-config-volume\") pod \"cb352efd-35ec-4cb9-9043-89df49c03a2a\" (UID: \"cb352efd-35ec-4cb9-9043-89df49c03a2a\") "
Sep 05 06:52:04.580128 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.580064    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfrn8\" (UniqueName: \"kubernetes.io/projected/cb352efd-35ec-4cb9-9043-89df49c03a2a-kube-api-access-sfrn8\") pod \"cb352efd-35ec-4cb9-9043-89df49c03a2a\" (UID: \"cb352efd-35ec-4cb9-9043-89df49c03a2a\") "
Sep 05 06:52:04.580408 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.580376    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab13c58-4eff-4402-948d-71bf9d9dd239-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ab13c58-4eff-4402-948d-71bf9d9dd239" (UID: "9ab13c58-4eff-4402-948d-71bf9d9dd239"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:52:04.580476 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.580391    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb352efd-35ec-4cb9-9043-89df49c03a2a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cb352efd-35ec-4cb9-9043-89df49c03a2a" (UID: "cb352efd-35ec-4cb9-9043-89df49c03a2a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:52:04.582150 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.582126    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb352efd-35ec-4cb9-9043-89df49c03a2a-kube-api-access-sfrn8" (OuterVolumeSpecName: "kube-api-access-sfrn8") pod "cb352efd-35ec-4cb9-9043-89df49c03a2a" (UID: "cb352efd-35ec-4cb9-9043-89df49c03a2a"). InnerVolumeSpecName "kube-api-access-sfrn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:04.582234 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.582177    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab13c58-4eff-4402-948d-71bf9d9dd239-kube-api-access-pttqk" (OuterVolumeSpecName: "kube-api-access-pttqk") pod "9ab13c58-4eff-4402-948d-71bf9d9dd239" (UID: "9ab13c58-4eff-4402-948d-71bf9d9dd239"). InnerVolumeSpecName "kube-api-access-pttqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:04.681151 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.681071    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb352efd-35ec-4cb9-9043-89df49c03a2a-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:04.681151 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.681098    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfrn8\" (UniqueName: \"kubernetes.io/projected/cb352efd-35ec-4cb9-9043-89df49c03a2a-kube-api-access-sfrn8\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:04.681151 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.681108    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab13c58-4eff-4402-948d-71bf9d9dd239-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:04.681151 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.681117    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pttqk\" (UniqueName: \"kubernetes.io/projected/9ab13c58-4eff-4402-948d-71bf9d9dd239-kube-api-access-pttqk\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:04.782259 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.782219    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:04.829487 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.829457    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"]
Sep 05 06:52:04.831159 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.831133    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b"]
Sep 05 06:52:04.842842 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.842817    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"]
Sep 05 06:52:04.846200 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.846176    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx"]
Sep 05 06:52:04.914084 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.914056    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960e3d2b-5b9e-4c21-ac01-e82b203117bd" path="/var/lib/kubelet/pods/960e3d2b-5b9e-4c21-ac01-e82b203117bd/volumes"
Sep 05 06:52:04.914409 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.914396    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ab13c58-4eff-4402-948d-71bf9d9dd239" path="/var/lib/kubelet/pods/9ab13c58-4eff-4402-948d-71bf9d9dd239/volumes"
Sep 05 06:52:04.914699 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:04.914688    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb352efd-35ec-4cb9-9043-89df49c03a2a" path="/var/lib/kubelet/pods/cb352efd-35ec-4cb9-9043-89df49c03a2a/volumes"
Sep 05 06:52:08.456428 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:08.456386    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:52:11.297983 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.297947    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:11.398882 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.398824    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:11.563911 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.563789    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:11.931126 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.931044    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn"]
Sep 05 06:52:11.931436 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.931422    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab13c58-4eff-4402-948d-71bf9d9dd239" containerName="payload-processing"
Sep 05 06:52:11.931482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.931437    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab13c58-4eff-4402-948d-71bf9d9dd239" containerName="payload-processing"
Sep 05 06:52:11.931482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.931451    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb352efd-35ec-4cb9-9043-89df49c03a2a" containerName="payload-pre-processing"
Sep 05 06:52:11.931482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.931457    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb352efd-35ec-4cb9-9043-89df49c03a2a" containerName="payload-pre-processing"
Sep 05 06:52:11.931482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.931464    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960e3d2b-5b9e-4c21-ac01-e82b203117bd" containerName="revoke-keys"
Sep 05 06:52:11.931482 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.931470    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="960e3d2b-5b9e-4c21-ac01-e82b203117bd" containerName="revoke-keys"
Sep 05 06:52:11.931660 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.931520    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="960e3d2b-5b9e-4c21-ac01-e82b203117bd" containerName="revoke-keys"
Sep 05 06:52:11.931660 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.931529    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb352efd-35ec-4cb9-9043-89df49c03a2a" containerName="payload-pre-processing"
Sep 05 06:52:11.931660 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.931535    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ab13c58-4eff-4402-948d-71bf9d9dd239" containerName="payload-processing"
Sep 05 06:52:11.935699 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.935680    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn"
Sep 05 06:52:11.938211 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.938182    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:52:11.938353 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.938258    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:52:11.950446 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:11.950417    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn"]
Sep 05 06:52:12.036922 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:12.036853    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:12.053126 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:12.053095    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3785d2a5-0cc1-4d7e-9b2a-095d1c99934a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn\" (UID: \"3785d2a5-0cc1-4d7e-9b2a-095d1c99934a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn"
Sep 05 06:52:12.154211 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:12.154177    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3785d2a5-0cc1-4d7e-9b2a-095d1c99934a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn\" (UID: \"3785d2a5-0cc1-4d7e-9b2a-095d1c99934a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn"
Sep 05 06:52:12.154751 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:12.154733    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3785d2a5-0cc1-4d7e-9b2a-095d1c99934a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn\" (UID: \"3785d2a5-0cc1-4d7e-9b2a-095d1c99934a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn"
Sep 05 06:52:12.255606 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:12.255571    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn"
Sep 05 06:52:12.355501 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:12.355375    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"]
Sep 05 06:52:12.379494 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:12.379457    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:12.530903 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:12.530853    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn"]
Sep 05 06:52:12.533111 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:52:12.533080    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3785d2a5_0cc1_4d7e_9b2a_095d1c99934a.slice/crio-40ebbe1e66858f6777e301fb16614b0c12837828a14f2a01c72f8e2042722dcb WatchSource:0}: Error finding container 40ebbe1e66858f6777e301fb16614b0c12837828a14f2a01c72f8e2042722dcb: Status 404 returned error can't find the container with id 40ebbe1e66858f6777e301fb16614b0c12837828a14f2a01c72f8e2042722dcb
Sep 05 06:52:12.547938 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:12.547903    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn" event={"ID":"3785d2a5-0cc1-4d7e-9b2a-095d1c99934a","Type":"ContainerStarted","Data":"40ebbe1e66858f6777e301fb16614b0c12837828a14f2a01c72f8e2042722dcb"}
Sep 05 06:52:13.367600 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:13.367570    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:13.554682 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:13.554597    2583 generic.go:356] "Generic (PLEG): container finished" podID="3785d2a5-0cc1-4d7e-9b2a-095d1c99934a" containerID="6a8310e0f169fe4efccd7307b534f3e749eb28d0284059a7187a001766b82c91" exitCode=0
Sep 05 06:52:13.554682 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:13.554648    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn" event={"ID":"3785d2a5-0cc1-4d7e-9b2a-095d1c99934a","Type":"ContainerDied","Data":"6a8310e0f169fe4efccd7307b534f3e749eb28d0284059a7187a001766b82c91"}
Sep 05 06:52:13.822167 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:13.822091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:14.127737 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.127654    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"]
Sep 05 06:52:14.131209 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.131178    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.133886 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.133844    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-73a747-openshift-default-dockercfg-z5sfm\""
Sep 05 06:52:14.134004 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.133843    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 05 06:52:14.145449 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.145429    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"]
Sep 05 06:52:14.147820 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.147798    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:14.270005 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.269969    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-workload-certs\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.270153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.270021    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-envoy\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.270153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.270045    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istiod-ca-cert\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.270153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.270087    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-credential-socket\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.270153 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.270106    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-workload-socket\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.270307 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.270151    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-token\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.270307 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.270174    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thfgd\" (UniqueName: \"kubernetes.io/projected/5588484a-cf02-4330-9efb-93dbc8ad3e7d-kube-api-access-thfgd\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.270307 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.270192    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-podinfo\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.270307 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.270262    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-data\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.323722 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.323692    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:14.371220 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.371176    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-data\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.371697 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.371228    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-workload-certs\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.371697 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.371261    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-envoy\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.371697 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.371276    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istiod-ca-cert\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.371697 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.371295    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-credential-socket\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.371697 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.371313    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-workload-socket\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.371697 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.371343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-token\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.371697 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.371370    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thfgd\" (UniqueName: \"kubernetes.io/projected/5588484a-cf02-4330-9efb-93dbc8ad3e7d-kube-api-access-thfgd\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.371697 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.371400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-podinfo\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.371697 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.371650    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-data\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.371697 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.371664    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-workload-certs\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.372341 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.371780    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-credential-socket\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.372341 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.372014    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-workload-socket\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.372341 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.372274    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istiod-ca-cert\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.374150 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.374132    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-envoy\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.374456 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.374436    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-podinfo\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.390630 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.390565    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thfgd\" (UniqueName: \"kubernetes.io/projected/5588484a-cf02-4330-9efb-93dbc8ad3e7d-kube-api-access-thfgd\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.392440 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.392417    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-token\") pod \"e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") " pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.441680 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.441648    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:14.442594 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.442570    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:14.688829 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.688799    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn"
Sep 05 06:52:14.722496 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.722466    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"]
Sep 05 06:52:14.724332 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:52:14.724302    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5588484a_cf02_4330_9efb_93dbc8ad3e7d.slice/crio-0d890217e82f8525982432d8bc3c0dea9b9bf364dc86207314379e9abc1ed3e5 WatchSource:0}: Error finding container 0d890217e82f8525982432d8bc3c0dea9b9bf364dc86207314379e9abc1ed3e5: Status 404 returned error can't find the container with id 0d890217e82f8525982432d8bc3c0dea9b9bf364dc86207314379e9abc1ed3e5
Sep 05 06:52:14.775079 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.775049    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3785d2a5-0cc1-4d7e-9b2a-095d1c99934a-maas-api-service-ca\") pod \"3785d2a5-0cc1-4d7e-9b2a-095d1c99934a\" (UID: \"3785d2a5-0cc1-4d7e-9b2a-095d1c99934a\") "
Sep 05 06:52:14.775375 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.775353    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3785d2a5-0cc1-4d7e-9b2a-095d1c99934a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3785d2a5-0cc1-4d7e-9b2a-095d1c99934a" (UID: "3785d2a5-0cc1-4d7e-9b2a-095d1c99934a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:52:14.875574 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:14.875544    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3785d2a5-0cc1-4d7e-9b2a-095d1c99934a-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:15.565723 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:15.565694    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn"
Sep 05 06:52:15.566219 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:15.565734    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn" event={"ID":"3785d2a5-0cc1-4d7e-9b2a-095d1c99934a","Type":"ContainerDied","Data":"40ebbe1e66858f6777e301fb16614b0c12837828a14f2a01c72f8e2042722dcb"}
Sep 05 06:52:15.566219 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:15.565781    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40ebbe1e66858f6777e301fb16614b0c12837828a14f2a01c72f8e2042722dcb"
Sep 05 06:52:15.567084 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:15.567060    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" event={"ID":"5588484a-cf02-4330-9efb-93dbc8ad3e7d","Type":"ContainerStarted","Data":"0d890217e82f8525982432d8bc3c0dea9b9bf364dc86207314379e9abc1ed3e5"}
Sep 05 06:52:17.611823 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:17.611780    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 05 06:52:17.612145 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:17.611872    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 05 06:52:17.612145 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:17.611909    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 05 06:52:18.585026 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:18.584991    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" event={"ID":"5588484a-cf02-4330-9efb-93dbc8ad3e7d","Type":"ContainerStarted","Data":"a442bfeb27a5e98b591306d7742dd72dfa2d44aa6aff5871af4b5d6603fb7394"}
Sep 05 06:52:18.605301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:18.605254    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" podStartSLOduration=1.7203572029999998 podStartE2EDuration="4.605238565s" totalImagesPullingTime="2.884881362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:52:18.604198467 +0000 UTC m=+1636.208747307" watchObservedRunningTime="2026-09-05 06:52:18.605238565 +0000 UTC m=+1636.209787403"
Sep 05 06:52:19.443528 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:19.443490    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:19.448541 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:19.448513    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:19.591133 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:19.591100    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:19.592208 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:19.592186    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:20.542484 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:20.542451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:20.642470 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:20.642440    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:21.703733 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:21.703700    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:21.804379 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:21.804342    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:22.130654 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.130570    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:22.234314 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.234283    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:22.304090 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.304055    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:22.305735 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.305711    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"]
Sep 05 06:52:22.306179 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.306154    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3785d2a5-0cc1-4d7e-9b2a-095d1c99934a" containerName="revoke-keys"
Sep 05 06:52:22.306179 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.306181    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3785d2a5-0cc1-4d7e-9b2a-095d1c99934a" containerName="revoke-keys"
Sep 05 06:52:22.306304 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.306245    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3785d2a5-0cc1-4d7e-9b2a-095d1c99934a" containerName="revoke-keys"
Sep 05 06:52:22.308886 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.308845    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"
Sep 05 06:52:22.311316 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.311297    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-73a747\""
Sep 05 06:52:22.321491 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.320682    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"]
Sep 05 06:52:22.334936 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.334907    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sn6n\" (UniqueName: \"kubernetes.io/projected/2b783371-17b9-4916-8e5c-d756532d9234-kube-api-access-6sn6n\") pod \"payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2\" (UID: \"2b783371-17b9-4916-8e5c-d756532d9234\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"
Sep 05 06:52:22.335052 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.335006    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b783371-17b9-4916-8e5c-d756532d9234-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2\" (UID: \"2b783371-17b9-4916-8e5c-d756532d9234\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"
Sep 05 06:52:22.348721 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.348695    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"]
Sep 05 06:52:22.352176 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.352159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"
Sep 05 06:52:22.354736 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.354710    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-73a747-dockercfg-rn9jp\""
Sep 05 06:52:22.359410 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.359385    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"]
Sep 05 06:52:22.435956 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.435880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f42fc9d-b853-4b9d-aea9-933220a4bb3a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc\" (UID: \"9f42fc9d-b853-4b9d-aea9-933220a4bb3a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"
Sep 05 06:52:22.435956 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.435921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7bbc\" (UniqueName: \"kubernetes.io/projected/9f42fc9d-b853-4b9d-aea9-933220a4bb3a-kube-api-access-j7bbc\") pod \"payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc\" (UID: \"9f42fc9d-b853-4b9d-aea9-933220a4bb3a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"
Sep 05 06:52:22.436171 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.435958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b783371-17b9-4916-8e5c-d756532d9234-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2\" (UID: \"2b783371-17b9-4916-8e5c-d756532d9234\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"
Sep 05 06:52:22.436171 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.436090    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sn6n\" (UniqueName: \"kubernetes.io/projected/2b783371-17b9-4916-8e5c-d756532d9234-kube-api-access-6sn6n\") pod \"payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2\" (UID: \"2b783371-17b9-4916-8e5c-d756532d9234\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"
Sep 05 06:52:22.436682 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.436658    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b783371-17b9-4916-8e5c-d756532d9234-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2\" (UID: \"2b783371-17b9-4916-8e5c-d756532d9234\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"
Sep 05 06:52:22.444463 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.444438    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sn6n\" (UniqueName: \"kubernetes.io/projected/2b783371-17b9-4916-8e5c-d756532d9234-kube-api-access-6sn6n\") pod \"payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2\" (UID: \"2b783371-17b9-4916-8e5c-d756532d9234\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"
Sep 05 06:52:22.519882 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.515289    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:22.537233 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.537198    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f42fc9d-b853-4b9d-aea9-933220a4bb3a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc\" (UID: \"9f42fc9d-b853-4b9d-aea9-933220a4bb3a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"
Sep 05 06:52:22.537411 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.537248    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7bbc\" (UniqueName: \"kubernetes.io/projected/9f42fc9d-b853-4b9d-aea9-933220a4bb3a-kube-api-access-j7bbc\") pod \"payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc\" (UID: \"9f42fc9d-b853-4b9d-aea9-933220a4bb3a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"
Sep 05 06:52:22.538150 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.538122    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f42fc9d-b853-4b9d-aea9-933220a4bb3a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc\" (UID: \"9f42fc9d-b853-4b9d-aea9-933220a4bb3a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"
Sep 05 06:52:22.552006 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.551976    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7bbc\" (UniqueName: \"kubernetes.io/projected/9f42fc9d-b853-4b9d-aea9-933220a4bb3a-kube-api-access-j7bbc\") pod \"payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc\" (UID: \"9f42fc9d-b853-4b9d-aea9-933220a4bb3a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"
Sep 05 06:52:22.555614 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.555583    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"]
Sep 05 06:52:22.555840 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.555812    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c" podUID="fdcb0142-d6db-4dc6-95e3-31f9d33129b9" containerName="payload-pre-processing" containerID="cri-o://991deb8da9d3e3017cfb7f8efcaad83fd98713e1581854e54e65abcc370eaf10" gracePeriod=30
Sep 05 06:52:22.584100 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.584076    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:22.622140 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.622110    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"
Sep 05 06:52:22.663669 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.663636    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"
Sep 05 06:52:22.684256 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.684177    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:22.787651 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.787621    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:22.851405 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.851375    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn"]
Sep 05 06:52:22.852295 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.852274    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"
Sep 05 06:52:22.852457 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.852438    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:22.853226 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.853207    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-eac764-zr2kn"]
Sep 05 06:52:22.897057 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.897024    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"]
Sep 05 06:52:22.901162 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:52:22.901134    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b783371_17b9_4916_8e5c_d756532d9234.slice/crio-cc70b1b12de905e946a15eae7f62b985d2fab2e50a5421ed54c167de4fcc8903 WatchSource:0}: Error finding container cc70b1b12de905e946a15eae7f62b985d2fab2e50a5421ed54c167de4fcc8903: Status 404 returned error can't find the container with id cc70b1b12de905e946a15eae7f62b985d2fab2e50a5421ed54c167de4fcc8903
Sep 05 06:52:22.916747 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.916721    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3785d2a5-0cc1-4d7e-9b2a-095d1c99934a" path="/var/lib/kubelet/pods/3785d2a5-0cc1-4d7e-9b2a-095d1c99934a/volumes"
Sep 05 06:52:22.941256 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.941234    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8dj4\" (UniqueName: \"kubernetes.io/projected/fdcb0142-d6db-4dc6-95e3-31f9d33129b9-kube-api-access-n8dj4\") pod \"fdcb0142-d6db-4dc6-95e3-31f9d33129b9\" (UID: \"fdcb0142-d6db-4dc6-95e3-31f9d33129b9\") "
Sep 05 06:52:22.941421 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.941405    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdcb0142-d6db-4dc6-95e3-31f9d33129b9-plugins-config-volume\") pod \"fdcb0142-d6db-4dc6-95e3-31f9d33129b9\" (UID: \"fdcb0142-d6db-4dc6-95e3-31f9d33129b9\") "
Sep 05 06:52:22.941796 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.941760    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdcb0142-d6db-4dc6-95e3-31f9d33129b9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fdcb0142-d6db-4dc6-95e3-31f9d33129b9" (UID: "fdcb0142-d6db-4dc6-95e3-31f9d33129b9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:52:22.943368 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.943339    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdcb0142-d6db-4dc6-95e3-31f9d33129b9-kube-api-access-n8dj4" (OuterVolumeSpecName: "kube-api-access-n8dj4") pod "fdcb0142-d6db-4dc6-95e3-31f9d33129b9" (UID: "fdcb0142-d6db-4dc6-95e3-31f9d33129b9"). InnerVolumeSpecName "kube-api-access-n8dj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:22.961988 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:22.961960    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"]
Sep 05 06:52:22.962140 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:52:22.962118    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f42fc9d_b853_4b9d_aea9_933220a4bb3a.slice/crio-b56e20a492d1806219b511c161bac4783e32adefa09d056ae938294f261324fd WatchSource:0}: Error finding container b56e20a492d1806219b511c161bac4783e32adefa09d056ae938294f261324fd: Status 404 returned error can't find the container with id b56e20a492d1806219b511c161bac4783e32adefa09d056ae938294f261324fd
Sep 05 06:52:23.042189 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.042161    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8dj4\" (UniqueName: \"kubernetes.io/projected/fdcb0142-d6db-4dc6-95e3-31f9d33129b9-kube-api-access-n8dj4\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:23.042296 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.042194    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdcb0142-d6db-4dc6-95e3-31f9d33129b9-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:23.239158 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.239129    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:23.613787 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.613751    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2" event={"ID":"2b783371-17b9-4916-8e5c-d756532d9234","Type":"ContainerStarted","Data":"e573985b4cb57122327eb3e1ee3e437eaa5aa6c84c439e7d473b4b58b6095ea5"}
Sep 05 06:52:23.614007 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.613811    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2" event={"ID":"2b783371-17b9-4916-8e5c-d756532d9234","Type":"ContainerStarted","Data":"cc70b1b12de905e946a15eae7f62b985d2fab2e50a5421ed54c167de4fcc8903"}
Sep 05 06:52:23.614007 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.613951    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"
Sep 05 06:52:23.615444 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.615418    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc" event={"ID":"9f42fc9d-b853-4b9d-aea9-933220a4bb3a","Type":"ContainerStarted","Data":"82b935975efbfc5d90a8620a9ba6849b88ab236924a247f3aeec065f775b075c"}
Sep 05 06:52:23.615565 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.615463    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc" event={"ID":"9f42fc9d-b853-4b9d-aea9-933220a4bb3a","Type":"ContainerStarted","Data":"b56e20a492d1806219b511c161bac4783e32adefa09d056ae938294f261324fd"}
Sep 05 06:52:23.615565 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.615491    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"
Sep 05 06:52:23.616770 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.616734    2583 generic.go:356] "Generic (PLEG): container finished" podID="fdcb0142-d6db-4dc6-95e3-31f9d33129b9" containerID="991deb8da9d3e3017cfb7f8efcaad83fd98713e1581854e54e65abcc370eaf10" exitCode=0
Sep 05 06:52:23.616891 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.616766    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c" event={"ID":"fdcb0142-d6db-4dc6-95e3-31f9d33129b9","Type":"ContainerDied","Data":"991deb8da9d3e3017cfb7f8efcaad83fd98713e1581854e54e65abcc370eaf10"}
Sep 05 06:52:23.616891 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.616781    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"
Sep 05 06:52:23.616891 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.616820    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c" event={"ID":"fdcb0142-d6db-4dc6-95e3-31f9d33129b9","Type":"ContainerDied","Data":"4b1d3a3227b330baefb4241934378ebb173888d8fb88a6cef29839f9fd594972"}
Sep 05 06:52:23.616891 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.616878    2583 scope.go:117] "RemoveContainer" containerID="991deb8da9d3e3017cfb7f8efcaad83fd98713e1581854e54e65abcc370eaf10"
Sep 05 06:52:23.625610 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.625587    2583 scope.go:117] "RemoveContainer" containerID="991deb8da9d3e3017cfb7f8efcaad83fd98713e1581854e54e65abcc370eaf10"
Sep 05 06:52:23.625932 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:52:23.625902    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"991deb8da9d3e3017cfb7f8efcaad83fd98713e1581854e54e65abcc370eaf10\": container with ID starting with 991deb8da9d3e3017cfb7f8efcaad83fd98713e1581854e54e65abcc370eaf10 not found: ID does not exist" containerID="991deb8da9d3e3017cfb7f8efcaad83fd98713e1581854e54e65abcc370eaf10"
Sep 05 06:52:23.626035 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.625941    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"991deb8da9d3e3017cfb7f8efcaad83fd98713e1581854e54e65abcc370eaf10"} err="failed to get container status \"991deb8da9d3e3017cfb7f8efcaad83fd98713e1581854e54e65abcc370eaf10\": rpc error: code = NotFound desc = could not find container \"991deb8da9d3e3017cfb7f8efcaad83fd98713e1581854e54e65abcc370eaf10\": container with ID starting with 991deb8da9d3e3017cfb7f8efcaad83fd98713e1581854e54e65abcc370eaf10 not found: ID does not exist"
Sep 05 06:52:23.632818 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.632775    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2" podStartSLOduration=1.632756846 podStartE2EDuration="1.632756846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:52:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:52:23.630061805 +0000 UTC m=+1641.234610645" watchObservedRunningTime="2026-09-05 06:52:23.632756846 +0000 UTC m=+1641.237305686"
Sep 05 06:52:23.645604 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.645566    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc" podStartSLOduration=1.645554181 podStartE2EDuration="1.645554181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:52:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:52:23.644570965 +0000 UTC m=+1641.249119803" watchObservedRunningTime="2026-09-05 06:52:23.645554181 +0000 UTC m=+1641.250103018"
Sep 05 06:52:23.659766 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.659743    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"]
Sep 05 06:52:23.666595 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:23.666575    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c"]
Sep 05 06:52:24.915069 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:24.915033    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdcb0142-d6db-4dc6-95e3-31f9d33129b9" path="/var/lib/kubelet/pods/fdcb0142-d6db-4dc6-95e3-31f9d33129b9/volumes"
Sep 05 06:52:26.555958 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:26.555923    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:52:27.380957 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.380915    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz" podUID="612d9e0c-699b-461e-929e-b183a177dd85" containerName="main" containerID="cri-o://052d3aff166f4c114437afbf8629f28c01c6d95c35b728ecdba9e96de2b380c1" gracePeriod=45
Sep 05 06:52:27.640192 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.640118    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:52:27.640796 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.640767    2583 generic.go:356] "Generic (PLEG): container finished" podID="612d9e0c-699b-461e-929e-b183a177dd85" containerID="052d3aff166f4c114437afbf8629f28c01c6d95c35b728ecdba9e96de2b380c1" exitCode=0
Sep 05 06:52:27.640933 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.640855    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz" event={"ID":"612d9e0c-699b-461e-929e-b183a177dd85","Type":"ContainerDied","Data":"052d3aff166f4c114437afbf8629f28c01c6d95c35b728ecdba9e96de2b380c1"}
Sep 05 06:52:27.640933 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.640926    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz" event={"ID":"612d9e0c-699b-461e-929e-b183a177dd85","Type":"ContainerDied","Data":"ea71ad8895e654b4ae4fb035b442f263755ca180ad30ebb64cfc76d1c98e384c"}
Sep 05 06:52:27.641039 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.640951    2583 scope.go:117] "RemoveContainer" containerID="052d3aff166f4c114437afbf8629f28c01c6d95c35b728ecdba9e96de2b380c1"
Sep 05 06:52:27.649371 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.649348    2583 scope.go:117] "RemoveContainer" containerID="052d3aff166f4c114437afbf8629f28c01c6d95c35b728ecdba9e96de2b380c1"
Sep 05 06:52:27.649654 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:52:27.649635    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"052d3aff166f4c114437afbf8629f28c01c6d95c35b728ecdba9e96de2b380c1\": container with ID starting with 052d3aff166f4c114437afbf8629f28c01c6d95c35b728ecdba9e96de2b380c1 not found: ID does not exist" containerID="052d3aff166f4c114437afbf8629f28c01c6d95c35b728ecdba9e96de2b380c1"
Sep 05 06:52:27.649710 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.649663    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"052d3aff166f4c114437afbf8629f28c01c6d95c35b728ecdba9e96de2b380c1"} err="failed to get container status \"052d3aff166f4c114437afbf8629f28c01c6d95c35b728ecdba9e96de2b380c1\": rpc error: code = NotFound desc = could not find container \"052d3aff166f4c114437afbf8629f28c01c6d95c35b728ecdba9e96de2b380c1\": container with ID starting with 052d3aff166f4c114437afbf8629f28c01c6d95c35b728ecdba9e96de2b380c1 not found: ID does not exist"
Sep 05 06:52:27.679978 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.679950    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-home\") pod \"612d9e0c-699b-461e-929e-b183a177dd85\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") "
Sep 05 06:52:27.680145 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.680017    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v58nf\" (UniqueName: \"kubernetes.io/projected/612d9e0c-699b-461e-929e-b183a177dd85-kube-api-access-v58nf\") pod \"612d9e0c-699b-461e-929e-b183a177dd85\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") "
Sep 05 06:52:27.680145 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.680036    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-tmp-dir\") pod \"612d9e0c-699b-461e-929e-b183a177dd85\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") "
Sep 05 06:52:27.680145 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.680068    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-dshm\") pod \"612d9e0c-699b-461e-929e-b183a177dd85\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") "
Sep 05 06:52:27.680145 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.680084    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-model-cache\") pod \"612d9e0c-699b-461e-929e-b183a177dd85\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") "
Sep 05 06:52:27.680339 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.680150    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/612d9e0c-699b-461e-929e-b183a177dd85-tls-certs\") pod \"612d9e0c-699b-461e-929e-b183a177dd85\" (UID: \"612d9e0c-699b-461e-929e-b183a177dd85\") "
Sep 05 06:52:27.680339 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.680235    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-home" (OuterVolumeSpecName: "home") pod "612d9e0c-699b-461e-929e-b183a177dd85" (UID: "612d9e0c-699b-461e-929e-b183a177dd85"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:27.680339 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.680303    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "612d9e0c-699b-461e-929e-b183a177dd85" (UID: "612d9e0c-699b-461e-929e-b183a177dd85"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:27.680452 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.680392    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-model-cache" (OuterVolumeSpecName: "model-cache") pod "612d9e0c-699b-461e-929e-b183a177dd85" (UID: "612d9e0c-699b-461e-929e-b183a177dd85"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:27.680497 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.680449    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:27.680497 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.680467    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:27.682310 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.682288    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-dshm" (OuterVolumeSpecName: "dshm") pod "612d9e0c-699b-461e-929e-b183a177dd85" (UID: "612d9e0c-699b-461e-929e-b183a177dd85"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:27.682414 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.682307    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/612d9e0c-699b-461e-929e-b183a177dd85-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "612d9e0c-699b-461e-929e-b183a177dd85" (UID: "612d9e0c-699b-461e-929e-b183a177dd85"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:52:27.682414 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.682325    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/612d9e0c-699b-461e-929e-b183a177dd85-kube-api-access-v58nf" (OuterVolumeSpecName: "kube-api-access-v58nf") pod "612d9e0c-699b-461e-929e-b183a177dd85" (UID: "612d9e0c-699b-461e-929e-b183a177dd85"). InnerVolumeSpecName "kube-api-access-v58nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:27.781610 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.781574    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v58nf\" (UniqueName: \"kubernetes.io/projected/612d9e0c-699b-461e-929e-b183a177dd85-kube-api-access-v58nf\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:27.781610 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.781608    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:27.781610 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.781619    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/612d9e0c-699b-461e-929e-b183a177dd85-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:27.781845 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:27.781628    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/612d9e0c-699b-461e-929e-b183a177dd85-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:28.647772 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:28.647744    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"
Sep 05 06:52:28.669795 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:28.669764    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"]
Sep 05 06:52:28.673807 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:28.673777    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ef54fd/rate-test-model-ef54fd-kserve-7d7944474c-ddhmz"]
Sep 05 06:52:28.914997 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:28.914910    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="612d9e0c-699b-461e-929e-b183a177dd85" path="/var/lib/kubelet/pods/612d9e0c-699b-461e-929e-b183a177dd85/volumes"
Sep 05 06:52:29.529542 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:29.529509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:29.630650 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:29.630603    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:29.816642 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:29.816525    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:30.293760 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:30.293731    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:31.388775 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:31.388742    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:34.625708 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:34.625670    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"
Sep 05 06:52:34.626087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:34.625764    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"
Sep 05 06:52:35.633042 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:35.632999    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 05 06:52:35.633532 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:35.633080    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 05 06:52:37.699858 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:37.699825    2583 generic.go:356] "Generic (PLEG): container finished" podID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerID="a442bfeb27a5e98b591306d7742dd72dfa2d44aa6aff5871af4b5d6603fb7394" exitCode=0
Sep 05 06:52:37.700303 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:37.699899    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" event={"ID":"5588484a-cf02-4330-9efb-93dbc8ad3e7d","Type":"ContainerDied","Data":"a442bfeb27a5e98b591306d7742dd72dfa2d44aa6aff5871af4b5d6603fb7394"}
Sep 05 06:52:37.700347 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:37.700335    2583 scope.go:117] "RemoveContainer" containerID="a442bfeb27a5e98b591306d7742dd72dfa2d44aa6aff5871af4b5d6603fb7394"
Sep 05 06:52:37.701408 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:37.701378    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 05 06:52:37.701473 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:37.701446    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 05 06:52:37.701510 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:37.701478    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 05 06:52:38.715163 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:38.715110    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" event={"ID":"5588484a-cf02-4330-9efb-93dbc8ad3e7d","Type":"ContainerStarted","Data":"7333b17d0c4f12398f2f3a79b9fba808a95834f9dda9e1174877d1d2244c9599"}
Sep 05 06:52:39.443701 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:39.443659    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:39.443946 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:39.443912    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 05 06:52:39.444042 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:39.443977    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 05 06:52:40.443496 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:40.443452    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 05 06:52:40.443996 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:40.443520    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 05 06:52:40.678929 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:40.678876    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:40.736751 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:40.736718    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"]
Sep 05 06:52:40.736953 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:40.736928    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f" podUID="5c90f226-2248-416e-8bd1-a6d1c41629a0" containerName="payload-processing" containerID="cri-o://b38af6dc6dfed10b2876e09e4664a0abdc59061159f14a787e2f3412a5bdd970" gracePeriod=30
Sep 05 06:52:40.761388 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:40.761356    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"]
Sep 05 06:52:40.761660 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:40.761614    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk" podUID="48e8a0c6-a5df-4435-8b19-f8a79f86981a" containerName="payload-pre-processing" containerID="cri-o://190dcd67fb883373d22ad5bb44dab6cb08e971ba49546da29c5508ab0044d28d" gracePeriod=30
Sep 05 06:52:41.072096 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.072074    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"
Sep 05 06:52:41.135231 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.135201    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"
Sep 05 06:52:41.227759 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.227721    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c90f226-2248-416e-8bd1-a6d1c41629a0-plugins-config-volume\") pod \"5c90f226-2248-416e-8bd1-a6d1c41629a0\" (UID: \"5c90f226-2248-416e-8bd1-a6d1c41629a0\") "
Sep 05 06:52:41.227968 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.227788    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pcdw\" (UniqueName: \"kubernetes.io/projected/48e8a0c6-a5df-4435-8b19-f8a79f86981a-kube-api-access-9pcdw\") pod \"48e8a0c6-a5df-4435-8b19-f8a79f86981a\" (UID: \"48e8a0c6-a5df-4435-8b19-f8a79f86981a\") "
Sep 05 06:52:41.227968 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.227904    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e8a0c6-a5df-4435-8b19-f8a79f86981a-plugins-config-volume\") pod \"48e8a0c6-a5df-4435-8b19-f8a79f86981a\" (UID: \"48e8a0c6-a5df-4435-8b19-f8a79f86981a\") "
Sep 05 06:52:41.227968 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.227920    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd47x\" (UniqueName: \"kubernetes.io/projected/5c90f226-2248-416e-8bd1-a6d1c41629a0-kube-api-access-bd47x\") pod \"5c90f226-2248-416e-8bd1-a6d1c41629a0\" (UID: \"5c90f226-2248-416e-8bd1-a6d1c41629a0\") "
Sep 05 06:52:41.228174 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.228135    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c90f226-2248-416e-8bd1-a6d1c41629a0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5c90f226-2248-416e-8bd1-a6d1c41629a0" (UID: "5c90f226-2248-416e-8bd1-a6d1c41629a0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:52:41.228306 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.228207    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48e8a0c6-a5df-4435-8b19-f8a79f86981a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48e8a0c6-a5df-4435-8b19-f8a79f86981a" (UID: "48e8a0c6-a5df-4435-8b19-f8a79f86981a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:52:41.229948 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.229926    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c90f226-2248-416e-8bd1-a6d1c41629a0-kube-api-access-bd47x" (OuterVolumeSpecName: "kube-api-access-bd47x") pod "5c90f226-2248-416e-8bd1-a6d1c41629a0" (UID: "5c90f226-2248-416e-8bd1-a6d1c41629a0"). InnerVolumeSpecName "kube-api-access-bd47x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:41.230033 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.229957    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e8a0c6-a5df-4435-8b19-f8a79f86981a-kube-api-access-9pcdw" (OuterVolumeSpecName: "kube-api-access-9pcdw") pod "48e8a0c6-a5df-4435-8b19-f8a79f86981a" (UID: "48e8a0c6-a5df-4435-8b19-f8a79f86981a"). InnerVolumeSpecName "kube-api-access-9pcdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:41.329044 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.328966    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e8a0c6-a5df-4435-8b19-f8a79f86981a-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:41.329044 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.328992    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd47x\" (UniqueName: \"kubernetes.io/projected/5c90f226-2248-416e-8bd1-a6d1c41629a0-kube-api-access-bd47x\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:41.329044 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.329003    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c90f226-2248-416e-8bd1-a6d1c41629a0-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:41.329044 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.329013    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pcdw\" (UniqueName: \"kubernetes.io/projected/48e8a0c6-a5df-4435-8b19-f8a79f86981a-kube-api-access-9pcdw\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:52:41.443820 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.443779    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 05 06:52:41.444248 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.443856    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 05 06:52:41.737537 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.737494    2583 generic.go:356] "Generic (PLEG): container finished" podID="48e8a0c6-a5df-4435-8b19-f8a79f86981a" containerID="190dcd67fb883373d22ad5bb44dab6cb08e971ba49546da29c5508ab0044d28d" exitCode=0
Sep 05 06:52:41.737537 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.737535    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"
Sep 05 06:52:41.737786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.737572    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk" event={"ID":"48e8a0c6-a5df-4435-8b19-f8a79f86981a","Type":"ContainerDied","Data":"190dcd67fb883373d22ad5bb44dab6cb08e971ba49546da29c5508ab0044d28d"}
Sep 05 06:52:41.737786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.737622    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk" event={"ID":"48e8a0c6-a5df-4435-8b19-f8a79f86981a","Type":"ContainerDied","Data":"56b8535871fd768b51cf225acb92cea9ddadeb1188429bf59029b298bc3eba6e"}
Sep 05 06:52:41.737786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.737654    2583 scope.go:117] "RemoveContainer" containerID="190dcd67fb883373d22ad5bb44dab6cb08e971ba49546da29c5508ab0044d28d"
Sep 05 06:52:41.739098 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.739079    2583 generic.go:356] "Generic (PLEG): container finished" podID="5c90f226-2248-416e-8bd1-a6d1c41629a0" containerID="b38af6dc6dfed10b2876e09e4664a0abdc59061159f14a787e2f3412a5bdd970" exitCode=0
Sep 05 06:52:41.739197 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.739136    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"
Sep 05 06:52:41.739197 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.739152    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f" event={"ID":"5c90f226-2248-416e-8bd1-a6d1c41629a0","Type":"ContainerDied","Data":"b38af6dc6dfed10b2876e09e4664a0abdc59061159f14a787e2f3412a5bdd970"}
Sep 05 06:52:41.739279 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.739207    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f" event={"ID":"5c90f226-2248-416e-8bd1-a6d1c41629a0","Type":"ContainerDied","Data":"1d8e3a42fa7386b4bb1b943f8421a5be52010e47126f71867b88a201cfa98350"}
Sep 05 06:52:41.747709 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.747680    2583 scope.go:117] "RemoveContainer" containerID="190dcd67fb883373d22ad5bb44dab6cb08e971ba49546da29c5508ab0044d28d"
Sep 05 06:52:41.748010 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:52:41.747989    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"190dcd67fb883373d22ad5bb44dab6cb08e971ba49546da29c5508ab0044d28d\": container with ID starting with 190dcd67fb883373d22ad5bb44dab6cb08e971ba49546da29c5508ab0044d28d not found: ID does not exist" containerID="190dcd67fb883373d22ad5bb44dab6cb08e971ba49546da29c5508ab0044d28d"
Sep 05 06:52:41.748087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.748017    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"190dcd67fb883373d22ad5bb44dab6cb08e971ba49546da29c5508ab0044d28d"} err="failed to get container status \"190dcd67fb883373d22ad5bb44dab6cb08e971ba49546da29c5508ab0044d28d\": rpc error: code = NotFound desc = could not find container \"190dcd67fb883373d22ad5bb44dab6cb08e971ba49546da29c5508ab0044d28d\": container with ID starting with 190dcd67fb883373d22ad5bb44dab6cb08e971ba49546da29c5508ab0044d28d not found: ID does not exist"
Sep 05 06:52:41.748087 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.748034    2583 scope.go:117] "RemoveContainer" containerID="b38af6dc6dfed10b2876e09e4664a0abdc59061159f14a787e2f3412a5bdd970"
Sep 05 06:52:41.762008 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.761987    2583 scope.go:117] "RemoveContainer" containerID="b38af6dc6dfed10b2876e09e4664a0abdc59061159f14a787e2f3412a5bdd970"
Sep 05 06:52:41.762343 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:52:41.762319    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b38af6dc6dfed10b2876e09e4664a0abdc59061159f14a787e2f3412a5bdd970\": container with ID starting with b38af6dc6dfed10b2876e09e4664a0abdc59061159f14a787e2f3412a5bdd970 not found: ID does not exist" containerID="b38af6dc6dfed10b2876e09e4664a0abdc59061159f14a787e2f3412a5bdd970"
Sep 05 06:52:41.762391 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.762354    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b38af6dc6dfed10b2876e09e4664a0abdc59061159f14a787e2f3412a5bdd970"} err="failed to get container status \"b38af6dc6dfed10b2876e09e4664a0abdc59061159f14a787e2f3412a5bdd970\": rpc error: code = NotFound desc = could not find container \"b38af6dc6dfed10b2876e09e4664a0abdc59061159f14a787e2f3412a5bdd970\": container with ID starting with b38af6dc6dfed10b2876e09e4664a0abdc59061159f14a787e2f3412a5bdd970 not found: ID does not exist"
Sep 05 06:52:41.762505 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.762490    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"]
Sep 05 06:52:41.777083 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.777060    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk"]
Sep 05 06:52:41.792641 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.792613    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"]
Sep 05 06:52:41.801298 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.801259    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f"]
Sep 05 06:52:41.958136 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:41.958093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:42.443963 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:42.443925    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 05 06:52:42.444375 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:42.444005    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 05 06:52:42.673543 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:42.673509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:42.919835 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:42.919799    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48e8a0c6-a5df-4435-8b19-f8a79f86981a" path="/var/lib/kubelet/pods/48e8a0c6-a5df-4435-8b19-f8a79f86981a/volumes"
Sep 05 06:52:42.920568 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:42.920547    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c90f226-2248-416e-8bd1-a6d1c41629a0" path="/var/lib/kubelet/pods/5c90f226-2248-416e-8bd1-a6d1c41629a0/volumes"
Sep 05 06:52:43.443750 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:43.443712    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 05 06:52:43.443957 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:43.443765    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 05 06:52:44.447080 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:44.447047    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:44.447571 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:44.447487    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:44.448284 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:44.448263    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:52:45.588678 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:45.588643    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:46.296317 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:46.296286    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:46.704842 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:46.704811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:46.793777 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:46.793734    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:47.453014 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:47.452975    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:52:48.994981 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:48.994942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:49.059462 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:49.059428    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:49.271333 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:49.271252    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:49.898026 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:49.897993    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:49.998880 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:49.998818    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:50.218848 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:50.218819    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:51.108165 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.108132    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:51.199546 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.199477    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:51.300647 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.300591    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:51.619291 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.619249    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:51.746520 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.746473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:52:51.747709 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.747689    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"]
Sep 05 06:52:51.748042 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.748029    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="612d9e0c-699b-461e-929e-b183a177dd85" containerName="main"
Sep 05 06:52:51.748086 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.748044    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="612d9e0c-699b-461e-929e-b183a177dd85" containerName="main"
Sep 05 06:52:51.748086 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.748060    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdcb0142-d6db-4dc6-95e3-31f9d33129b9" containerName="payload-pre-processing"
Sep 05 06:52:51.748086 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.748066    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdcb0142-d6db-4dc6-95e3-31f9d33129b9" containerName="payload-pre-processing"
Sep 05 06:52:51.748086 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.748074    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e8a0c6-a5df-4435-8b19-f8a79f86981a" containerName="payload-pre-processing"
Sep 05 06:52:51.748086 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.748079    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e8a0c6-a5df-4435-8b19-f8a79f86981a" containerName="payload-pre-processing"
Sep 05 06:52:51.748251 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.748095    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c90f226-2248-416e-8bd1-a6d1c41629a0" containerName="payload-processing"
Sep 05 06:52:51.748251 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.748100    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c90f226-2248-416e-8bd1-a6d1c41629a0" containerName="payload-processing"
Sep 05 06:52:51.748251 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.748159    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdcb0142-d6db-4dc6-95e3-31f9d33129b9" containerName="payload-pre-processing"
Sep 05 06:52:51.748251 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.748165    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c90f226-2248-416e-8bd1-a6d1c41629a0" containerName="payload-processing"
Sep 05 06:52:51.748251 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.748171    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="48e8a0c6-a5df-4435-8b19-f8a79f86981a" containerName="payload-pre-processing"
Sep 05 06:52:51.748251 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.748179    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="612d9e0c-699b-461e-929e-b183a177dd85" containerName="main"
Sep 05 06:52:51.754221 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.754201    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"
Sep 05 06:52:51.756930 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.756845    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-930288\""
Sep 05 06:52:51.756930 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.756882    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-930288-dockercfg-tp9w6\""
Sep 05 06:52:51.768648 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.768621    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"]
Sep 05 06:52:51.926962 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.926854    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26d6a6ea-9283-498d-b32d-8cc5ff84452b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf\" (UID: \"26d6a6ea-9283-498d-b32d-8cc5ff84452b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"
Sep 05 06:52:51.927118 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:51.926979    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqr2l\" (UniqueName: \"kubernetes.io/projected/26d6a6ea-9283-498d-b32d-8cc5ff84452b-kube-api-access-tqr2l\") pod \"payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf\" (UID: \"26d6a6ea-9283-498d-b32d-8cc5ff84452b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"
Sep 05 06:52:52.028209 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:52.028171    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26d6a6ea-9283-498d-b32d-8cc5ff84452b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf\" (UID: \"26d6a6ea-9283-498d-b32d-8cc5ff84452b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"
Sep 05 06:52:52.028411 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:52.028247    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqr2l\" (UniqueName: \"kubernetes.io/projected/26d6a6ea-9283-498d-b32d-8cc5ff84452b-kube-api-access-tqr2l\") pod \"payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf\" (UID: \"26d6a6ea-9283-498d-b32d-8cc5ff84452b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"
Sep 05 06:52:52.028968 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:52.028944    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26d6a6ea-9283-498d-b32d-8cc5ff84452b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf\" (UID: \"26d6a6ea-9283-498d-b32d-8cc5ff84452b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"
Sep 05 06:52:52.037071 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:52.037047    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqr2l\" (UniqueName: \"kubernetes.io/projected/26d6a6ea-9283-498d-b32d-8cc5ff84452b-kube-api-access-tqr2l\") pod \"payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf\" (UID: \"26d6a6ea-9283-498d-b32d-8cc5ff84452b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"
Sep 05 06:52:52.063963 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:52.063938    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"
Sep 05 06:52:52.335824 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:52.335796    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"]
Sep 05 06:52:52.336838 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:52:52.336813    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d6a6ea_9283_498d_b32d_8cc5ff84452b.slice/crio-ace2d70d55d14d2b9c70b349003d006d54d52393862534afe81ffe44ab2298d0 WatchSource:0}: Error finding container ace2d70d55d14d2b9c70b349003d006d54d52393862534afe81ffe44ab2298d0: Status 404 returned error can't find the container with id ace2d70d55d14d2b9c70b349003d006d54d52393862534afe81ffe44ab2298d0
Sep 05 06:52:52.808606 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:52.808564    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf" event={"ID":"26d6a6ea-9283-498d-b32d-8cc5ff84452b","Type":"ContainerStarted","Data":"0a60de558f37c5d2a8d33364f89b779610fedc19d9e4889fd955c4efaa6236a8"}
Sep 05 06:52:52.808810 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:52.808628    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf" event={"ID":"26d6a6ea-9283-498d-b32d-8cc5ff84452b","Type":"ContainerStarted","Data":"ace2d70d55d14d2b9c70b349003d006d54d52393862534afe81ffe44ab2298d0"}
Sep 05 06:52:52.808810 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:52.808673    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"
Sep 05 06:52:52.827733 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:52.827685    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf" podStartSLOduration=1.8276705720000002 podStartE2EDuration="1.827670572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:52:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:52:52.82511399 +0000 UTC m=+1670.429662867" watchObservedRunningTime="2026-09-05 06:52:52.827670572 +0000 UTC m=+1670.432219409"
Sep 05 06:52:56.561056 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:52:56.561012    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:53:03.817734 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:03.817692    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"
Sep 05 06:53:14.922544 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:14.922507    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:53:20.060605 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:20.060572    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-kxf79_05b4a34f-8094-44b3-944b-a8a95fbf7dbf/payload-processing/0.log"
Sep 05 06:53:20.183097 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:20.183068    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf_26d6a6ea-9283-498d-b32d-8cc5ff84452b/payload-processing/0.log"
Sep 05 06:53:32.637291 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:32.637207    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:53:33.330517 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:33.330485    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:53:36.646160 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:36.646121    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:53:52.550835 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:52.550795    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:53:57.975539 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:57.975504    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc_9f42fc9d-b853-4b9d-aea9-933220a4bb3a/payload-processing/0.log"
Sep 05 06:53:58.110517 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:58.110485    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-kxf79_05b4a34f-8094-44b3-944b-a8a95fbf7dbf/payload-processing/0.log"
Sep 05 06:53:58.238252 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:58.238168    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf_26d6a6ea-9283-498d-b32d-8cc5ff84452b/payload-processing/0.log"
Sep 05 06:53:58.529831 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:58.529742    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:53:58.831385 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:58.831302    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:53:59.541786 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:53:59.541758    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:02.290756 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:02.290719    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:02.378892 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:02.378834    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:03.455076 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:03.455043    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:03.555028 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:03.554994    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:03.654846 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:03.654809    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:03.951651 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:03.951623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:04.018302 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.018261    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:04.084210 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.084172    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"]
Sep 05 06:54:04.087898 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.087857    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"
Sep 05 06:54:04.090685 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.090664    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-703730\""
Sep 05 06:54:04.090821 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.090664    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-703730-dockercfg-lfdqw\""
Sep 05 06:54:04.096903 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.096877    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"]
Sep 05 06:54:04.166304 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.166265    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6fa18a9-680b-43b6-bae9-26e17a38734d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv\" (UID: \"a6fa18a9-680b-43b6-bae9-26e17a38734d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"
Sep 05 06:54:04.166506 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.166351    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d5t6\" (UniqueName: \"kubernetes.io/projected/a6fa18a9-680b-43b6-bae9-26e17a38734d-kube-api-access-2d5t6\") pod \"payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv\" (UID: \"a6fa18a9-680b-43b6-bae9-26e17a38734d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"
Sep 05 06:54:04.267448 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.267339    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6fa18a9-680b-43b6-bae9-26e17a38734d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv\" (UID: \"a6fa18a9-680b-43b6-bae9-26e17a38734d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"
Sep 05 06:54:04.267448 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.267424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5t6\" (UniqueName: \"kubernetes.io/projected/a6fa18a9-680b-43b6-bae9-26e17a38734d-kube-api-access-2d5t6\") pod \"payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv\" (UID: \"a6fa18a9-680b-43b6-bae9-26e17a38734d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"
Sep 05 06:54:04.268102 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.268080    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6fa18a9-680b-43b6-bae9-26e17a38734d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv\" (UID: \"a6fa18a9-680b-43b6-bae9-26e17a38734d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"
Sep 05 06:54:04.275071 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.275048    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d5t6\" (UniqueName: \"kubernetes.io/projected/a6fa18a9-680b-43b6-bae9-26e17a38734d-kube-api-access-2d5t6\") pod \"payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv\" (UID: \"a6fa18a9-680b-43b6-bae9-26e17a38734d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"
Sep 05 06:54:04.401641 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.401603    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"
Sep 05 06:54:04.673439 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:04.673409    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"]
Sep 05 06:54:04.675214 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:54:04.675172    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6fa18a9_680b_43b6_bae9_26e17a38734d.slice/crio-2dc7ec433ecd46c513f1370c4fcec52765a864f26f235dbd76871fccc1e28af6 WatchSource:0}: Error finding container 2dc7ec433ecd46c513f1370c4fcec52765a864f26f235dbd76871fccc1e28af6: Status 404 returned error can't find the container with id 2dc7ec433ecd46c513f1370c4fcec52765a864f26f235dbd76871fccc1e28af6
Sep 05 06:54:05.177809 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:05.177769    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv" event={"ID":"a6fa18a9-680b-43b6-bae9-26e17a38734d","Type":"ContainerStarted","Data":"785d1d22588c172eb7fe50aadf0404632ebd4dd7caa2081aa4722700b012b19c"}
Sep 05 06:54:05.177997 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:05.177833    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv" event={"ID":"a6fa18a9-680b-43b6-bae9-26e17a38734d","Type":"ContainerStarted","Data":"2dc7ec433ecd46c513f1370c4fcec52765a864f26f235dbd76871fccc1e28af6"}
Sep 05 06:54:05.177997 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:05.177877    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"
Sep 05 06:54:05.197416 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:05.197334    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv" podStartSLOduration=1.197312753 podStartE2EDuration="1.197312753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:54:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:54:05.193311006 +0000 UTC m=+1742.797859845" watchObservedRunningTime="2026-09-05 06:54:05.197312753 +0000 UTC m=+1742.801861593"
Sep 05 06:54:12.549320 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:12.549283    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:54:16.185820 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:16.185785    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"
Sep 05 06:54:27.301286 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:27.301248    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:34.129595 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.129564    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:34.161527 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.161491    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"]
Sep 05 06:54:34.161871 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.161824    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv" podUID="a6fa18a9-680b-43b6-bae9-26e17a38734d" containerName="payload-processing" containerID="cri-o://785d1d22588c172eb7fe50aadf0404632ebd4dd7caa2081aa4722700b012b19c" gracePeriod=30
Sep 05 06:54:34.230395 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.230359    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:34.327059 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.327027    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:34.329582 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.329543    2583 generic.go:356] "Generic (PLEG): container finished" podID="a6fa18a9-680b-43b6-bae9-26e17a38734d" containerID="785d1d22588c172eb7fe50aadf0404632ebd4dd7caa2081aa4722700b012b19c" exitCode=0
Sep 05 06:54:34.329718 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.329612    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv" event={"ID":"a6fa18a9-680b-43b6-bae9-26e17a38734d","Type":"ContainerDied","Data":"785d1d22588c172eb7fe50aadf0404632ebd4dd7caa2081aa4722700b012b19c"}
Sep 05 06:54:34.390159 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.390057    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:34.432048 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.432020    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"
Sep 05 06:54:34.435611 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.435592    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6fa18a9-680b-43b6-bae9-26e17a38734d-plugins-config-volume\") pod \"a6fa18a9-680b-43b6-bae9-26e17a38734d\" (UID: \"a6fa18a9-680b-43b6-bae9-26e17a38734d\") "
Sep 05 06:54:34.435702 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.435629    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d5t6\" (UniqueName: \"kubernetes.io/projected/a6fa18a9-680b-43b6-bae9-26e17a38734d-kube-api-access-2d5t6\") pod \"a6fa18a9-680b-43b6-bae9-26e17a38734d\" (UID: \"a6fa18a9-680b-43b6-bae9-26e17a38734d\") "
Sep 05 06:54:34.435979 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.435949    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6fa18a9-680b-43b6-bae9-26e17a38734d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6fa18a9-680b-43b6-bae9-26e17a38734d" (UID: "a6fa18a9-680b-43b6-bae9-26e17a38734d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:54:34.437671 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.437646    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6fa18a9-680b-43b6-bae9-26e17a38734d-kube-api-access-2d5t6" (OuterVolumeSpecName: "kube-api-access-2d5t6") pod "a6fa18a9-680b-43b6-bae9-26e17a38734d" (UID: "a6fa18a9-680b-43b6-bae9-26e17a38734d"). InnerVolumeSpecName "kube-api-access-2d5t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:54:34.536146 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.536107    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6fa18a9-680b-43b6-bae9-26e17a38734d-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:54:34.536146 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.536138    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d5t6\" (UniqueName: \"kubernetes.io/projected/a6fa18a9-680b-43b6-bae9-26e17a38734d-kube-api-access-2d5t6\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:54:34.709588 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:34.709556    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:35.336335 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:35.336307    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"
Sep 05 06:54:35.336750 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:35.336332    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv" event={"ID":"a6fa18a9-680b-43b6-bae9-26e17a38734d","Type":"ContainerDied","Data":"2dc7ec433ecd46c513f1370c4fcec52765a864f26f235dbd76871fccc1e28af6"}
Sep 05 06:54:35.336750 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:35.336397    2583 scope.go:117] "RemoveContainer" containerID="785d1d22588c172eb7fe50aadf0404632ebd4dd7caa2081aa4722700b012b19c"
Sep 05 06:54:35.353981 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:35.353958    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"]
Sep 05 06:54:35.360417 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:35.360394    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv"]
Sep 05 06:54:36.914976 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:36.914939    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6fa18a9-680b-43b6-bae9-26e17a38734d" path="/var/lib/kubelet/pods/a6fa18a9-680b-43b6-bae9-26e17a38734d/volumes"
Sep 05 06:54:39.348780 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:39.348745    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:54:40.737700 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:40.737653    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:40.812435 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:40.812346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:40.995036 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:40.995007    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:54:44.931825 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:54:44.931795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:00.266114 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.266027    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:00.294446 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.294412    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"]
Sep 05 06:55:00.298825 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.294733    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc" podUID="9f42fc9d-b853-4b9d-aea9-933220a4bb3a" containerName="payload-processing" containerID="cri-o://82b935975efbfc5d90a8620a9ba6849b88ab236924a247f3aeec065f775b075c" gracePeriod=30
Sep 05 06:55:00.299837 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.299443    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"]
Sep 05 06:55:00.299837 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.299660    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2" podUID="2b783371-17b9-4916-8e5c-d756532d9234" containerName="payload-pre-processing" containerID="cri-o://e573985b4cb57122327eb3e1ee3e437eaa5aa6c84c439e7d473b4b58b6095ea5" gracePeriod=30
Sep 05 06:55:00.345317 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.345247    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:00.406326 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.406244    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:00.468197 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.468111    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:00.473785 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.473749    2583 generic.go:356] "Generic (PLEG): container finished" podID="2b783371-17b9-4916-8e5c-d756532d9234" containerID="e573985b4cb57122327eb3e1ee3e437eaa5aa6c84c439e7d473b4b58b6095ea5" exitCode=0
Sep 05 06:55:00.473978 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.473890    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2" event={"ID":"2b783371-17b9-4916-8e5c-d756532d9234","Type":"ContainerDied","Data":"e573985b4cb57122327eb3e1ee3e437eaa5aa6c84c439e7d473b4b58b6095ea5"}
Sep 05 06:55:00.476405 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.476377    2583 generic.go:356] "Generic (PLEG): container finished" podID="9f42fc9d-b853-4b9d-aea9-933220a4bb3a" containerID="82b935975efbfc5d90a8620a9ba6849b88ab236924a247f3aeec065f775b075c" exitCode=0
Sep 05 06:55:00.476535 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.476434    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc" event={"ID":"9f42fc9d-b853-4b9d-aea9-933220a4bb3a","Type":"ContainerDied","Data":"82b935975efbfc5d90a8620a9ba6849b88ab236924a247f3aeec065f775b075c"}
Sep 05 06:55:00.553006 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.552979    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"
Sep 05 06:55:00.586874 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.586841    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"
Sep 05 06:55:00.674989 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.674953    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sn6n\" (UniqueName: \"kubernetes.io/projected/2b783371-17b9-4916-8e5c-d756532d9234-kube-api-access-6sn6n\") pod \"2b783371-17b9-4916-8e5c-d756532d9234\" (UID: \"2b783371-17b9-4916-8e5c-d756532d9234\") "
Sep 05 06:55:00.675180 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.675021    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b783371-17b9-4916-8e5c-d756532d9234-plugins-config-volume\") pod \"2b783371-17b9-4916-8e5c-d756532d9234\" (UID: \"2b783371-17b9-4916-8e5c-d756532d9234\") "
Sep 05 06:55:00.675180 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.675123    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7bbc\" (UniqueName: \"kubernetes.io/projected/9f42fc9d-b853-4b9d-aea9-933220a4bb3a-kube-api-access-j7bbc\") pod \"9f42fc9d-b853-4b9d-aea9-933220a4bb3a\" (UID: \"9f42fc9d-b853-4b9d-aea9-933220a4bb3a\") "
Sep 05 06:55:00.675293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.675189    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f42fc9d-b853-4b9d-aea9-933220a4bb3a-plugins-config-volume\") pod \"9f42fc9d-b853-4b9d-aea9-933220a4bb3a\" (UID: \"9f42fc9d-b853-4b9d-aea9-933220a4bb3a\") "
Sep 05 06:55:00.675421 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.675377    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b783371-17b9-4916-8e5c-d756532d9234-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2b783371-17b9-4916-8e5c-d756532d9234" (UID: "2b783371-17b9-4916-8e5c-d756532d9234"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:55:00.675628 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.675600    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f42fc9d-b853-4b9d-aea9-933220a4bb3a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f42fc9d-b853-4b9d-aea9-933220a4bb3a" (UID: "9f42fc9d-b853-4b9d-aea9-933220a4bb3a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:55:00.677139 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.677122    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b783371-17b9-4916-8e5c-d756532d9234-kube-api-access-6sn6n" (OuterVolumeSpecName: "kube-api-access-6sn6n") pod "2b783371-17b9-4916-8e5c-d756532d9234" (UID: "2b783371-17b9-4916-8e5c-d756532d9234"). InnerVolumeSpecName "kube-api-access-6sn6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:55:00.677204 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.677132    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f42fc9d-b853-4b9d-aea9-933220a4bb3a-kube-api-access-j7bbc" (OuterVolumeSpecName: "kube-api-access-j7bbc") pod "9f42fc9d-b853-4b9d-aea9-933220a4bb3a" (UID: "9f42fc9d-b853-4b9d-aea9-933220a4bb3a"). InnerVolumeSpecName "kube-api-access-j7bbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:55:00.760136 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.760099    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:55:00.776068 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.776030    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b783371-17b9-4916-8e5c-d756532d9234-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:00.776239 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.776075    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7bbc\" (UniqueName: \"kubernetes.io/projected/9f42fc9d-b853-4b9d-aea9-933220a4bb3a-kube-api-access-j7bbc\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:00.776239 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.776092    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f42fc9d-b853-4b9d-aea9-933220a4bb3a-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:00.776239 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.776105    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sn6n\" (UniqueName: \"kubernetes.io/projected/2b783371-17b9-4916-8e5c-d756532d9234-kube-api-access-6sn6n\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:00.824217 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:00.824135    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:01.482989 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:01.482959    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"
Sep 05 06:55:01.483399 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:01.482995    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc" event={"ID":"9f42fc9d-b853-4b9d-aea9-933220a4bb3a","Type":"ContainerDied","Data":"b56e20a492d1806219b511c161bac4783e32adefa09d056ae938294f261324fd"}
Sep 05 06:55:01.483399 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:01.483051    2583 scope.go:117] "RemoveContainer" containerID="82b935975efbfc5d90a8620a9ba6849b88ab236924a247f3aeec065f775b075c"
Sep 05 06:55:01.484561 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:01.484385    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2" event={"ID":"2b783371-17b9-4916-8e5c-d756532d9234","Type":"ContainerDied","Data":"cc70b1b12de905e946a15eae7f62b985d2fab2e50a5421ed54c167de4fcc8903"}
Sep 05 06:55:01.484561 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:01.484431    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"
Sep 05 06:55:01.492224 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:01.492200    2583 scope.go:117] "RemoveContainer" containerID="e573985b4cb57122327eb3e1ee3e437eaa5aa6c84c439e7d473b4b58b6095ea5"
Sep 05 06:55:01.501019 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:01.500992    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"]
Sep 05 06:55:01.504425 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:01.504400    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc"]
Sep 05 06:55:01.514883 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:01.514841    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"]
Sep 05 06:55:01.518159 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:01.518140    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2"]
Sep 05 06:55:02.915242 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:02.915202    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b783371-17b9-4916-8e5c-d756532d9234" path="/var/lib/kubelet/pods/2b783371-17b9-4916-8e5c-d756532d9234/volumes"
Sep 05 06:55:02.915737 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:02.915715    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f42fc9d-b853-4b9d-aea9-933220a4bb3a" path="/var/lib/kubelet/pods/9f42fc9d-b853-4b9d-aea9-933220a4bb3a/volumes"
Sep 05 06:55:03.193619 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:03.193538    2583 scope.go:117] "RemoveContainer" containerID="c7e699702f7fcb29a88828a20a6f9c0b2848dcb33804e9c32a16e4212ee72c69"
Sep 05 06:55:03.201680 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:03.201660    2583 scope.go:117] "RemoveContainer" containerID="29ad3fd427e755e9e5fd2498b6f9f87312954d97a005cbdddd28c1e411cfc7a9"
Sep 05 06:55:04.798790 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:04.798755    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:05.893359 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:05.893322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:10.353920 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:10.353883    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:55:19.739065 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:19.739033    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:34.123702 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:34.123668    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:42.844123 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:42.844094    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:43.195435 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:43.195347    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:48.759585 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:48.759549    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:48.820243 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:48.820207    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:49.025102 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.025012    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"]
Sep 05 06:55:49.025313 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.025284    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerName="istio-proxy" containerID="cri-o://7333b17d0c4f12398f2f3a79b9fba808a95834f9dda9e1174877d1d2244c9599" gracePeriod=30
Sep 05 06:55:49.049630 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.049586    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:49.419216 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.419128    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq"]
Sep 05 06:55:49.419488 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.419475    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f42fc9d-b853-4b9d-aea9-933220a4bb3a" containerName="payload-processing"
Sep 05 06:55:49.419532 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.419490    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f42fc9d-b853-4b9d-aea9-933220a4bb3a" containerName="payload-processing"
Sep 05 06:55:49.419532 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.419507    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b783371-17b9-4916-8e5c-d756532d9234" containerName="payload-pre-processing"
Sep 05 06:55:49.419532 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.419514    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b783371-17b9-4916-8e5c-d756532d9234" containerName="payload-pre-processing"
Sep 05 06:55:49.419532 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.419520    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6fa18a9-680b-43b6-bae9-26e17a38734d" containerName="payload-processing"
Sep 05 06:55:49.419532 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.419526    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6fa18a9-680b-43b6-bae9-26e17a38734d" containerName="payload-processing"
Sep 05 06:55:49.419691 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.419588    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b783371-17b9-4916-8e5c-d756532d9234" containerName="payload-pre-processing"
Sep 05 06:55:49.419691 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.419595    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f42fc9d-b853-4b9d-aea9-933220a4bb3a" containerName="payload-processing"
Sep 05 06:55:49.419691 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.419602    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6fa18a9-680b-43b6-bae9-26e17a38734d" containerName="payload-processing"
Sep 05 06:55:49.422620 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.422598    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq"
Sep 05 06:55:49.425167 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.425141    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:55:49.425295 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.425180    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:55:49.429301 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.429276    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq"]
Sep 05 06:55:49.513493 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.513453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80aa6d08-df8e-4066-ae84-d859c08170f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq\" (UID: \"80aa6d08-df8e-4066-ae84-d859c08170f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq"
Sep 05 06:55:49.587885 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.587827    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:49.614171 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.614141    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80aa6d08-df8e-4066-ae84-d859c08170f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq\" (UID: \"80aa6d08-df8e-4066-ae84-d859c08170f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq"
Sep 05 06:55:49.614854 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.614830    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80aa6d08-df8e-4066-ae84-d859c08170f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq\" (UID: \"80aa6d08-df8e-4066-ae84-d859c08170f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq"
Sep 05 06:55:49.734415 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:49.734381    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq"
Sep 05 06:55:50.003370 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:50.003341    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq"]
Sep 05 06:55:50.005935 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:55:50.005908    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80aa6d08_df8e_4066_ae84_d859c08170f2.slice/crio-75f1eb07a936414c78f68328190d65c0e697a907a92c6aec9398ede4687394a5 WatchSource:0}: Error finding container 75f1eb07a936414c78f68328190d65c0e697a907a92c6aec9398ede4687394a5: Status 404 returned error can't find the container with id 75f1eb07a936414c78f68328190d65c0e697a907a92c6aec9398ede4687394a5
Sep 05 06:55:50.735747 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:50.735715    2583 generic.go:356] "Generic (PLEG): container finished" podID="80aa6d08-df8e-4066-ae84-d859c08170f2" containerID="56dc447d6e0a65ae57bcc11650e3fa81a6595fca14daf0206f5192cbec700280" exitCode=0
Sep 05 06:55:50.736006 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:50.735808    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq" event={"ID":"80aa6d08-df8e-4066-ae84-d859c08170f2","Type":"ContainerDied","Data":"56dc447d6e0a65ae57bcc11650e3fa81a6595fca14daf0206f5192cbec700280"}
Sep 05 06:55:50.736006 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:50.735895    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq" event={"ID":"80aa6d08-df8e-4066-ae84-d859c08170f2","Type":"ContainerStarted","Data":"75f1eb07a936414c78f68328190d65c0e697a907a92c6aec9398ede4687394a5"}
Sep 05 06:55:51.868934 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:51.868906    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq"
Sep 05 06:55:52.037479 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:52.037386    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80aa6d08-df8e-4066-ae84-d859c08170f2-maas-api-service-ca\") pod \"80aa6d08-df8e-4066-ae84-d859c08170f2\" (UID: \"80aa6d08-df8e-4066-ae84-d859c08170f2\") "
Sep 05 06:55:52.037815 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:52.037789    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80aa6d08-df8e-4066-ae84-d859c08170f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "80aa6d08-df8e-4066-ae84-d859c08170f2" (UID: "80aa6d08-df8e-4066-ae84-d859c08170f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:55:52.138727 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:52.138692    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80aa6d08-df8e-4066-ae84-d859c08170f2-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:52.746487 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:52.746451    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq" event={"ID":"80aa6d08-df8e-4066-ae84-d859c08170f2","Type":"ContainerDied","Data":"75f1eb07a936414c78f68328190d65c0e697a907a92c6aec9398ede4687394a5"}
Sep 05 06:55:52.746675 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:52.746500    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75f1eb07a936414c78f68328190d65c0e697a907a92c6aec9398ede4687394a5"
Sep 05 06:55:52.746675 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:52.746467    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq"
Sep 05 06:55:54.284249 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.284190    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:55:54.457834 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.457802    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istiod-ca-cert\") pod \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") "
Sep 05 06:55:54.457834 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.457837    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-credential-socket\") pod \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") "
Sep 05 06:55:54.458106 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.457896    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-data\") pod \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") "
Sep 05 06:55:54.458106 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.457926    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-workload-socket\") pod \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") "
Sep 05 06:55:54.458106 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.457953    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-workload-certs\") pod \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") "
Sep 05 06:55:54.458106 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.457992    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-token\") pod \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") "
Sep 05 06:55:54.458106 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.458051    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thfgd\" (UniqueName: \"kubernetes.io/projected/5588484a-cf02-4330-9efb-93dbc8ad3e7d-kube-api-access-thfgd\") pod \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") "
Sep 05 06:55:54.458106 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.458101    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-envoy\") pod \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") "
Sep 05 06:55:54.458421 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.458124    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-podinfo\") pod \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\" (UID: \"5588484a-cf02-4330-9efb-93dbc8ad3e7d\") "
Sep 05 06:55:54.458421 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.458192    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5588484a-cf02-4330-9efb-93dbc8ad3e7d" (UID: "5588484a-cf02-4330-9efb-93dbc8ad3e7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:55:54.458421 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.458244    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "5588484a-cf02-4330-9efb-93dbc8ad3e7d" (UID: "5588484a-cf02-4330-9efb-93dbc8ad3e7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:55:54.458421 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.458263    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5588484a-cf02-4330-9efb-93dbc8ad3e7d" (UID: "5588484a-cf02-4330-9efb-93dbc8ad3e7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:55:54.458421 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.458276    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5588484a-cf02-4330-9efb-93dbc8ad3e7d" (UID: "5588484a-cf02-4330-9efb-93dbc8ad3e7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:55:54.458421 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.458313    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5588484a-cf02-4330-9efb-93dbc8ad3e7d" (UID: "5588484a-cf02-4330-9efb-93dbc8ad3e7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:55:54.458421 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.458414    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-workload-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:54.458705 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.458433    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istiod-ca-cert\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:54.458705 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.458445    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-credential-socket\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:54.458705 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.458457    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-data\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:54.458705 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.458471    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-workload-socket\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:54.460225 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.460201    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "5588484a-cf02-4330-9efb-93dbc8ad3e7d" (UID: "5588484a-cf02-4330-9efb-93dbc8ad3e7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:55:54.460321 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.460233    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5588484a-cf02-4330-9efb-93dbc8ad3e7d-kube-api-access-thfgd" (OuterVolumeSpecName: "kube-api-access-thfgd") pod "5588484a-cf02-4330-9efb-93dbc8ad3e7d" (UID: "5588484a-cf02-4330-9efb-93dbc8ad3e7d"). InnerVolumeSpecName "kube-api-access-thfgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:55:54.460672 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.460652    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5588484a-cf02-4330-9efb-93dbc8ad3e7d" (UID: "5588484a-cf02-4330-9efb-93dbc8ad3e7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:55:54.460774 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.460670    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5588484a-cf02-4330-9efb-93dbc8ad3e7d" (UID: "5588484a-cf02-4330-9efb-93dbc8ad3e7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:55:54.559355 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.559276    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thfgd\" (UniqueName: \"kubernetes.io/projected/5588484a-cf02-4330-9efb-93dbc8ad3e7d-kube-api-access-thfgd\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:54.559355 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.559304    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-envoy\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:54.559355 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.559313    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-podinfo\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:54.559355 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.559321    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5588484a-cf02-4330-9efb-93dbc8ad3e7d-istio-token\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:55:54.758608 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.758573    2583 generic.go:356] "Generic (PLEG): container finished" podID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerID="7333b17d0c4f12398f2f3a79b9fba808a95834f9dda9e1174877d1d2244c9599" exitCode=0
Sep 05 06:55:54.758823 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.758635    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"
Sep 05 06:55:54.758823 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.758663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" event={"ID":"5588484a-cf02-4330-9efb-93dbc8ad3e7d","Type":"ContainerDied","Data":"7333b17d0c4f12398f2f3a79b9fba808a95834f9dda9e1174877d1d2244c9599"}
Sep 05 06:55:54.758823 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.758721    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b" event={"ID":"5588484a-cf02-4330-9efb-93dbc8ad3e7d","Type":"ContainerDied","Data":"0d890217e82f8525982432d8bc3c0dea9b9bf364dc86207314379e9abc1ed3e5"}
Sep 05 06:55:54.758823 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.758744    2583 scope.go:117] "RemoveContainer" containerID="7333b17d0c4f12398f2f3a79b9fba808a95834f9dda9e1174877d1d2244c9599"
Sep 05 06:55:54.767911 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.767890    2583 scope.go:117] "RemoveContainer" containerID="a442bfeb27a5e98b591306d7742dd72dfa2d44aa6aff5871af4b5d6603fb7394"
Sep 05 06:55:54.776234 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.776214    2583 scope.go:117] "RemoveContainer" containerID="7333b17d0c4f12398f2f3a79b9fba808a95834f9dda9e1174877d1d2244c9599"
Sep 05 06:55:54.776656 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:55:54.776630    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7333b17d0c4f12398f2f3a79b9fba808a95834f9dda9e1174877d1d2244c9599\": container with ID starting with 7333b17d0c4f12398f2f3a79b9fba808a95834f9dda9e1174877d1d2244c9599 not found: ID does not exist" containerID="7333b17d0c4f12398f2f3a79b9fba808a95834f9dda9e1174877d1d2244c9599"
Sep 05 06:55:54.776744 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.776668    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7333b17d0c4f12398f2f3a79b9fba808a95834f9dda9e1174877d1d2244c9599"} err="failed to get container status \"7333b17d0c4f12398f2f3a79b9fba808a95834f9dda9e1174877d1d2244c9599\": rpc error: code = NotFound desc = could not find container \"7333b17d0c4f12398f2f3a79b9fba808a95834f9dda9e1174877d1d2244c9599\": container with ID starting with 7333b17d0c4f12398f2f3a79b9fba808a95834f9dda9e1174877d1d2244c9599 not found: ID does not exist"
Sep 05 06:55:54.776744 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.776689    2583 scope.go:117] "RemoveContainer" containerID="a442bfeb27a5e98b591306d7742dd72dfa2d44aa6aff5871af4b5d6603fb7394"
Sep 05 06:55:54.777172 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:55:54.777147    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a442bfeb27a5e98b591306d7742dd72dfa2d44aa6aff5871af4b5d6603fb7394\": container with ID starting with a442bfeb27a5e98b591306d7742dd72dfa2d44aa6aff5871af4b5d6603fb7394 not found: ID does not exist" containerID="a442bfeb27a5e98b591306d7742dd72dfa2d44aa6aff5871af4b5d6603fb7394"
Sep 05 06:55:54.777238 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.777182    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a442bfeb27a5e98b591306d7742dd72dfa2d44aa6aff5871af4b5d6603fb7394"} err="failed to get container status \"a442bfeb27a5e98b591306d7742dd72dfa2d44aa6aff5871af4b5d6603fb7394\": rpc error: code = NotFound desc = could not find container \"a442bfeb27a5e98b591306d7742dd72dfa2d44aa6aff5871af4b5d6603fb7394\": container with ID starting with a442bfeb27a5e98b591306d7742dd72dfa2d44aa6aff5871af4b5d6603fb7394 not found: ID does not exist"
Sep 05 06:55:54.782823 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.782800    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"]
Sep 05 06:55:54.785966 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.785947    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b"]
Sep 05 06:55:54.915303 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:54.915220    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" path="/var/lib/kubelet/pods/5588484a-cf02-4330-9efb-93dbc8ad3e7d/volumes"
Sep 05 06:55:59.899340 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:59.899291    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:55:59.925514 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:59.925477    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"]
Sep 05 06:55:59.925784 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:59.925756    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf" podUID="26d6a6ea-9283-498d-b32d-8cc5ff84452b" containerName="payload-processing" containerID="cri-o://0a60de558f37c5d2a8d33364f89b779610fedc19d9e4889fd955c4efaa6236a8" gracePeriod=30
Sep 05 06:55:59.996548 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:55:59.996518    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:00.094831 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.094802    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq"]
Sep 05 06:56:00.096520 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.096497    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:00.101430 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.101404    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-930288-rrqhq"]
Sep 05 06:56:00.185511 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.185485    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"
Sep 05 06:56:00.196000 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.195971    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:00.208257 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.208229    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26d6a6ea-9283-498d-b32d-8cc5ff84452b-plugins-config-volume\") pod \"26d6a6ea-9283-498d-b32d-8cc5ff84452b\" (UID: \"26d6a6ea-9283-498d-b32d-8cc5ff84452b\") "
Sep 05 06:56:00.208392 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.208272    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqr2l\" (UniqueName: \"kubernetes.io/projected/26d6a6ea-9283-498d-b32d-8cc5ff84452b-kube-api-access-tqr2l\") pod \"26d6a6ea-9283-498d-b32d-8cc5ff84452b\" (UID: \"26d6a6ea-9283-498d-b32d-8cc5ff84452b\") "
Sep 05 06:56:00.208575 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.208546    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26d6a6ea-9283-498d-b32d-8cc5ff84452b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "26d6a6ea-9283-498d-b32d-8cc5ff84452b" (UID: "26d6a6ea-9283-498d-b32d-8cc5ff84452b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:56:00.210611 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.210586    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26d6a6ea-9283-498d-b32d-8cc5ff84452b-kube-api-access-tqr2l" (OuterVolumeSpecName: "kube-api-access-tqr2l") pod "26d6a6ea-9283-498d-b32d-8cc5ff84452b" (UID: "26d6a6ea-9283-498d-b32d-8cc5ff84452b"). InnerVolumeSpecName "kube-api-access-tqr2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:56:00.302856 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.302820    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:00.308896 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.308854    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26d6a6ea-9283-498d-b32d-8cc5ff84452b-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:56:00.308985 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.308901    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqr2l\" (UniqueName: \"kubernetes.io/projected/26d6a6ea-9283-498d-b32d-8cc5ff84452b-kube-api-access-tqr2l\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:56:00.505055 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.505023    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:00.789003 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.788912    2583 generic.go:356] "Generic (PLEG): container finished" podID="26d6a6ea-9283-498d-b32d-8cc5ff84452b" containerID="0a60de558f37c5d2a8d33364f89b779610fedc19d9e4889fd955c4efaa6236a8" exitCode=0
Sep 05 06:56:00.789003 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.788960    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"
Sep 05 06:56:00.789206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.788999    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf" event={"ID":"26d6a6ea-9283-498d-b32d-8cc5ff84452b","Type":"ContainerDied","Data":"0a60de558f37c5d2a8d33364f89b779610fedc19d9e4889fd955c4efaa6236a8"}
Sep 05 06:56:00.789206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.789052    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf" event={"ID":"26d6a6ea-9283-498d-b32d-8cc5ff84452b","Type":"ContainerDied","Data":"ace2d70d55d14d2b9c70b349003d006d54d52393862534afe81ffe44ab2298d0"}
Sep 05 06:56:00.789206 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.789080    2583 scope.go:117] "RemoveContainer" containerID="0a60de558f37c5d2a8d33364f89b779610fedc19d9e4889fd955c4efaa6236a8"
Sep 05 06:56:00.799151 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.799129    2583 scope.go:117] "RemoveContainer" containerID="0a60de558f37c5d2a8d33364f89b779610fedc19d9e4889fd955c4efaa6236a8"
Sep 05 06:56:00.799474 ip-10-0-137-250 kubenswrapper[2583]: E0905 06:56:00.799450    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a60de558f37c5d2a8d33364f89b779610fedc19d9e4889fd955c4efaa6236a8\": container with ID starting with 0a60de558f37c5d2a8d33364f89b779610fedc19d9e4889fd955c4efaa6236a8 not found: ID does not exist" containerID="0a60de558f37c5d2a8d33364f89b779610fedc19d9e4889fd955c4efaa6236a8"
Sep 05 06:56:00.799530 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.799485    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a60de558f37c5d2a8d33364f89b779610fedc19d9e4889fd955c4efaa6236a8"} err="failed to get container status \"0a60de558f37c5d2a8d33364f89b779610fedc19d9e4889fd955c4efaa6236a8\": rpc error: code = NotFound desc = could not find container \"0a60de558f37c5d2a8d33364f89b779610fedc19d9e4889fd955c4efaa6236a8\": container with ID starting with 0a60de558f37c5d2a8d33364f89b779610fedc19d9e4889fd955c4efaa6236a8 not found: ID does not exist"
Sep 05 06:56:00.811458 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.811438    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"]
Sep 05 06:56:00.815318 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.815298    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf"]
Sep 05 06:56:00.914876 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.914834    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26d6a6ea-9283-498d-b32d-8cc5ff84452b" path="/var/lib/kubelet/pods/26d6a6ea-9283-498d-b32d-8cc5ff84452b/volumes"
Sep 05 06:56:00.915255 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:00.915171    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80aa6d08-df8e-4066-ae84-d859c08170f2" path="/var/lib/kubelet/pods/80aa6d08-df8e-4066-ae84-d859c08170f2/volumes"
Sep 05 06:56:04.351590 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:04.351549    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:56:06.436460 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:06.436423    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:06.536760 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:06.536727    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:06.687693 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:06.687609    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:07.032455 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.032425    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd"]
Sep 05 06:56:07.032757 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.032746    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d6a6ea-9283-498d-b32d-8cc5ff84452b" containerName="payload-processing"
Sep 05 06:56:07.032812 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.032759    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d6a6ea-9283-498d-b32d-8cc5ff84452b" containerName="payload-processing"
Sep 05 06:56:07.032812 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.032772    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80aa6d08-df8e-4066-ae84-d859c08170f2" containerName="revoke-keys"
Sep 05 06:56:07.032812 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.032778    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80aa6d08-df8e-4066-ae84-d859c08170f2" containerName="revoke-keys"
Sep 05 06:56:07.032812 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.032788    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerName="istio-proxy"
Sep 05 06:56:07.032812 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.032794    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerName="istio-proxy"
Sep 05 06:56:07.032812 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.032805    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerName="istio-proxy"
Sep 05 06:56:07.032812 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.032811    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerName="istio-proxy"
Sep 05 06:56:07.033050 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.032889    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="80aa6d08-df8e-4066-ae84-d859c08170f2" containerName="revoke-keys"
Sep 05 06:56:07.033050 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.032899    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerName="istio-proxy"
Sep 05 06:56:07.033050 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.032907    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="26d6a6ea-9283-498d-b32d-8cc5ff84452b" containerName="payload-processing"
Sep 05 06:56:07.035664 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.035649    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd"
Sep 05 06:56:07.038290 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.038269    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:56:07.038337 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.038298    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:56:07.042949 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.042709    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd"]
Sep 05 06:56:07.057332 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.057295    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc5b3aca-4ec8-48c5-bb37-20f370c1fb72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd\" (UID: \"bc5b3aca-4ec8-48c5-bb37-20f370c1fb72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd"
Sep 05 06:56:07.133022 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.132981    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:07.157921 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.157885    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc5b3aca-4ec8-48c5-bb37-20f370c1fb72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd\" (UID: \"bc5b3aca-4ec8-48c5-bb37-20f370c1fb72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd"
Sep 05 06:56:07.158452 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.158429    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc5b3aca-4ec8-48c5-bb37-20f370c1fb72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd\" (UID: \"bc5b3aca-4ec8-48c5-bb37-20f370c1fb72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd"
Sep 05 06:56:07.346572 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.346483    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd"
Sep 05 06:56:07.614101 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.613983    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd"]
Sep 05 06:56:07.616126 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:56:07.616101    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5b3aca_4ec8_48c5_bb37_20f370c1fb72.slice/crio-a4a57fbb046f7da0203c54ea4e499d08e84bba8ff8113f63e42890f53f42e0e7 WatchSource:0}: Error finding container a4a57fbb046f7da0203c54ea4e499d08e84bba8ff8113f63e42890f53f42e0e7: Status 404 returned error can't find the container with id a4a57fbb046f7da0203c54ea4e499d08e84bba8ff8113f63e42890f53f42e0e7
Sep 05 06:56:07.827392 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.827365    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd" event={"ID":"bc5b3aca-4ec8-48c5-bb37-20f370c1fb72","Type":"ContainerStarted","Data":"c7d88629be5807a17f17cf769bc201f5790213d88cdbb1c403738d51340c6d75"}
Sep 05 06:56:07.827509 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.827413    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd" event={"ID":"bc5b3aca-4ec8-48c5-bb37-20f370c1fb72","Type":"ContainerStarted","Data":"a4a57fbb046f7da0203c54ea4e499d08e84bba8ff8113f63e42890f53f42e0e7"}
Sep 05 06:56:07.842654 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:07.842606    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd" podStartSLOduration=0.842591371 podStartE2EDuration="842.591371ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:56:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:56:07.841215901 +0000 UTC m=+1865.445764740" watchObservedRunningTime="2026-09-05 06:56:07.842591371 +0000 UTC m=+1865.447140269"
Sep 05 06:56:08.837232 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:08.837198    2583 generic.go:356] "Generic (PLEG): container finished" podID="bc5b3aca-4ec8-48c5-bb37-20f370c1fb72" containerID="c7d88629be5807a17f17cf769bc201f5790213d88cdbb1c403738d51340c6d75" exitCode=0
Sep 05 06:56:08.837629 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:08.837283    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd" event={"ID":"bc5b3aca-4ec8-48c5-bb37-20f370c1fb72","Type":"ContainerDied","Data":"c7d88629be5807a17f17cf769bc201f5790213d88cdbb1c403738d51340c6d75"}
Sep 05 06:56:09.969751 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:09.969721    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd"
Sep 05 06:56:09.976871 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:09.976835    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc5b3aca-4ec8-48c5-bb37-20f370c1fb72-maas-api-service-ca\") pod \"bc5b3aca-4ec8-48c5-bb37-20f370c1fb72\" (UID: \"bc5b3aca-4ec8-48c5-bb37-20f370c1fb72\") "
Sep 05 06:56:09.977139 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:09.977118    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc5b3aca-4ec8-48c5-bb37-20f370c1fb72-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bc5b3aca-4ec8-48c5-bb37-20f370c1fb72" (UID: "bc5b3aca-4ec8-48c5-bb37-20f370c1fb72"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:56:10.077882 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:10.077838    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc5b3aca-4ec8-48c5-bb37-20f370c1fb72-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:56:10.847794 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:10.847755    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd" event={"ID":"bc5b3aca-4ec8-48c5-bb37-20f370c1fb72","Type":"ContainerDied","Data":"a4a57fbb046f7da0203c54ea4e499d08e84bba8ff8113f63e42890f53f42e0e7"}
Sep 05 06:56:10.847794 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:10.847795    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd"
Sep 05 06:56:10.848032 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:10.847816    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4a57fbb046f7da0203c54ea4e499d08e84bba8ff8113f63e42890f53f42e0e7"
Sep 05 06:56:17.616480 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.616441    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:17.643293 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.643261    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"]
Sep 05 06:56:17.643564 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.643507    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv" podUID="9819c766-c012-4594-a4be-21488bb4a706" containerName="payload-processing" containerID="cri-o://87ebd12b3a0164b4200c1ee9d16c2a0d9a894439b85988ef78e10661a43a0f0c" gracePeriod=30
Sep 05 06:56:17.716043 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.716016    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:17.806999 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.806955    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd"]
Sep 05 06:56:17.811321 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.811296    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef54fd-jw8wd"]
Sep 05 06:56:17.811458 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.811356    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:17.871207 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.871119    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:17.883385 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.883356    2583 generic.go:356] "Generic (PLEG): container finished" podID="9819c766-c012-4594-a4be-21488bb4a706" containerID="87ebd12b3a0164b4200c1ee9d16c2a0d9a894439b85988ef78e10661a43a0f0c" exitCode=0
Sep 05 06:56:17.883497 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.883434    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv" event={"ID":"9819c766-c012-4594-a4be-21488bb4a706","Type":"ContainerDied","Data":"87ebd12b3a0164b4200c1ee9d16c2a0d9a894439b85988ef78e10661a43a0f0c"}
Sep 05 06:56:17.883548 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.883494    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv" event={"ID":"9819c766-c012-4594-a4be-21488bb4a706","Type":"ContainerDied","Data":"4a4d87427c1e31105e56074ad7570be7ef12ebe81cc77cc3c587b05287f9fe7a"}
Sep 05 06:56:17.883548 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.883518    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a4d87427c1e31105e56074ad7570be7ef12ebe81cc77cc3c587b05287f9fe7a"
Sep 05 06:56:17.896223 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.896201    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"
Sep 05 06:56:17.926404 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.926373    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9819c766-c012-4594-a4be-21488bb4a706-plugins-config-volume\") pod \"9819c766-c012-4594-a4be-21488bb4a706\" (UID: \"9819c766-c012-4594-a4be-21488bb4a706\") "
Sep 05 06:56:17.926580 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.926432    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h986x\" (UniqueName: \"kubernetes.io/projected/9819c766-c012-4594-a4be-21488bb4a706-kube-api-access-h986x\") pod \"9819c766-c012-4594-a4be-21488bb4a706\" (UID: \"9819c766-c012-4594-a4be-21488bb4a706\") "
Sep 05 06:56:17.926821 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.926794    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9819c766-c012-4594-a4be-21488bb4a706-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9819c766-c012-4594-a4be-21488bb4a706" (UID: "9819c766-c012-4594-a4be-21488bb4a706"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:56:17.928492 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:17.928472    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9819c766-c012-4594-a4be-21488bb4a706-kube-api-access-h986x" (OuterVolumeSpecName: "kube-api-access-h986x") pod "9819c766-c012-4594-a4be-21488bb4a706" (UID: "9819c766-c012-4594-a4be-21488bb4a706"). InnerVolumeSpecName "kube-api-access-h986x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:56:18.026943 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:18.026905    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h986x\" (UniqueName: \"kubernetes.io/projected/9819c766-c012-4594-a4be-21488bb4a706-kube-api-access-h986x\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:56:18.026943 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:18.026937    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9819c766-c012-4594-a4be-21488bb4a706-plugins-config-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:56:18.173694 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:18.173610    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:18.888823 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:18.888792    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"
Sep 05 06:56:18.915378 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:18.915340    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc5b3aca-4ec8-48c5-bb37-20f370c1fb72" path="/var/lib/kubelet/pods/bc5b3aca-4ec8-48c5-bb37-20f370c1fb72/volumes"
Sep 05 06:56:18.915684 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:18.915663    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"]
Sep 05 06:56:18.915764 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:18.915700    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv"]
Sep 05 06:56:20.914395 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:20.914359    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9819c766-c012-4594-a4be-21488bb4a706" path="/var/lib/kubelet/pods/9819c766-c012-4594-a4be-21488bb4a706/volumes"
Sep 05 06:56:20.954779 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:20.954752    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:56:24.450938 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:24.450906    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:24.513204 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:24.513175    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:24.722696 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:24.722615    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:25.089144 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.089053    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr"]
Sep 05 06:56:25.089467 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.089448    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9819c766-c012-4594-a4be-21488bb4a706" containerName="payload-processing"
Sep 05 06:56:25.089558 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.089471    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9819c766-c012-4594-a4be-21488bb4a706" containerName="payload-processing"
Sep 05 06:56:25.089558 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.089491    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc5b3aca-4ec8-48c5-bb37-20f370c1fb72" containerName="revoke-keys"
Sep 05 06:56:25.089558 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.089499    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc5b3aca-4ec8-48c5-bb37-20f370c1fb72" containerName="revoke-keys"
Sep 05 06:56:25.089720 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.089589    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9819c766-c012-4594-a4be-21488bb4a706" containerName="payload-processing"
Sep 05 06:56:25.089720 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.089604    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5588484a-cf02-4330-9efb-93dbc8ad3e7d" containerName="istio-proxy"
Sep 05 06:56:25.089720 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.089616    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc5b3aca-4ec8-48c5-bb37-20f370c1fb72" containerName="revoke-keys"
Sep 05 06:56:25.093979 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.093958    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr"
Sep 05 06:56:25.096484 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.096462    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:56:25.096613 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.096594    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:56:25.100405 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.100381    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr"]
Sep 05 06:56:25.176015 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.175971    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc79bea-a44d-42aa-8bae-c820c292765a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr\" (UID: \"1cc79bea-a44d-42aa-8bae-c820c292765a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr"
Sep 05 06:56:25.188912 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.188881    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:25.276558 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.276525    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc79bea-a44d-42aa-8bae-c820c292765a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr\" (UID: \"1cc79bea-a44d-42aa-8bae-c820c292765a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr"
Sep 05 06:56:25.277182 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.277156    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc79bea-a44d-42aa-8bae-c820c292765a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr\" (UID: \"1cc79bea-a44d-42aa-8bae-c820c292765a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr"
Sep 05 06:56:25.405015 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.404914    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr"
Sep 05 06:56:25.675630 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.675599    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr"]
Sep 05 06:56:25.677607 ip-10-0-137-250 kubenswrapper[2583]: W0905 06:56:25.677582    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc79bea_a44d_42aa_8bae_c820c292765a.slice/crio-7333ba8bba2920e1372e027361b446033007f4287bd06422c8326fea535bec48 WatchSource:0}: Error finding container 7333ba8bba2920e1372e027361b446033007f4287bd06422c8326fea535bec48: Status 404 returned error can't find the container with id 7333ba8bba2920e1372e027361b446033007f4287bd06422c8326fea535bec48
Sep 05 06:56:25.922889 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:25.922849    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr" event={"ID":"1cc79bea-a44d-42aa-8bae-c820c292765a","Type":"ContainerStarted","Data":"7333ba8bba2920e1372e027361b446033007f4287bd06422c8326fea535bec48"}
Sep 05 06:56:26.928672 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:26.928636    2583 generic.go:356] "Generic (PLEG): container finished" podID="1cc79bea-a44d-42aa-8bae-c820c292765a" containerID="975dba062d11779c9483409d6632d5f8fe0ce6390c9b0cb8bf1b104e056cead8" exitCode=0
Sep 05 06:56:26.929103 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:26.928719    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr" event={"ID":"1cc79bea-a44d-42aa-8bae-c820c292765a","Type":"ContainerDied","Data":"975dba062d11779c9483409d6632d5f8fe0ce6390c9b0cb8bf1b104e056cead8"}
Sep 05 06:56:28.057335 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:28.057308    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr"
Sep 05 06:56:28.100177 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:28.100143    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc79bea-a44d-42aa-8bae-c820c292765a-maas-api-service-ca\") pod \"1cc79bea-a44d-42aa-8bae-c820c292765a\" (UID: \"1cc79bea-a44d-42aa-8bae-c820c292765a\") "
Sep 05 06:56:28.100486 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:28.100461    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cc79bea-a44d-42aa-8bae-c820c292765a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1cc79bea-a44d-42aa-8bae-c820c292765a" (UID: "1cc79bea-a44d-42aa-8bae-c820c292765a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:56:28.201623 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:28.201596    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc79bea-a44d-42aa-8bae-c820c292765a-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:56:28.940034 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:28.940009    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr"
Sep 05 06:56:28.940162 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:28.940006    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr" event={"ID":"1cc79bea-a44d-42aa-8bae-c820c292765a","Type":"ContainerDied","Data":"7333ba8bba2920e1372e027361b446033007f4287bd06422c8326fea535bec48"}
Sep 05 06:56:28.940162 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:28.940135    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7333ba8bba2920e1372e027361b446033007f4287bd06422c8326fea535bec48"
Sep 05 06:56:35.543422 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:35.543381    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:35.643093 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:35.643055    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:35.716593 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:35.716558    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr"]
Sep 05 06:56:35.719457 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:35.719432    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5b1d24-67jnr"]
Sep 05 06:56:35.719586 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:35.719463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:35.783989 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:35.783949    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:36.095567 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:36.095531    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:36.914108 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:36.914072    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cc79bea-a44d-42aa-8bae-c820c292765a" path="/var/lib/kubelet/pods/1cc79bea-a44d-42aa-8bae-c820c292765a/volumes"
Sep 05 06:56:38.853165 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:38.853130    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:56:41.995693 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:41.995651    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:42.098478 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:42.098440    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:42.257629 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:42.257548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:56:48.544435 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:56:48.544397    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:57:03.258009 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:57:03.257974    2583 scope.go:117] "RemoveContainer" containerID="87ebd12b3a0164b4200c1ee9d16c2a0d9a894439b85988ef78e10661a43a0f0c"
Sep 05 06:58:03.277584 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:58:03.277506    2583 scope.go:117] "RemoveContainer" containerID="84e565a4fecaadba0c7491979de1c5d6a982c99d4bbe19893c923fb33b94d992"
Sep 05 06:58:03.286154 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:58:03.286133    2583 scope.go:117] "RemoveContainer" containerID="3e7c0be7ee6539a7077b2fe336a754ed346082650d1a417b908cc3860744b0d1"
Sep 05 06:58:06.690359 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:58:06.690302    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:58:07.756559 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:58:07.756526    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:58:08.313425 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:58:08.313391    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:58:09.852179 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:58:09.852145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:58:31.622936 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:58:31.622902    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:58:31.724581 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:58:31.724543    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 06:58:34.046890 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:58:34.046841    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:58:41.956913 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:58:41.956853    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:58:49.066063 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:58:49.066026    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:58:55.656711 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:58:55.656675    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:59:03.309445 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:03.309408    2583 scope.go:117] "RemoveContainer" containerID="6a8310e0f169fe4efccd7307b534f3e749eb28d0284059a7187a001766b82c91"
Sep 05 06:59:16.751772 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:16.751735    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:59:23.853680 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:23.853644    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 06:59:28.478582 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:28.478501    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"]
Sep 05 06:59:28.478980 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:28.478723    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm" podUID="23a50426-27a4-4de9-9388-2c9f44993758" containerName="manager" containerID="cri-o://5502cd6646bd16df3ab021631f4fbd41e9cc9e8959b9aae1d1906e00dc179800" gracePeriod=10
Sep 05 06:59:30.851900 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:30.851843    2583 generic.go:356] "Generic (PLEG): container finished" podID="23a50426-27a4-4de9-9388-2c9f44993758" containerID="5502cd6646bd16df3ab021631f4fbd41e9cc9e8959b9aae1d1906e00dc179800" exitCode=0
Sep 05 06:59:30.851900 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:30.851894    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm" event={"ID":"23a50426-27a4-4de9-9388-2c9f44993758","Type":"ContainerDied","Data":"5502cd6646bd16df3ab021631f4fbd41e9cc9e8959b9aae1d1906e00dc179800"}
Sep 05 06:59:30.922029 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:30.922005    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"
Sep 05 06:59:30.994468 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:30.994367    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8q6q\" (UniqueName: \"kubernetes.io/projected/23a50426-27a4-4de9-9388-2c9f44993758-kube-api-access-p8q6q\") pod \"23a50426-27a4-4de9-9388-2c9f44993758\" (UID: \"23a50426-27a4-4de9-9388-2c9f44993758\") "
Sep 05 06:59:30.994468 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:30.994462    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23a50426-27a4-4de9-9388-2c9f44993758-extensions-socket-volume\") pod \"23a50426-27a4-4de9-9388-2c9f44993758\" (UID: \"23a50426-27a4-4de9-9388-2c9f44993758\") "
Sep 05 06:59:30.994827 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:30.994799    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23a50426-27a4-4de9-9388-2c9f44993758-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "23a50426-27a4-4de9-9388-2c9f44993758" (UID: "23a50426-27a4-4de9-9388-2c9f44993758"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:59:30.996443 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:30.996421    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23a50426-27a4-4de9-9388-2c9f44993758-kube-api-access-p8q6q" (OuterVolumeSpecName: "kube-api-access-p8q6q") pod "23a50426-27a4-4de9-9388-2c9f44993758" (UID: "23a50426-27a4-4de9-9388-2c9f44993758"). InnerVolumeSpecName "kube-api-access-p8q6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:59:31.095068 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:31.095028    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23a50426-27a4-4de9-9388-2c9f44993758-extensions-socket-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:59:31.095068 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:31.095061    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8q6q\" (UniqueName: \"kubernetes.io/projected/23a50426-27a4-4de9-9388-2c9f44993758-kube-api-access-p8q6q\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Sep 05 06:59:31.857900 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:31.857852    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"
Sep 05 06:59:31.857900 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:31.857883    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm" event={"ID":"23a50426-27a4-4de9-9388-2c9f44993758","Type":"ContainerDied","Data":"77d7c8c8ef154364416b17647c0957aafd97893081e1ef894cd4676b6adc38eb"}
Sep 05 06:59:31.858388 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:31.857943    2583 scope.go:117] "RemoveContainer" containerID="5502cd6646bd16df3ab021631f4fbd41e9cc9e8959b9aae1d1906e00dc179800"
Sep 05 06:59:31.880484 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:31.880460    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"]
Sep 05 06:59:31.886171 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:31.886150    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-84fnm"]
Sep 05 06:59:32.913841 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:32.913809    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23a50426-27a4-4de9-9388-2c9f44993758" path="/var/lib/kubelet/pods/23a50426-27a4-4de9-9388-2c9f44993758/volumes"
Sep 05 06:59:58.474499 ip-10-0-137-250 kubenswrapper[2583]: I0905 06:59:58.474463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 07:00:00.142992 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.142962    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29809860-npmkd"]
Sep 05 07:00:00.143358 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.143281    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc79bea-a44d-42aa-8bae-c820c292765a" containerName="revoke-keys"
Sep 05 07:00:00.143358 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.143309    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc79bea-a44d-42aa-8bae-c820c292765a" containerName="revoke-keys"
Sep 05 07:00:00.143358 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.143329    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23a50426-27a4-4de9-9388-2c9f44993758" containerName="manager"
Sep 05 07:00:00.143358 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.143335    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a50426-27a4-4de9-9388-2c9f44993758" containerName="manager"
Sep 05 07:00:00.143497 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.143382    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cc79bea-a44d-42aa-8bae-c820c292765a" containerName="revoke-keys"
Sep 05 07:00:00.143497 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.143393    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="23a50426-27a4-4de9-9388-2c9f44993758" containerName="manager"
Sep 05 07:00:00.146187 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.146171    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809860-npmkd"
Sep 05 07:00:00.148763 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.148742    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 07:00:00.154990 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.154964    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29809860-npmkd"]
Sep 05 07:00:00.156573 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.156557    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809860-npmkd"
Sep 05 07:00:00.426744 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.426720    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29809860-npmkd"]
Sep 05 07:00:00.428795 ip-10-0-137-250 kubenswrapper[2583]: W0905 07:00:00.428765    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb308ff_3a16_4456_8864_f2cb5df1275b.slice/crio-6677314e412353183b80a9d40e939690eb0f31e880bfcdf472fb939873f4205e WatchSource:0}: Error finding container 6677314e412353183b80a9d40e939690eb0f31e880bfcdf472fb939873f4205e: Status 404 returned error can't find the container with id 6677314e412353183b80a9d40e939690eb0f31e880bfcdf472fb939873f4205e
Sep 05 07:00:00.999094 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.999060    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809860-npmkd" event={"ID":"adb308ff-3a16-4456-8864-f2cb5df1275b","Type":"ContainerStarted","Data":"4bf000312489189b1ce511d53740e4176fc824eee48c3b675cd839d12d7eebd0"}
Sep 05 07:00:00.999289 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:00.999111    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809860-npmkd" event={"ID":"adb308ff-3a16-4456-8864-f2cb5df1275b","Type":"ContainerStarted","Data":"6677314e412353183b80a9d40e939690eb0f31e880bfcdf472fb939873f4205e"}
Sep 05 07:00:01.015686 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:01.015621    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809860-npmkd" podStartSLOduration=1.015608541 podStartE2EDuration="1.015608541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 07:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 07:00:01.014733433 +0000 UTC m=+2098.619282273" watchObservedRunningTime="2026-09-05 07:00:01.015608541 +0000 UTC m=+2098.620157378"
Sep 05 07:00:02.005597 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:02.005566    2583 generic.go:356] "Generic (PLEG): container finished" podID="adb308ff-3a16-4456-8864-f2cb5df1275b" containerID="4bf000312489189b1ce511d53740e4176fc824eee48c3b675cd839d12d7eebd0" exitCode=0
Sep 05 07:00:02.006027 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:02.005633    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809860-npmkd" event={"ID":"adb308ff-3a16-4456-8864-f2cb5df1275b","Type":"ContainerDied","Data":"4bf000312489189b1ce511d53740e4176fc824eee48c3b675cd839d12d7eebd0"}
Sep 05 07:00:03.138007 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:03.137979    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809860-npmkd"
Sep 05 07:00:04.015758 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:04.015731    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809860-npmkd"
Sep 05 07:00:04.015972 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:04.015726    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29809860-npmkd" event={"ID":"adb308ff-3a16-4456-8864-f2cb5df1275b","Type":"ContainerDied","Data":"6677314e412353183b80a9d40e939690eb0f31e880bfcdf472fb939873f4205e"}
Sep 05 07:00:04.015972 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:04.015853    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6677314e412353183b80a9d40e939690eb0f31e880bfcdf472fb939873f4205e"
Sep 05 07:00:09.490357 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:09.490326    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 07:00:29.173558 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.173524    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv"]
Sep 05 07:00:29.173974 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.173846    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb308ff-3a16-4456-8864-f2cb5df1275b" containerName="cleanup"
Sep 05 07:00:29.173974 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.173857    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb308ff-3a16-4456-8864-f2cb5df1275b" containerName="cleanup"
Sep 05 07:00:29.173974 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.173970    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="adb308ff-3a16-4456-8864-f2cb5df1275b" containerName="cleanup"
Sep 05 07:00:29.176938 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.176919    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv"
Sep 05 07:00:29.180520 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.180500    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7q2pt\""
Sep 05 07:00:29.194892 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.194850    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv"]
Sep 05 07:00:29.286561 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.286531    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea694a75-9415-4203-80aa-a3751a34a3a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-vhzsv\" (UID: \"ea694a75-9415-4203-80aa-a3751a34a3a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv"
Sep 05 07:00:29.286826 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.286606    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rg5h\" (UniqueName: \"kubernetes.io/projected/ea694a75-9415-4203-80aa-a3751a34a3a8-kube-api-access-2rg5h\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-vhzsv\" (UID: \"ea694a75-9415-4203-80aa-a3751a34a3a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv"
Sep 05 07:00:29.387284 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.387252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rg5h\" (UniqueName: \"kubernetes.io/projected/ea694a75-9415-4203-80aa-a3751a34a3a8-kube-api-access-2rg5h\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-vhzsv\" (UID: \"ea694a75-9415-4203-80aa-a3751a34a3a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv"
Sep 05 07:00:29.387462 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.387311    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea694a75-9415-4203-80aa-a3751a34a3a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-vhzsv\" (UID: \"ea694a75-9415-4203-80aa-a3751a34a3a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv"
Sep 05 07:00:29.387665 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.387647    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea694a75-9415-4203-80aa-a3751a34a3a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-vhzsv\" (UID: \"ea694a75-9415-4203-80aa-a3751a34a3a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv"
Sep 05 07:00:29.400821 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.400791    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rg5h\" (UniqueName: \"kubernetes.io/projected/ea694a75-9415-4203-80aa-a3751a34a3a8-kube-api-access-2rg5h\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-vhzsv\" (UID: \"ea694a75-9415-4203-80aa-a3751a34a3a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv"
Sep 05 07:00:29.486834 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.486805    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv"
Sep 05 07:00:29.762794 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:29.762763    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv"]
Sep 05 07:00:29.764063 ip-10-0-137-250 kubenswrapper[2583]: W0905 07:00:29.764037    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea694a75_9415_4203_80aa_a3751a34a3a8.slice/crio-86110f57a35c3fa6a3426307c12ccb4e12391e7f85a617aca034fe79a79e1544 WatchSource:0}: Error finding container 86110f57a35c3fa6a3426307c12ccb4e12391e7f85a617aca034fe79a79e1544: Status 404 returned error can't find the container with id 86110f57a35c3fa6a3426307c12ccb4e12391e7f85a617aca034fe79a79e1544
Sep 05 07:00:30.135542 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:30.135437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv" event={"ID":"ea694a75-9415-4203-80aa-a3751a34a3a8","Type":"ContainerStarted","Data":"2b86a772c2a04c8e56548e670faf0540025fa6dca7583eada709de06fb2a8855"}
Sep 05 07:00:30.135542 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:30.135504    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv" event={"ID":"ea694a75-9415-4203-80aa-a3751a34a3a8","Type":"ContainerStarted","Data":"86110f57a35c3fa6a3426307c12ccb4e12391e7f85a617aca034fe79a79e1544"}
Sep 05 07:00:30.135772 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:30.135604    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv"
Sep 05 07:00:30.156593 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:30.156538    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv" podStartSLOduration=1.1565218800000001 podStartE2EDuration="1.15652188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 07:00:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 07:00:30.154855571 +0000 UTC m=+2127.759404407" watchObservedRunningTime="2026-09-05 07:00:30.15652188 +0000 UTC m=+2127.761070718"
Sep 05 07:00:41.142712 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:41.142630    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-vhzsv"
Sep 05 07:00:49.845777 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:49.845735    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 07:00:56.452592 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:00:56.452504    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 07:01:03.955336 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:01:03.955297    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 07:01:06.066619 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:01:06.066576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 07:01:08.357401 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:01:08.357362    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 07:01:24.454214 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:01:24.454173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 07:01:27.651150 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:01:27.651112    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 07:02:03.352942 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:02:03.352907    2583 scope.go:117] "RemoveContainer" containerID="56dc447d6e0a65ae57bcc11650e3fa81a6595fca14daf0206f5192cbec700280"
Sep 05 07:02:09.148198 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:02:09.148167    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 07:02:10.901938 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:02:10.901897    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 07:02:11.251468 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:02:11.251428    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 07:02:18.947932 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:02:18.947894    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 07:02:27.945072 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:02:27.944992    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 07:02:36.847915 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:02:36.847857    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 07:02:45.461677 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:02:45.461640    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 07:02:51.047383 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:02:51.047347    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 07:02:58.248348 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:02:58.248302    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-22rqm"]
Sep 05 07:03:03.371913 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:03.371855    2583 scope.go:117] "RemoveContainer" containerID="975dba062d11779c9483409d6632d5f8fe0ce6390c9b0cb8bf1b104e056cead8"
Sep 05 07:03:03.379966 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:03.379947    2583 scope.go:117] "RemoveContainer" containerID="c7d88629be5807a17f17cf769bc201f5790213d88cdbb1c403738d51340c6d75"
Sep 05 07:03:06.188662 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:06.188616    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gpjp4_1cf33a6e-11c7-45d0-a745-08a419a6901f/manager/0.log"
Sep 05 07:03:06.314659 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:06.314625    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9vks8_528bc1a8-43f3-46d0-8693-db879285bf29/manager/0.log"
Sep 05 07:03:06.817534 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:06.817505    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665f9d595b-475w2_0ca8c1e7-521e-44af-8c23-04d1a7a6402f/copy-manifests/0.log"
Sep 05 07:03:06.829483 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:06.829455    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665f9d595b-475w2_0ca8c1e7-521e-44af-8c23-04d1a7a6402f/manager/0.log"
Sep 05 07:03:07.700184 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:07.700153    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29809845-7xll4_e50cc870-a11a-41a0-8f9b-01b569752fcd/cleanup/0.log"
Sep 05 07:03:07.817136 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:07.817106    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29809860-npmkd_adb308ff-3a16-4456-8864-f2cb5df1275b/cleanup/0.log"
Sep 05 07:03:08.918584 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:08.918559    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-pgb58_02dea07a-b6fe-4277-a4a5-04b5036ebf21/manager/0.log"
Sep 05 07:03:09.039589 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:09.039557    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-b6tlv_3385b045-8f4e-4d2d-b559-4cccc6647762/manager/0.log"
Sep 05 07:03:09.159666 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:09.159638    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-7xh2f_4f095918-637a-40f8-a199-4ab218329468/kuadrant-console-plugin/0.log"
Sep 05 07:03:09.296976 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:09.296948    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-vhzsv_ea694a75-9415-4203-80aa-a3751a34a3a8/manager/0.log"
Sep 05 07:03:09.434254 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:09.434227    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-22rqm_0fa6df0d-162f-4555-b1ec-cee7372eb7d0/limitador/0.log"
Sep 05 07:03:09.554679 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:09.554606    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-zxnl6_112b41f8-f6ef-48ca-9b90-069bdc59cec4/manager/0.log"
Sep 05 07:03:10.302059 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:10.302032    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff6468b6c-lxdl9_3fe4de53-12d0-44c6-bf07-4131e25302ad/kube-auth-proxy/0.log"
Sep 05 07:03:10.558310 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:10.558226    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-qghsb_5cc87164-e87f-4989-9f35-ccd5474b0017/payload-pre-processing/0.log"
Sep 05 07:03:10.684539 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:10.684506    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-kxf79_05b4a34f-8094-44b3-944b-a8a95fbf7dbf/payload-processing/0.log"
Sep 05 07:03:11.382651 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:11.382614    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-xbznh_3812579a-474d-4139-a775-f4cb57121308/main/0.log"
Sep 05 07:03:11.736118 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:11.736088    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-lztvr_3cd66b90-5009-4017-80c6-8a844bfd5d35/main/0.log"
Sep 05 07:03:11.858157 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:11.858128    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-thbxv_904385aa-554a-45bc-89af-48aa50c8e6b7/main/0.log"
Sep 05 07:03:17.711994 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:17.711959    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q9qgh/must-gather-w2kbg"]
Sep 05 07:03:17.715457 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:17.715435    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q9qgh/must-gather-w2kbg"
Sep 05 07:03:17.717901 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:17.717879    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q9qgh\"/\"default-dockercfg-ssk9n\""
Sep 05 07:03:17.718030 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:17.717878    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q9qgh\"/\"kube-root-ca.crt\""
Sep 05 07:03:17.718030 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:17.717879    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q9qgh\"/\"openshift-service-ca.crt\""
Sep 05 07:03:17.724821 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:17.724800    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q9qgh/must-gather-w2kbg"]
Sep 05 07:03:17.731260 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:17.731234    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 07:03:17.883010 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:17.882978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rxvm\" (UniqueName: \"kubernetes.io/projected/5fcfe534-b08e-4b66-9a03-fb49ee861a46-kube-api-access-4rxvm\") pod \"must-gather-w2kbg\" (UID: \"5fcfe534-b08e-4b66-9a03-fb49ee861a46\") " pod="openshift-must-gather-q9qgh/must-gather-w2kbg"
Sep 05 07:03:17.883162 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:17.883037    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5fcfe534-b08e-4b66-9a03-fb49ee861a46-must-gather-output\") pod \"must-gather-w2kbg\" (UID: \"5fcfe534-b08e-4b66-9a03-fb49ee861a46\") " pod="openshift-must-gather-q9qgh/must-gather-w2kbg"
Sep 05 07:03:17.983896 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:17.983788    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rxvm\" (UniqueName: \"kubernetes.io/projected/5fcfe534-b08e-4b66-9a03-fb49ee861a46-kube-api-access-4rxvm\") pod \"must-gather-w2kbg\" (UID: \"5fcfe534-b08e-4b66-9a03-fb49ee861a46\") " pod="openshift-must-gather-q9qgh/must-gather-w2kbg"
Sep 05 07:03:17.983896 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:17.983851    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5fcfe534-b08e-4b66-9a03-fb49ee861a46-must-gather-output\") pod \"must-gather-w2kbg\" (UID: \"5fcfe534-b08e-4b66-9a03-fb49ee861a46\") " pod="openshift-must-gather-q9qgh/must-gather-w2kbg"
Sep 05 07:03:17.984181 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:17.984163    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5fcfe534-b08e-4b66-9a03-fb49ee861a46-must-gather-output\") pod \"must-gather-w2kbg\" (UID: \"5fcfe534-b08e-4b66-9a03-fb49ee861a46\") " pod="openshift-must-gather-q9qgh/must-gather-w2kbg"
Sep 05 07:03:17.992110 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:17.992085    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rxvm\" (UniqueName: \"kubernetes.io/projected/5fcfe534-b08e-4b66-9a03-fb49ee861a46-kube-api-access-4rxvm\") pod \"must-gather-w2kbg\" (UID: \"5fcfe534-b08e-4b66-9a03-fb49ee861a46\") " pod="openshift-must-gather-q9qgh/must-gather-w2kbg"
Sep 05 07:03:18.025094 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:18.025063    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q9qgh/must-gather-w2kbg"
Sep 05 07:03:18.303956 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:18.303929    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q9qgh/must-gather-w2kbg"]
Sep 05 07:03:18.305245 ip-10-0-137-250 kubenswrapper[2583]: W0905 07:03:18.305215    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fcfe534_b08e_4b66_9a03_fb49ee861a46.slice/crio-fbf50b35c0c6c3b6b6f0db4a2dc4157a17716593489262d08d5266be04c0e072 WatchSource:0}: Error finding container fbf50b35c0c6c3b6b6f0db4a2dc4157a17716593489262d08d5266be04c0e072: Status 404 returned error can't find the container with id fbf50b35c0c6c3b6b6f0db4a2dc4157a17716593489262d08d5266be04c0e072
Sep 05 07:03:18.307098 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:18.307079    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 05 07:03:18.956529 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:18.956498    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log" limit=1024
Sep 05 07:03:18.961099 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:18.961068    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9qgh/must-gather-w2kbg" event={"ID":"5fcfe534-b08e-4b66-9a03-fb49ee861a46","Type":"ContainerStarted","Data":"fbf50b35c0c6c3b6b6f0db4a2dc4157a17716593489262d08d5266be04c0e072"}
Sep 05 07:03:19.974985 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:19.974633    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9qgh/must-gather-w2kbg" event={"ID":"5fcfe534-b08e-4b66-9a03-fb49ee861a46","Type":"ContainerStarted","Data":"ba9b1e5d881ba9b1c8343831f278ed5baa55af46efbc5889e9fc64f7b2898726"}
Sep 05 07:03:19.974985 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:19.974691    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9qgh/must-gather-w2kbg" event={"ID":"5fcfe534-b08e-4b66-9a03-fb49ee861a46","Type":"ContainerStarted","Data":"24a860bde6af6842aea2ae49c7f587ce8580efe9289e22a5f5081638e562101e"}
Sep 05 07:03:19.992092 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:19.992030    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q9qgh/must-gather-w2kbg" podStartSLOduration=2.186516754 podStartE2EDuration="2.992007897s" totalImagesPullingTime="805.491143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 07:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 07:03:19.989222473 +0000 UTC m=+2297.593771315" watchObservedRunningTime="2026-09-05 07:03:19.992007897 +0000 UTC m=+2297.596556736"
Sep 05 07:03:20.677567 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:20.677537    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-82mp8_104a86cd-474f-4615-b7b5-94fd578c46a4/global-pull-secret-syncer/0.log"
Sep 05 07:03:20.821049 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:20.821013    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9v682_6ae2eb04-2f07-4d37-9d15-8622b614403b/konnectivity-agent/0.log"
Sep 05 07:03:20.915268 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:20.915235    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-250.ec2.internal_315d8cbf3b078d65e6cd2c542ab86aac/haproxy/0.log"
Sep 05 07:03:25.251367 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:25.251301    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-pgb58_02dea07a-b6fe-4277-a4a5-04b5036ebf21/manager/0.log"
Sep 05 07:03:25.277695 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:25.277613    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-b6tlv_3385b045-8f4e-4d2d-b559-4cccc6647762/manager/0.log"
Sep 05 07:03:25.305450 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:25.305294    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-7xh2f_4f095918-637a-40f8-a199-4ab218329468/kuadrant-console-plugin/0.log"
Sep 05 07:03:25.356671 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:25.356631    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-vhzsv_ea694a75-9415-4203-80aa-a3751a34a3a8/manager/0.log"
Sep 05 07:03:25.393403 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:25.393376    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-22rqm_0fa6df0d-162f-4555-b1ec-cee7372eb7d0/limitador/0.log"
Sep 05 07:03:25.473850 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:25.473819    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-zxnl6_112b41f8-f6ef-48ca-9b90-069bdc59cec4/manager/0.log"
Sep 05 07:03:27.322312 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:27.322238    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bg4kj_d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee/node-exporter/0.log"
Sep 05 07:03:27.344921 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:27.344856    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bg4kj_d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee/kube-rbac-proxy/0.log"
Sep 05 07:03:27.365820 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:27.365791    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bg4kj_d6a11c81-b8a2-48fa-bd2a-a9623d1fc1ee/init-textfile/0.log"
Sep 05 07:03:30.916298 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:30.916262    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"]
Sep 05 07:03:30.924340 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:30.924309    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"]
Sep 05 07:03:30.924484 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:30.924430    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.032578 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.032526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-lib-modules\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.032774 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.032650    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-proc\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.032774 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.032730    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-podres\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.032774 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.032755    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxrcw\" (UniqueName: \"kubernetes.io/projected/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-kube-api-access-jxrcw\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.032969 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.032791    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-sys\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.133912 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.133852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-proc\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.134106 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.133929    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-podres\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.134106 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.133947    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrcw\" (UniqueName: \"kubernetes.io/projected/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-kube-api-access-jxrcw\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.134106 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.133968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-sys\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.134106 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.133996    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-lib-modules\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.134106 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.134004    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-proc\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.134106 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.134078    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-sys\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.134106 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.134107    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-lib-modules\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.134437 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.134121    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-podres\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.141894 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.141851    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxrcw\" (UniqueName: \"kubernetes.io/projected/f8a4a3e1-053d-499e-b136-6de8b5e5c68b-kube-api-access-jxrcw\") pod \"perf-node-gather-daemonset-knzvv\" (UID: \"f8a4a3e1-053d-499e-b136-6de8b5e5c68b\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.238248 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.238212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:31.548687 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:31.548657    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"]
Sep 05 07:03:31.551212 ip-10-0-137-250 kubenswrapper[2583]: W0905 07:03:31.551168    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf8a4a3e1_053d_499e_b136_6de8b5e5c68b.slice/crio-aebe0396265b36c627d3bb6bbcaa9b84e284dd4e48158aeaaa1be417381ab623 WatchSource:0}: Error finding container aebe0396265b36c627d3bb6bbcaa9b84e284dd4e48158aeaaa1be417381ab623: Status 404 returned error can't find the container with id aebe0396265b36c627d3bb6bbcaa9b84e284dd4e48158aeaaa1be417381ab623
Sep 05 07:03:32.061999 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:32.061891    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv" event={"ID":"f8a4a3e1-053d-499e-b136-6de8b5e5c68b","Type":"ContainerStarted","Data":"fdebfa0d06a0a6a1d53ca981e44a179326ba311a8e78c839d34ed86060a9ddba"}
Sep 05 07:03:32.061999 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:32.061959    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv" event={"ID":"f8a4a3e1-053d-499e-b136-6de8b5e5c68b","Type":"ContainerStarted","Data":"aebe0396265b36c627d3bb6bbcaa9b84e284dd4e48158aeaaa1be417381ab623"}
Sep 05 07:03:32.062548 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:32.062109    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:32.081079 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:32.080973    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv" podStartSLOduration=2.080955273 podStartE2EDuration="2.080955273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 07:03:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 07:03:32.079390636 +0000 UTC m=+2309.683939476" watchObservedRunningTime="2026-09-05 07:03:32.080955273 +0000 UTC m=+2309.685504110"
Sep 05 07:03:32.890840 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:32.890804    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rmx67_a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77/dns/0.log"
Sep 05 07:03:32.912021 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:32.911971    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rmx67_a0bafcde-e6b9-4dc6-b05e-9a7bbac52f77/kube-rbac-proxy/0.log"
Sep 05 07:03:32.939261 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:32.939228    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c5gst_7106bb4d-a09c-4d8a-af07-a349c2d464ef/dns-node-resolver/0.log"
Sep 05 07:03:33.601117 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:33.601087    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-24cbm_32b062bd-e411-4997-ba7c-0ac37d425e38/node-ca/0.log"
Sep 05 07:03:34.881284 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:34.881255    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff6468b6c-lxdl9_3fe4de53-12d0-44c6-bf07-4131e25302ad/kube-auth-proxy/0.log"
Sep 05 07:03:34.968022 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:34.967987    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-qghsb_5cc87164-e87f-4989-9f35-ccd5474b0017/payload-pre-processing/0.log"
Sep 05 07:03:35.006418 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:35.006371    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-kxf79_05b4a34f-8094-44b3-944b-a8a95fbf7dbf/payload-processing/0.log"
Sep 05 07:03:35.867592 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:35.867564    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hvbvv_a24e846a-7c8e-472f-a6ba-410f2a191c1d/serve-healthcheck-canary/0.log"
Sep 05 07:03:36.389530 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:36.389492    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-67tb2_0540b4cf-969a-4239-b079-3936895f2958/kube-rbac-proxy/0.log"
Sep 05 07:03:36.410657 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:36.410632    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-67tb2_0540b4cf-969a-4239-b079-3936895f2958/exporter/0.log"
Sep 05 07:03:36.431119 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:36.431087    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-67tb2_0540b4cf-969a-4239-b079-3936895f2958/extractor/0.log"
Sep 05 07:03:38.080958 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:38.080922    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-knzvv"
Sep 05 07:03:38.595005 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:38.594973    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gpjp4_1cf33a6e-11c7-45d0-a745-08a419a6901f/manager/0.log"
Sep 05 07:03:38.842271 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:38.842239    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9vks8_528bc1a8-43f3-46d0-8693-db879285bf29/manager/0.log"
Sep 05 07:03:39.084906 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:39.084874    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665f9d595b-475w2_0ca8c1e7-521e-44af-8c23-04d1a7a6402f/manager/0.log"
Sep 05 07:03:39.104509 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:39.104467    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665f9d595b-475w2_0ca8c1e7-521e-44af-8c23-04d1a7a6402f/copy-manifests/0.log"
Sep 05 07:03:40.689790 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:40.689744    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-g2g5m_a1d5d57c-a506-46d6-ba8c-3ac0f8345a95/openshift-lws-operator/0.log"
Sep 05 07:03:41.605329 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:41.605288    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff6468b6c-lxdl9_3fe4de53-12d0-44c6-bf07-4131e25302ad/kube-auth-proxy/0.log"
Sep 05 07:03:41.674717 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:41.674675    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-qghsb_5cc87164-e87f-4989-9f35-ccd5474b0017/payload-pre-processing/0.log"
Sep 05 07:03:41.704653 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:41.704626    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-kxf79_05b4a34f-8094-44b3-944b-a8a95fbf7dbf/payload-processing/0.log"
Sep 05 07:03:43.512753 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:43.512716    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff6468b6c-lxdl9_3fe4de53-12d0-44c6-bf07-4131e25302ad/kube-auth-proxy/0.log"
Sep 05 07:03:43.588238 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:43.588207    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-qghsb_5cc87164-e87f-4989-9f35-ccd5474b0017/payload-pre-processing/0.log"
Sep 05 07:03:43.621049 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:43.621021    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-kxf79_05b4a34f-8094-44b3-944b-a8a95fbf7dbf/payload-processing/0.log"
Sep 05 07:03:47.409410 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:47.409366    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvr8h_18cf93ad-f837-4588-b868-b905984873ab/kube-multus-additional-cni-plugins/0.log"
Sep 05 07:03:47.429816 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:47.429788    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvr8h_18cf93ad-f837-4588-b868-b905984873ab/egress-router-binary-copy/0.log"
Sep 05 07:03:47.449603 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:47.449572    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvr8h_18cf93ad-f837-4588-b868-b905984873ab/cni-plugins/0.log"
Sep 05 07:03:47.469610 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:47.469582    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvr8h_18cf93ad-f837-4588-b868-b905984873ab/bond-cni-plugin/0.log"
Sep 05 07:03:47.490580 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:47.490557    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvr8h_18cf93ad-f837-4588-b868-b905984873ab/routeoverride-cni/0.log"
Sep 05 07:03:47.513371 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:47.513349    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvr8h_18cf93ad-f837-4588-b868-b905984873ab/whereabouts-cni-bincopy/0.log"
Sep 05 07:03:47.534242 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:47.534218    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvr8h_18cf93ad-f837-4588-b868-b905984873ab/whereabouts-cni/0.log"
Sep 05 07:03:47.582535 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:47.582504    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-r9qv4_665494d6-d2e1-4a6b-b101-d26c750878ab/kube-multus/0.log"
Sep 05 07:03:47.660231 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:47.660168    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fdjjs_d6d27aa9-3777-4509-9ff4-d4c47ffc3485/network-metrics-daemon/0.log"
Sep 05 07:03:47.676991 ip-10-0-137-250 kubenswrapper[2583]: I0905 07:03:47.676969    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fdjjs_d6d27aa9-3777-4509-9ff4-d4c47ffc3485/kube-rbac-proxy/0.log"