Sep 10 23:31:26.059796 ip-10-0-135-1 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 23:31:26.059812 ip-10-0-135-1 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 23:31:26.059821 ip-10-0-135-1 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 23:31:26.060150 ip-10-0-135-1 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 23:31:36.155673 ip-10-0-135-1 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 23:31:36.155692 ip-10-0-135-1 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bfb38dd13e0a4670886648a47b223f17 --
Sep 10 23:33:22.703013 ip-10-0-135-1 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 23:33:23.102167 ip-10-0-135-1 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 23:33:23.102167 ip-10-0-135-1 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 23:33:23.102167 ip-10-0-135-1 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 23:33:23.102167 ip-10-0-135-1 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 23:33:23.102167 ip-10-0-135-1 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 23:33:23.102834 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.102177    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 23:33:23.107612 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107597    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:33:23.107612 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107611    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107615    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107619    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107622    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107625    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107628    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107632    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107636    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107639    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107641    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107644    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107647    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107650    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107652    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107655    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107658    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107661    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107663    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107673    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107675    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:33:23.107679 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107678    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107681    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107684    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107686    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107690    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107693    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107696    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107698    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107701    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107704    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107706    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107723    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107726    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107728    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107731    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107734    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107736    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107739    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107741    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107744    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:33:23.108183 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107747    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107749    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107752    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107755    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107757    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107760    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107763    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107767    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107771    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107774    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107777    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107779    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107782    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107785    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107788    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107791    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107793    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107796    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107799    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107801    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:33:23.108734 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107804    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107808    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107811    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107815    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107818    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107821    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107824    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107826    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107829    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107833    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107836    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107838    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107841    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107844    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107846    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107849    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107851    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107854    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107856    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:33:23.109236 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107859    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107862    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107865    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107868    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107870    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107873    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107876    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107881    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107883    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107886    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107888    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107891    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107894    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107897    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107899    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107902    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107904    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107907    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.107910    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108683    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:33:23.109685 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108695    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108699    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108702    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108705    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108722    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108727    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108730    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108733    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108735    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108738    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108741    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108744    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108747    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108750    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108752    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108755    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108757    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108760    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108763    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:33:23.110179 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108765    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108768    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108770    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108773    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108776    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108779    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108782    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108784    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108787    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108789    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108792    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108795    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108797    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108801    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108804    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108807    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108810    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108812    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108815    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:33:23.110651 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108817    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108820    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108822    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108825    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108827    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108830    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108832    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108835    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108837    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108840    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108842    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108845    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108848    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108851    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108855    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108859    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108862    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108864    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108868    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108870    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:33:23.111142 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108873    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108875    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108878    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108881    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108883    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108888    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108893    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108896    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108899    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108902    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108905    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108908    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108911    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108913    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108916    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108919    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108926    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108930    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108933    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108936    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:33:23.111629 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108939    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108941    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108945    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108947    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108950    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108952    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108955    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108957    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108960    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108962    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108965    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108967    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108970    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108972    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108975    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108977    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108980    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108983    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108986    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:33:23.112159 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.108989    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109343    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109348    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109351    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109354    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109357    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109359    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109362    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109365    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109368    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109370    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109373    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109375    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109378    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109381    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109383    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109386    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109389    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109391    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109394    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:33:23.112633 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109397    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109399    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109402    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109405    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109407    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109410    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109413    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109415    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109417    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109420    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109423    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109426    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109428    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109432    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109434    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109438    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109442    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109445    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109447    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:33:23.113157 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109450    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109454    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109456    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109459    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109461    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109465    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109469    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109472    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109475    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109477    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109480    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109483    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109486    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109489    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109492    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109495    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109497    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109500    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109502    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109505    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:33:23.113670 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109507    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109510    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109512    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109515    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109518    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109520    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109523    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109526    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109528    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109531    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109533    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109536    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109539    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109542    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109545    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109547    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109550    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109552    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109555    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109557    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:33:23.114176 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109560    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109563    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109565    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109568    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109571    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109573    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109580    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109582    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109585    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109588    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109591    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109593    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109596    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109598    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109601    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109605    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109608    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109611    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109614    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109617    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:33:23.114660 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.109621    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109693    2574 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109755    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109763    2574 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109768    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109772    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109775    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109779    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109784    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109787    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109790    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109794    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109797    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109800    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109803    2574 flags.go:64] FLAG: --cgroup-root=""
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109806    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109809    2574 flags.go:64] FLAG: --client-ca-file=""
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109812    2574 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109817    2574 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109821    2574 flags.go:64] FLAG: --cluster-domain=""
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109824    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109828    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109831    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109834    2574 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 23:33:23.115172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109838    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109841    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109845    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109848    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109851    2574 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109854    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109857    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109860    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109863    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109867    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109871    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109874    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109877    2574 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109880    2574 flags.go:64] FLAG: --enable-server="true"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109883    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109890    2574 flags.go:64] FLAG: --event-burst="100"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109893    2574 flags.go:64] FLAG: --event-qps="50"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109897    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109900    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109903    2574 flags.go:64] FLAG: --eviction-hard=""
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109906    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109909    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109912    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109915    2574 flags.go:64] FLAG: --eviction-soft=""
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109918    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 23:33:23.115785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109921    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109925    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109928    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109932    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109934    2574 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109938    2574 flags.go:64] FLAG: --feature-gates=""
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109941    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109944    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109947    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109951    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109953    2574 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109956    2574 flags.go:64] FLAG: --help="false"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109959    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109963    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109965    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109968    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109972    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109976    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109978    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109981    2574 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109984    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109987    2574 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109990    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109993    2574 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 23:33:23.116451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109995    2574 flags.go:64] FLAG: --kube-reserved=""
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.109999    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110002    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110004    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110007    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110010    2574 flags.go:64] FLAG: --lock-file=""
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110013    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110016    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110019    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110025    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110028    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110031    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110034    2574 flags.go:64] FLAG: --logging-format="text"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110036    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110040    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110042    2574 flags.go:64] FLAG: --manifest-url=""
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110045    2574 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110049    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110052    2574 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110056    2574 flags.go:64] FLAG: --max-pods="110"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110059    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110062    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110064    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110067    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110070    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 23:33:23.117133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110073    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110077    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110083    2574 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110086    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110090    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110093    2574 flags.go:64] FLAG: --pod-cidr=""
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110095    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110101    2574 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110104    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110107    2574 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110109    2574 flags.go:64] FLAG: --port="10250"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110112    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110115    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-023c18c013b81571a"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110118    2574 flags.go:64] FLAG: --qos-reserved=""
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110123    2574 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110126    2574 flags.go:64] FLAG: --register-node="true"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110130    2574 flags.go:64] FLAG: --register-with-taints=""
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110134    2574 flags.go:64] FLAG: --registry-burst="10"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110137    2574 flags.go:64] FLAG: --registry-qps="5"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110140    2574 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110143    2574 flags.go:64] FLAG: --reserved-memory=""
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110146    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110149    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110152    2574 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110155    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 23:33:23.117767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110158    2574 flags.go:64] FLAG: --runonce="false"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110161    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110164    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110167    2574 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110170    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110173    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110176    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110179    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110183    2574 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110186    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110189    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110193    2574 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110196    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110199    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110202    2574 flags.go:64] FLAG: --system-cgroups=""
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110205    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110210    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110213    2574 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110216    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110220    2574 flags.go:64] FLAG: --tls-min-version=""
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110222    2574 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110227    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110231    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110235    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110238    2574 flags.go:64] FLAG: --v="2"
Sep 10 23:33:23.118389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110241    2574 flags.go:64] FLAG: --version="false"
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110245    2574 flags.go:64] FLAG: --vmodule=""
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110249    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.110252    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110364    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110368    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110371    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110375    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110378    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110380    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110383    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110386    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110389    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110392    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110395    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110398    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110401    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110405    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110409    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110413    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:33:23.119107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110416    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110419    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110422    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110424    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110428    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110432    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110435    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110437    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110442    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110445    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110449    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110451    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110454    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110457    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110459    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110462    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110465    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110467    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110470    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:33:23.119603 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110473    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110476    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110479    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110482    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110486    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110489    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110491    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110494    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110497    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110499    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110502    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110505    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110508    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110511    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110514    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110516    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110519    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110521    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110524    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:33:23.120094 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110526    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110529    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110533    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110535    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110541    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110545    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110549    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110553    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110556    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110558    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110561    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110564    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110566    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110569    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110572    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110574    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110577    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110579    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110582    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110585    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:33:23.120577 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110588    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110590    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110593    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110595    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110598    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110601    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110603    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110606    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110609    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110611    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110614    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110616    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110619    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110622    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110626    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110629    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110633    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110636    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110639    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110642    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:33:23.121107 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110644    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110647    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110649    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110652    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.110655    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.111228    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.118294    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.118314    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.119097    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.119104    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119174    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119179    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119183    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119186    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119189    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:33:23.121599 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119192    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119195    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119198    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119200    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119203    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119206    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119208    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119210    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119213    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119216    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119218    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119221    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119224    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119227    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119229    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119232    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119234    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119237    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119240    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:33:23.121989 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119244    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119249    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119252    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119255    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119258    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119267    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119271    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119274    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119276    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119279    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119282    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119285    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119287    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119290    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119293    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119295    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119298    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119300    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119303    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:33:23.122477 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119306    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119308    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119311    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119313    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119316    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119318    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119321    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119324    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119326    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119329    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119332    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119334    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119337    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119339    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119342    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119345    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119347    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119350    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119353    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119361    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:33:23.122999 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119364    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119366    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119369    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119372    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119377    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119380    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119383    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119385    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119388    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119390    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119393    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119395    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119398    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119400    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119403    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119405    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119407    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119410    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119413    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119415    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:33:23.123516 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119418    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119420    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119423    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119425    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119428    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119431    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119433    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119436    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119438    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119442    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119446    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119449    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119457    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119466    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119469    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:33:23.124010 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119472    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.119477    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119645    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119649    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119652    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119655    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119658    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119660    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119663    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119665    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119668    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119670    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119673    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119675    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119678    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:33:23.124380 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119681    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119683    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119686    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119688    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119691    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119693    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119696    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119698    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119701    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119704    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119706    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119721    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119725    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119728    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119730    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119739    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119742    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119745    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119747    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119750    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:33:23.124773 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119752    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119755    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119757    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119760    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119762    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119766    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119769    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119772    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119775    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119779    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119782    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119785    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119788    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119791    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119794    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119796    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119799    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119801    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119804    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:33:23.125272 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119806    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119809    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119812    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119814    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119817    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119820    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119822    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119825    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119828    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119836    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119838    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119841    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119843    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119846    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119848    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119851    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119854    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119856    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119859    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119861    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:33:23.125791 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119864    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119866    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119869    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119871    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119873    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119876    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119879    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119881    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119884    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119886    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119889    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119891    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119894    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119897    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119900    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119902    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119905    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119907    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119910    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119912    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:33:23.126305 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119915    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:33:23.127051 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119918    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:33:23.127051 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119925    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:33:23.127051 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119928    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:33:23.127051 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119931    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:33:23.127051 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119933    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:33:23.127051 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:23.119935    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:33:23.127051 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.119941    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 23:33:23.127051 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.120069    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 23:33:23.127051 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.122166    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 23:33:23.127051 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.123082    2574 server.go:1019] "Starting client certificate rotation"
Sep 10 23:33:23.127051 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.123182    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 23:33:23.127051 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.123242    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 23:33:23.127051 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.125432    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 23:33:23.128799 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.128744    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 23:33:23.139554 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.139533    2574 log.go:25] "Validated CRI v1 runtime API"
Sep 10 23:33:23.142161 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.142146    2574 log.go:25] "Validated CRI v1 image API"
Sep 10 23:33:23.143072 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.143057    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 23:33:23.146399 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.146380    2574 fs.go:135] Filesystem UUIDs: map[144ed9e1-1ab2-4d46-9725-e86b76a3565f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 88bd9371-8779-4abc-a614-daa5355dd9cc:/dev/nvme0n1p3]
Sep 10 23:33:23.146453 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.146399    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 23:33:23.150778 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.150761    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 23:33:23.151472 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.151370    2574 manager.go:216] Machine: {Timestamp:2026-09-10 23:33:23.150071919 +0000 UTC m=+0.332230039 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114464 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec204314440cf7eb75a321366a016b95 SystemUUID:ec204314-440c-f7eb-75a3-21366a016b95 BootID:bfb38dd1-3e0a-4670-8866-48a47b223f17 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e8:36:5d:38:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e8:36:5d:38:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:bf:de:cf:76:48 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 23:33:23.151472 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.151471    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 23:33:23.151560 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.151544    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 23:33:23.154474 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.154451    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 23:33:23.154606 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.154478    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 23:33:23.155154 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.155144    2574 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 23:33:23.155184 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.155157    2574 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 23:33:23.155184 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.155164    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 23:33:23.155811 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.155801    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 23:33:23.156534 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.156526    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 23:33:23.160476 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.160465    2574 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 23:33:23.160598 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.160588    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 23:33:23.160635 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.160625    2574 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 23:33:23.160670 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.160645    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 23:33:23.160670 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.160656    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 23:33:23.160739 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.160687    2574 kubelet.go:398] "Adding apiserver pod source"
Sep 10 23:33:23.160739 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.160699    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 23:33:23.161759 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.161745    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 23:33:23.161817 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.161771    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 23:33:23.166270 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.166243    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 23:33:23.171779 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.171760    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 23:33:23.171840 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.171795    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 23:33:23.172830 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.172806    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 23:33:23.172830 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.172807    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 23:33:23.173802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.173786    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 23:33:23.173863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.173806    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 23:33:23.173863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.173813    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 23:33:23.173863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.173817    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 23:33:23.173863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.173826    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 23:33:23.173863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.173831    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 23:33:23.173863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.173844    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 23:33:23.173863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.173849    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 23:33:23.173863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.173856    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 23:33:23.173863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.173861    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 23:33:23.174113 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.173870    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 23:33:23.174113 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.173875    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 23:33:23.174571 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.174562    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 23:33:23.174571 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.174570    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 23:33:23.176498 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.176484    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-1.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 23:33:23.178029 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.178016    2574 server.go:1268] "Started kubelet"
Sep 10 23:33:23.178136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.178101    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 23:33:23.178136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.178104    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 23:33:23.178283 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.178172    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 23:33:23.178451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.178435    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8cvf8"
Sep 10 23:33:23.178920 ip-10-0-135-1 systemd[1]: Started Kubernetes Kubelet.
Sep 10 23:33:23.180814 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.180129    2574 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 23:33:23.181352 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.181338    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 23:33:23.184976 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.184920    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 23:33:23.185294 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.185279    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 23:33:23.185739 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.185725    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 23:33:23.187004 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.186018    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-1.ec2.internal\" not found"
Sep 10 23:33:23.187004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.186091    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8cvf8"
Sep 10 23:33:23.187004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.186465    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 23:33:23.187004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.186496    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 23:33:23.187004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.186519    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 23:33:23.187004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.186642    2574 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 23:33:23.187004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.186650    2574 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 23:33:23.187458 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.187348    2574 factory.go:55] Registering systemd factory
Sep 10 23:33:23.187458 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.187365    2574 factory.go:223] Registration of the systemd container factory successfully
Sep 10 23:33:23.187605 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.187589    2574 factory.go:153] Registering CRI-O factory
Sep 10 23:33:23.187605 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.187604    2574 factory.go:223] Registration of the crio container factory successfully
Sep 10 23:33:23.187769 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.187662    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 23:33:23.187769 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.187706    2574 factory.go:103] Registering Raw factory
Sep 10 23:33:23.187769 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.187753    2574 manager.go:1196] Started watching for new ooms in manager
Sep 10 23:33:23.188344 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.188324    2574 manager.go:349] Starting recovery of all containers
Sep 10 23:33:23.192884 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.192863    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 23:33:23.193010 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.192991    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 23:33:23.193577 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.192552    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-1.ec2.internal.18d419b1bf0ab86b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-1.ec2.internal,UID:ip-10-0-135-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-1.ec2.internal,},FirstTimestamp:2026-09-10 23:33:23.177986155 +0000 UTC m=+0.360144274,LastTimestamp:2026-09-10 23:33:23.177986155 +0000 UTC m=+0.360144274,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-1.ec2.internal,}"
Sep 10 23:33:23.199730 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.199603    2574 manager.go:354] Recovery completed
Sep 10 23:33:23.205266 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.205251    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:23.206886 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.206868    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:23.206942 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.206897    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:23.206942 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.206909    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:23.207462 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.207449    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 23:33:23.207462 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.207460    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 23:33:23.207634 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.207474    2574 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 23:33:23.207634 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.207517    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:23.208226 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.208211    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:23.208304 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.208241    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:23.208304 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.208255    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:23.208611 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.208597    2574 policy_none.go:49] "None policy: Start"
Sep 10 23:33:23.208653 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.208614    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 23:33:23.208653 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.208624    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 23:33:23.209460 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.209449    2574 policy_none.go:47] "Start"
Sep 10 23:33:23.238351 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.238337    2574 manager.go:337] "Starting Device Plugin manager"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.238387    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.238401    2574 server.go:87] "Starting device plugin registration server"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.238642    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.238651    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.238788    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.238863    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.238873    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.239531    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.239584    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-1.ec2.internal\" not found"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.248514    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.249621    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.249661    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.249678    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.249766    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 23:33:23.252116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.251530    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:33:23.339688 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.339665    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:23.340589 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.340574    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:23.340672 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.340607    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:23.340672 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.340617    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:23.340672 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.340637    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.348733 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.348704    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.348838 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.348742    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-1.ec2.internal\": node \"ip-10-0-135-1.ec2.internal\" not found"
Sep 10 23:33:23.350417 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.350395    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-1.ec2.internal"]
Sep 10 23:33:23.350467 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.350459    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:23.351782 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.351760    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:23.351846 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.351785    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:23.351846 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.351799    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:23.353360 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.353294    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:23.353435 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.353386    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.353469 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.353435    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:23.353989 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.353975    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:23.354052 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.354003    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:23.354052 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.354013    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:23.354138 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.354049    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:23.354138 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.354073    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:23.354138 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.354087    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:23.355549 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.355534    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.355605 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.355567    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:23.356816 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.356798    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:23.356894 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.356826    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:23.356894 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.356836    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:23.363507 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.363493    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-1.ec2.internal\" not found"
Sep 10 23:33:23.388447 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.388429    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d41ca270205501ca8a2b3a06f04b5b69-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal\" (UID: \"d41ca270205501ca8a2b3a06f04b5b69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.388533 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.388452    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d41ca270205501ca8a2b3a06f04b5b69-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal\" (UID: \"d41ca270205501ca8a2b3a06f04b5b69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.388533 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.388471    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c136d63f0f74198e85586854afa827e1-config\") pod \"kube-apiserver-proxy-ip-10-0-135-1.ec2.internal\" (UID: \"c136d63f0f74198e85586854afa827e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.392265 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.392251    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-1.ec2.internal\" not found" node="ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.395641 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.395625    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-1.ec2.internal\" not found" node="ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.463998 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.463980    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-1.ec2.internal\" not found"
Sep 10 23:33:23.489323 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.489299    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d41ca270205501ca8a2b3a06f04b5b69-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal\" (UID: \"d41ca270205501ca8a2b3a06f04b5b69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.489412 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.489330    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d41ca270205501ca8a2b3a06f04b5b69-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal\" (UID: \"d41ca270205501ca8a2b3a06f04b5b69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.489412 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.489360    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c136d63f0f74198e85586854afa827e1-config\") pod \"kube-apiserver-proxy-ip-10-0-135-1.ec2.internal\" (UID: \"c136d63f0f74198e85586854afa827e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.489412 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.489389    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d41ca270205501ca8a2b3a06f04b5b69-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal\" (UID: \"d41ca270205501ca8a2b3a06f04b5b69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.489525 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.489415    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c136d63f0f74198e85586854afa827e1-config\") pod \"kube-apiserver-proxy-ip-10-0-135-1.ec2.internal\" (UID: \"c136d63f0f74198e85586854afa827e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.489525 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.489392    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d41ca270205501ca8a2b3a06f04b5b69-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal\" (UID: \"d41ca270205501ca8a2b3a06f04b5b69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.564701 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.564669    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-1.ec2.internal\" not found"
Sep 10 23:33:23.665375 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.665346    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-1.ec2.internal\" not found"
Sep 10 23:33:23.694828 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.694812    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.698978 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:23.698961    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:23.765744 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.765698    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-1.ec2.internal\" not found"
Sep 10 23:33:23.866175 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.866151    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-1.ec2.internal\" not found"
Sep 10 23:33:23.966721 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:23.966648    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-1.ec2.internal\" not found"
Sep 10 23:33:24.067095 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:24.067072    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-1.ec2.internal\" not found"
Sep 10 23:33:24.122482 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:24.122456    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 23:33:24.122884 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:24.122600    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 23:33:24.159888 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:24.159866    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:33:24.168056 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:24.168036    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-1.ec2.internal\" not found"
Sep 10 23:33:24.191143 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:24.191110    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 23:28:23 +0000 UTC" deadline="2028-03-15 19:07:24.85660214 +0000 UTC"
Sep 10 23:33:24.191143 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:24.191137    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13243h34m0.6654698s"
Sep 10 23:33:24.269183 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:24.269157    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-1.ec2.internal\" not found"
Sep 10 23:33:24.283508 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:24.283486    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:33:24.286532 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:24.286512    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:24.298220 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:24.298199    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 23:33:24.300019 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:24.300005    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-1.ec2.internal"
Sep 10 23:33:24.308669 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:24.308655    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 23:33:24.331359 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:24.331330    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc136d63f0f74198e85586854afa827e1.slice/crio-b7b65bcd5a34d89f859ab73587b3c1021f2b7999de07b78934ef677b3881cf54 WatchSource:0}: Error finding container b7b65bcd5a34d89f859ab73587b3c1021f2b7999de07b78934ef677b3881cf54: Status 404 returned error can't find the container with id b7b65bcd5a34d89f859ab73587b3c1021f2b7999de07b78934ef677b3881cf54
Sep 10 23:33:24.331631 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:24.331615    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41ca270205501ca8a2b3a06f04b5b69.slice/crio-87d01754af684e9d0f4d9bbc34d1045d08182688f60be81e6ebb2d8a1c88082e WatchSource:0}: Error finding container 87d01754af684e9d0f4d9bbc34d1045d08182688f60be81e6ebb2d8a1c88082e: Status 404 returned error can't find the container with id 87d01754af684e9d0f4d9bbc34d1045d08182688f60be81e6ebb2d8a1c88082e
Sep 10 23:33:24.337981 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:24.337966    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:33:24.673964 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:24.673935    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:33:24.976135 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:24.976054    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:33:25.161803 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.161770    2574 apiserver.go:52] "Watching apiserver"
Sep 10 23:33:25.172990 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.172949    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 23:33:25.173437 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.173411    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-nhqwd","openshift-ovn-kubernetes/ovnkube-node-tzxwx","kube-system/kube-apiserver-proxy-ip-10-0-135-1.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45","openshift-cluster-node-tuning-operator/tuned-v9mjd","openshift-dns/node-resolver-hpfc4","openshift-image-registry/node-ca-9zd99","openshift-multus/multus-additional-cni-plugins-phlkq","openshift-multus/multus-jrqbg","openshift-network-diagnostics/network-check-target-dnpld","kube-system/global-pull-secret-syncer-w8hxs","kube-system/konnectivity-agent-2gmzl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal","openshift-multus/network-metrics-daemon-4k2jt"]
Sep 10 23:33:25.175375 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.175349    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.176943 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.176793    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:25.176943 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.176875    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:25.178192 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.178162    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:25.178292 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.178242    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:25.178672 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.178408    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 23:33:25.178672 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.178416    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 23:33:25.178672 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.178435    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n6ngn\""
Sep 10 23:33:25.178672 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.178519    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 23:33:25.178672 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.178408    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 23:33:25.179039 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.178789    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 23:33:25.180559 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.179936    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nhqwd"
Sep 10 23:33:25.180651 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.180573    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.181867 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.181847    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hpfc4"
Sep 10 23:33:25.182391 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.182296    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 23:33:25.182481 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.182427    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 23:33:25.182545 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.182480    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:33:25.182995 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.182973    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m8xmb\""
Sep 10 23:33:25.183291 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.183271    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9zd99"
Sep 10 23:33:25.183369 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.183339    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vrz9f\""
Sep 10 23:33:25.183443 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.183389    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 23:33:25.183507 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.183485    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 23:33:25.183640 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.183617    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 23:33:25.184023 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.184006    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 23:33:25.184397 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.184264    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 23:33:25.184397 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.184278    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8g5v7\""
Sep 10 23:33:25.184559 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.184546    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.186201 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.185519    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 23:33:25.186201 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.185595    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 23:33:25.186201 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.185786    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-94hwz\""
Sep 10 23:33:25.186201 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.185963    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 23:33:25.186410 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.186271    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 23:33:25.186986 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.186715    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:33:25.186986 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.186864    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cz6s9\""
Sep 10 23:33:25.187126 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.186990    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.187126 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.187028    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 23:33:25.188099 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.188074    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:25.188208 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.188135    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:25.189289 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.189269    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jrgl2\""
Sep 10 23:33:25.189391 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.189335    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 23:33:25.189710 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.189656    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2gmzl"
Sep 10 23:33:25.191292 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.191264    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.192050 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.192032    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 23:33:25.192156 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.192116    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 23:33:25.192245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.192222    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r64n4\""
Sep 10 23:33:25.194405 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.194384    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 23:33:25.195267 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.195200    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 23:33:25.195380 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.195279    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 23:33:25.195380 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.195343    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w4lw6\""
Sep 10 23:33:25.195494 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.195414    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 23:33:25.195657 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.195634    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 23:33:25.195657 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.195650    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 23:33:25.198497 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.198472    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n9l7\" (UniqueName: \"kubernetes.io/projected/4fc47980-023d-4262-b0ce-d1e7e00e555d-kube-api-access-2n9l7\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.198609 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.198512    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-var-lib-cni-multus\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.198609 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.198544    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-kubernetes\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.198609 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.198569    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-run\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.198768 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.198639    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-registration-dir\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.199043 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.199007    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-device-dir\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.199200 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.199125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-multus-cni-dir\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.199270 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.199194    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kszx\" (UniqueName: \"kubernetes.io/projected/ff418d0b-69db-4755-8f64-656dcd13841b-kube-api-access-4kszx\") pod \"node-resolver-hpfc4\" (UID: \"ff418d0b-69db-4755-8f64-656dcd13841b\") " pod="openshift-dns/node-resolver-hpfc4"
Sep 10 23:33:25.199322 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.199265    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-sys\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.199358 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.199333    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03930709-78f9-49ae-bd6f-f9a6481c8e8f-cnibin\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.199404 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.199376    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-var-lib-kubelet\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.199465 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.199430    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-host\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.199519 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.199471    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03930709-78f9-49ae-bd6f-f9a6481c8e8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.199574 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.199516    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03930709-78f9-49ae-bd6f-f9a6481c8e8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.199574 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.199555    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-sys-fs\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.199674 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.199631    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-multus-conf-dir\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.199735 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.199707    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e04c068a-47d1-4208-b12f-4b25d729bf33-dbus\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:25.201421 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.201089    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz5ql\" (UniqueName: \"kubernetes.io/projected/a17767f6-d38b-4500-9986-fae0a8436062-kube-api-access-fz5ql\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.201421 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.201118    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-var-lib-kubelet\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.201421 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.201241    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4fc47980-023d-4262-b0ce-d1e7e00e555d-multus-daemon-config\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.201261    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-run-multus-certs\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.201958    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-system-cni-dir\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.201994    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/16227dff-3d81-4c11-98a6-7ff11e1d2ca4-host\") pod \"node-ca-9zd99\" (UID: \"16227dff-3d81-4c11-98a6-7ff11e1d2ca4\") " pod="openshift-image-registry/node-ca-9zd99"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-sysconfig\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202174    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202149    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03930709-78f9-49ae-bd6f-f9a6481c8e8f-system-cni-dir\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202305    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr7w7\" (UniqueName: \"kubernetes.io/projected/03930709-78f9-49ae-bd6f-f9a6481c8e8f-kube-api-access-zr7w7\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202367    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff418d0b-69db-4755-8f64-656dcd13841b-hosts-file\") pod \"node-resolver-hpfc4\" (UID: \"ff418d0b-69db-4755-8f64-656dcd13841b\") " pod="openshift-dns/node-resolver-hpfc4"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202473    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-var-lib-cni-bin\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202489    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ec31db2-a7b5-4d09-8871-4eea9449069c-tmp\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202591    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202688    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-sysctl-d\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202815    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a608109-2405-400e-af96-52621631a0f1-iptables-alerter-script\") pod \"iptables-alerter-nhqwd\" (UID: \"2a608109-2405-400e-af96-52621631a0f1\") " pod="openshift-network-operator/iptables-alerter-nhqwd"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202850    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fc47980-023d-4262-b0ce-d1e7e00e555d-cni-binary-copy\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202877    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff418d0b-69db-4755-8f64-656dcd13841b-tmp-dir\") pod \"node-resolver-hpfc4\" (UID: \"ff418d0b-69db-4755-8f64-656dcd13841b\") " pod="openshift-dns/node-resolver-hpfc4"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202938    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a608109-2405-400e-af96-52621631a0f1-host-slash\") pod \"iptables-alerter-nhqwd\" (UID: \"2a608109-2405-400e-af96-52621631a0f1\") " pod="openshift-network-operator/iptables-alerter-nhqwd"
Sep 10 23:33:25.204190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.202957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-run-k8s-cni-cncf-io\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203063    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-hostroot\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203101    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8xng\" (UniqueName: \"kubernetes.io/projected/16227dff-3d81-4c11-98a6-7ff11e1d2ca4-kube-api-access-v8xng\") pod \"node-ca-9zd99\" (UID: \"16227dff-3d81-4c11-98a6-7ff11e1d2ca4\") " pod="openshift-image-registry/node-ca-9zd99"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203154    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnd6c\" (UniqueName: \"kubernetes.io/projected/0ec31db2-a7b5-4d09-8871-4eea9449069c-kube-api-access-vnd6c\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203183    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e04c068a-47d1-4208-b12f-4b25d729bf33-kubelet-config\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203243    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03930709-78f9-49ae-bd6f-f9a6481c8e8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203274    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6tjl\" (UniqueName: \"kubernetes.io/projected/19caec11-5b78-4352-8b17-90d56d69a7de-kube-api-access-v6tjl\") pod \"network-metrics-daemon-4k2jt\" (UID: \"19caec11-5b78-4352-8b17-90d56d69a7de\") " pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203326    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-etc-kubernetes\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203360    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-sysctl-conf\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203384    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-etc-selinux\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203414    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/16227dff-3d81-4c11-98a6-7ff11e1d2ca4-serviceca\") pod \"node-ca-9zd99\" (UID: \"16227dff-3d81-4c11-98a6-7ff11e1d2ca4\") " pod="openshift-image-registry/node-ca-9zd99"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203446    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203571    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-cnibin\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203637    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-multus-socket-dir-parent\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203670    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-run-netns\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203720    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-systemd\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.205116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203826    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03930709-78f9-49ae-bd6f-f9a6481c8e8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.206009 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.203886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-modprobe-d\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.206009 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.204004    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-lib-modules\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.206009 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.204039    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-tuned\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.206009 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.204350    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs\") pod \"network-metrics-daemon-4k2jt\" (UID: \"19caec11-5b78-4352-8b17-90d56d69a7de\") " pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:25.206009 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.204393    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m72vl\" (UniqueName: \"kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl\") pod \"network-check-target-dnpld\" (UID: \"de7f431b-9317-47c1-a505-0fa7a1a7aeb4\") " pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:25.206009 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.204453    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cz9g\" (UniqueName: \"kubernetes.io/projected/2a608109-2405-400e-af96-52621631a0f1-kube-api-access-7cz9g\") pod \"iptables-alerter-nhqwd\" (UID: \"2a608109-2405-400e-af96-52621631a0f1\") " pod="openshift-network-operator/iptables-alerter-nhqwd"
Sep 10 23:33:25.206009 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.204487    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-socket-dir\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.218179 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.218158    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kw9hv"
Sep 10 23:33:25.226376 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.226320    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kw9hv"
Sep 10 23:33:25.256246 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.256119    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-1.ec2.internal" event={"ID":"c136d63f0f74198e85586854afa827e1","Type":"ContainerStarted","Data":"b7b65bcd5a34d89f859ab73587b3c1021f2b7999de07b78934ef677b3881cf54"}
Sep 10 23:33:25.257821 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.257794    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal" event={"ID":"d41ca270205501ca8a2b3a06f04b5b69","Type":"ContainerStarted","Data":"87d01754af684e9d0f4d9bbc34d1045d08182688f60be81e6ebb2d8a1c88082e"}
Sep 10 23:33:25.288423 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.288398    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 23:33:25.304959 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.304928    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/16227dff-3d81-4c11-98a6-7ff11e1d2ca4-host\") pod \"node-ca-9zd99\" (UID: \"16227dff-3d81-4c11-98a6-7ff11e1d2ca4\") " pod="openshift-image-registry/node-ca-9zd99"
Sep 10 23:33:25.305074 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.304970    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-sysconfig\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.305074 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.304990    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03930709-78f9-49ae-bd6f-f9a6481c8e8f-system-cni-dir\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.305074 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305051    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03930709-78f9-49ae-bd6f-f9a6481c8e8f-system-cni-dir\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.305074 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305056    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/16227dff-3d81-4c11-98a6-7ff11e1d2ca4-host\") pod \"node-ca-9zd99\" (UID: \"16227dff-3d81-4c11-98a6-7ff11e1d2ca4\") " pod="openshift-image-registry/node-ca-9zd99"
Sep 10 23:33:25.305282 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305090    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-sysconfig\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.305282 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305106    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr7w7\" (UniqueName: \"kubernetes.io/projected/03930709-78f9-49ae-bd6f-f9a6481c8e8f-kube-api-access-zr7w7\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.305282 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305142    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff418d0b-69db-4755-8f64-656dcd13841b-hosts-file\") pod \"node-resolver-hpfc4\" (UID: \"ff418d0b-69db-4755-8f64-656dcd13841b\") " pod="openshift-dns/node-resolver-hpfc4"
Sep 10 23:33:25.305282 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305172    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-node-log\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.305282 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305253    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff418d0b-69db-4755-8f64-656dcd13841b-hosts-file\") pod \"node-resolver-hpfc4\" (UID: \"ff418d0b-69db-4755-8f64-656dcd13841b\") " pod="openshift-dns/node-resolver-hpfc4"
Sep 10 23:33:25.305520 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305333    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83dc92c5-fb74-4c28-babb-0259c9c4efd4-ovnkube-config\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.305520 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305367    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-var-lib-cni-bin\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.305520 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ec31db2-a7b5-4d09-8871-4eea9449069c-tmp\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.305520 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305422    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.305520 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305458    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-log-socket\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.305520 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305470    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-var-lib-cni-bin\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.305520 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305484    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83dc92c5-fb74-4c28-babb-0259c9c4efd4-ovnkube-script-lib\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.305876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305535    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.305876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305521    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-sysctl-d\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.305876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a608109-2405-400e-af96-52621631a0f1-iptables-alerter-script\") pod \"iptables-alerter-nhqwd\" (UID: \"2a608109-2405-400e-af96-52621631a0f1\") " pod="openshift-network-operator/iptables-alerter-nhqwd"
Sep 10 23:33:25.305876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305605    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fc47980-023d-4262-b0ce-d1e7e00e555d-cni-binary-copy\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.305876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305652    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff418d0b-69db-4755-8f64-656dcd13841b-tmp-dir\") pod \"node-resolver-hpfc4\" (UID: \"ff418d0b-69db-4755-8f64-656dcd13841b\") " pod="openshift-dns/node-resolver-hpfc4"
Sep 10 23:33:25.305876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305679    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-kubelet\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.305876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305715    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-slash\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.305876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83dc92c5-fb74-4c28-babb-0259c9c4efd4-ovn-node-metrics-cert\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.305876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305756    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-sysctl-d\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.305876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305783    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a608109-2405-400e-af96-52621631a0f1-host-slash\") pod \"iptables-alerter-nhqwd\" (UID: \"2a608109-2405-400e-af96-52621631a0f1\") " pod="openshift-network-operator/iptables-alerter-nhqwd"
Sep 10 23:33:25.305876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305813    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-run-k8s-cni-cncf-io\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.305876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305840    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-hostroot\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.305876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305865    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8xng\" (UniqueName: \"kubernetes.io/projected/16227dff-3d81-4c11-98a6-7ff11e1d2ca4-kube-api-access-v8xng\") pod \"node-ca-9zd99\" (UID: \"16227dff-3d81-4c11-98a6-7ff11e1d2ca4\") " pod="openshift-image-registry/node-ca-9zd99"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305893    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305922    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnd6c\" (UniqueName: \"kubernetes.io/projected/0ec31db2-a7b5-4d09-8871-4eea9449069c-kube-api-access-vnd6c\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305949    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e04c068a-47d1-4208-b12f-4b25d729bf33-kubelet-config\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305975    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03930709-78f9-49ae-bd6f-f9a6481c8e8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.305975    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a608109-2405-400e-af96-52621631a0f1-host-slash\") pod \"iptables-alerter-nhqwd\" (UID: \"2a608109-2405-400e-af96-52621631a0f1\") " pod="openshift-network-operator/iptables-alerter-nhqwd"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306006    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6tjl\" (UniqueName: \"kubernetes.io/projected/19caec11-5b78-4352-8b17-90d56d69a7de-kube-api-access-v6tjl\") pod \"network-metrics-daemon-4k2jt\" (UID: \"19caec11-5b78-4352-8b17-90d56d69a7de\") " pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306036    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-etc-kubernetes\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306057    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff418d0b-69db-4755-8f64-656dcd13841b-tmp-dir\") pod \"node-resolver-hpfc4\" (UID: \"ff418d0b-69db-4755-8f64-656dcd13841b\") " pod="openshift-dns/node-resolver-hpfc4"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306072    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-cni-bin\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306124    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-run-k8s-cni-cncf-io\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306159    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-etc-kubernetes\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306222    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306310    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-hostroot\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306350    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-sysctl-conf\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306377    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-etc-selinux\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306411    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/16227dff-3d81-4c11-98a6-7ff11e1d2ca4-serviceca\") pod \"node-ca-9zd99\" (UID: \"16227dff-3d81-4c11-98a6-7ff11e1d2ca4\") " pod="openshift-image-registry/node-ca-9zd99"
Sep 10 23:33:25.306456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306450    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-run-ovn-kubernetes\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306470    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306512    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-cnibin\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306528    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-multus-socket-dir-parent\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306554    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-run-netns\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306612    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-systemd-units\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306623    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-run-netns\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306671    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-cnibin\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306669    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-sysctl-conf\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306696    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-etc-openvswitch\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306685    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fc47980-023d-4262-b0ce-d1e7e00e555d-cni-binary-copy\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306717    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03930709-78f9-49ae-bd6f-f9a6481c8e8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306804    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e04c068a-47d1-4208-b12f-4b25d729bf33-kubelet-config\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306850    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-systemd\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306869    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-multus-socket-dir-parent\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306875    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-etc-selinux\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.306873    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306885    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03930709-78f9-49ae-bd6f-f9a6481c8e8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.307357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306922    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-systemd\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.306959    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a608109-2405-400e-af96-52621631a0f1-iptables-alerter-script\") pod \"iptables-alerter-nhqwd\" (UID: \"2a608109-2405-400e-af96-52621631a0f1\") " pod="openshift-network-operator/iptables-alerter-nhqwd"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307052    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-run-openvswitch\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307102    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-modprobe-d\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307124    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/16227dff-3d81-4c11-98a6-7ff11e1d2ca4-serviceca\") pod \"node-ca-9zd99\" (UID: \"16227dff-3d81-4c11-98a6-7ff11e1d2ca4\") " pod="openshift-image-registry/node-ca-9zd99"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-lib-modules\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.307185    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret podName:e04c068a-47d1-4208-b12f-4b25d729bf33 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:25.80712837 +0000 UTC m=+2.989286495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret") pod "global-pull-secret-syncer-w8hxs" (UID: "e04c068a-47d1-4208-b12f-4b25d729bf33") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307230    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-lib-modules\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307229    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-modprobe-d\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307291    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-tuned\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307320    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs\") pod \"network-metrics-daemon-4k2jt\" (UID: \"19caec11-5b78-4352-8b17-90d56d69a7de\") " pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307350    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72vl\" (UniqueName: \"kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl\") pod \"network-check-target-dnpld\" (UID: \"de7f431b-9317-47c1-a505-0fa7a1a7aeb4\") " pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307364    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03930709-78f9-49ae-bd6f-f9a6481c8e8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307375    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cz9g\" (UniqueName: \"kubernetes.io/projected/2a608109-2405-400e-af96-52621631a0f1-kube-api-access-7cz9g\") pod \"iptables-alerter-nhqwd\" (UID: \"2a608109-2405-400e-af96-52621631a0f1\") " pod="openshift-network-operator/iptables-alerter-nhqwd"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.307572    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307600    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-socket-dir\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.308318 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.307661    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs podName:19caec11-5b78-4352-8b17-90d56d69a7de nodeName:}" failed. No retries permitted until 2026-09-10 23:33:25.8076217 +0000 UTC m=+2.989779829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs") pod "network-metrics-daemon-4k2jt" (UID: "19caec11-5b78-4352-8b17-90d56d69a7de") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307688    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9l7\" (UniqueName: \"kubernetes.io/projected/4fc47980-023d-4262-b0ce-d1e7e00e555d-kube-api-access-2n9l7\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307746    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-socket-dir\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307751    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-var-lib-cni-multus\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-kubernetes\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307792    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-var-lib-cni-multus\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307821    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-run\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307878    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-run\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307879    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-registration-dir\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307928    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-registration-dir\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307917    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-device-dir\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-multus-cni-dir\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307977    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-device-dir\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.307966    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-kubernetes\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kszx\" (UniqueName: \"kubernetes.io/projected/ff418d0b-69db-4755-8f64-656dcd13841b-kube-api-access-4kszx\") pod \"node-resolver-hpfc4\" (UID: \"ff418d0b-69db-4755-8f64-656dcd13841b\") " pod="openshift-dns/node-resolver-hpfc4"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308033    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-var-lib-openvswitch\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308070    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-sys\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.309203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308075    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-multus-cni-dir\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308092    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03930709-78f9-49ae-bd6f-f9a6481c8e8f-cnibin\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308116    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-run-ovn\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308143    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-cni-netd\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308151    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03930709-78f9-49ae-bd6f-f9a6481c8e8f-cnibin\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308159    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-run-netns\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308239    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-sys\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308230    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-var-lib-kubelet\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308325    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-var-lib-kubelet\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308333    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-host\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308381    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03930709-78f9-49ae-bd6f-f9a6481c8e8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308418    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ec31db2-a7b5-4d09-8871-4eea9449069c-host\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308419    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03930709-78f9-49ae-bd6f-f9a6481c8e8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308958    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-sys-fs\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.308994    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-multus-conf-dir\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309021    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-run-systemd\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309065    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e04c068a-47d1-4208-b12f-4b25d729bf33-dbus\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:25.310160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309099    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28186efb-cfb3-4d1b-9224-e81db5a3ec1b-agent-certs\") pod \"konnectivity-agent-2gmzl\" (UID: \"28186efb-cfb3-4d1b-9224-e81db5a3ec1b\") " pod="kube-system/konnectivity-agent-2gmzl"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28186efb-cfb3-4d1b-9224-e81db5a3ec1b-konnectivity-ca\") pod \"konnectivity-agent-2gmzl\" (UID: \"28186efb-cfb3-4d1b-9224-e81db5a3ec1b\") " pod="kube-system/konnectivity-agent-2gmzl"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309154    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83dc92c5-fb74-4c28-babb-0259c9c4efd4-env-overrides\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5nc4\" (UniqueName: \"kubernetes.io/projected/83dc92c5-fb74-4c28-babb-0259c9c4efd4-kube-api-access-d5nc4\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309208    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz5ql\" (UniqueName: \"kubernetes.io/projected/a17767f6-d38b-4500-9986-fae0a8436062-kube-api-access-fz5ql\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309272    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-var-lib-kubelet\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309299    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4fc47980-023d-4262-b0ce-d1e7e00e555d-multus-daemon-config\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309327    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-run-multus-certs\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309352    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-system-cni-dir\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309447    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-system-cni-dir\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309479    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e04c068a-47d1-4208-b12f-4b25d729bf33-dbus\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309503    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-var-lib-kubelet\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a17767f6-d38b-4500-9986-fae0a8436062-sys-fs\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309579    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03930709-78f9-49ae-bd6f-f9a6481c8e8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309592    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-multus-conf-dir\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.309690    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4fc47980-023d-4262-b0ce-d1e7e00e555d-host-run-multus-certs\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.310005    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4fc47980-023d-4262-b0ce-d1e7e00e555d-multus-daemon-config\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.311004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.310183    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03930709-78f9-49ae-bd6f-f9a6481c8e8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.311987 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.311075    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ec31db2-a7b5-4d09-8871-4eea9449069c-tmp\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.311987 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.311189    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ec31db2-a7b5-4d09-8871-4eea9449069c-etc-tuned\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.314824 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.314096    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr7w7\" (UniqueName: \"kubernetes.io/projected/03930709-78f9-49ae-bd6f-f9a6481c8e8f-kube-api-access-zr7w7\") pod \"multus-additional-cni-plugins-phlkq\" (UID: \"03930709-78f9-49ae-bd6f-f9a6481c8e8f\") " pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.317325 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.317276    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8xng\" (UniqueName: \"kubernetes.io/projected/16227dff-3d81-4c11-98a6-7ff11e1d2ca4-kube-api-access-v8xng\") pod \"node-ca-9zd99\" (UID: \"16227dff-3d81-4c11-98a6-7ff11e1d2ca4\") " pod="openshift-image-registry/node-ca-9zd99"
Sep 10 23:33:25.317570 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.317549    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnd6c\" (UniqueName: \"kubernetes.io/projected/0ec31db2-a7b5-4d09-8871-4eea9449069c-kube-api-access-vnd6c\") pod \"tuned-v9mjd\" (UID: \"0ec31db2-a7b5-4d09-8871-4eea9449069c\") " pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.319380 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.319315    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:33:25.319380 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.319341    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:33:25.319380 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.319356    2574 projected.go:196] Error preparing data for projected volume kube-api-access-m72vl for pod openshift-network-diagnostics/network-check-target-dnpld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:25.319618 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.319416    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl podName:de7f431b-9317-47c1-a505-0fa7a1a7aeb4 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:25.819399708 +0000 UTC m=+3.001557844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m72vl" (UniqueName: "kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl") pod "network-check-target-dnpld" (UID: "de7f431b-9317-47c1-a505-0fa7a1a7aeb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:25.320705 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.320679    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6tjl\" (UniqueName: \"kubernetes.io/projected/19caec11-5b78-4352-8b17-90d56d69a7de-kube-api-access-v6tjl\") pod \"network-metrics-daemon-4k2jt\" (UID: \"19caec11-5b78-4352-8b17-90d56d69a7de\") " pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:25.322457 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.322432    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kszx\" (UniqueName: \"kubernetes.io/projected/ff418d0b-69db-4755-8f64-656dcd13841b-kube-api-access-4kszx\") pod \"node-resolver-hpfc4\" (UID: \"ff418d0b-69db-4755-8f64-656dcd13841b\") " pod="openshift-dns/node-resolver-hpfc4"
Sep 10 23:33:25.323019 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.322929    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz5ql\" (UniqueName: \"kubernetes.io/projected/a17767f6-d38b-4500-9986-fae0a8436062-kube-api-access-fz5ql\") pod \"aws-ebs-csi-driver-node-dsd45\" (UID: \"a17767f6-d38b-4500-9986-fae0a8436062\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.323407 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.323351    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n9l7\" (UniqueName: \"kubernetes.io/projected/4fc47980-023d-4262-b0ce-d1e7e00e555d-kube-api-access-2n9l7\") pod \"multus-jrqbg\" (UID: \"4fc47980-023d-4262-b0ce-d1e7e00e555d\") " pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.324027 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.324003    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cz9g\" (UniqueName: \"kubernetes.io/projected/2a608109-2405-400e-af96-52621631a0f1-kube-api-access-7cz9g\") pod \"iptables-alerter-nhqwd\" (UID: \"2a608109-2405-400e-af96-52621631a0f1\") " pod="openshift-network-operator/iptables-alerter-nhqwd"
Sep 10 23:33:25.409997 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.409967    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-node-log\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.409997 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83dc92c5-fb74-4c28-babb-0259c9c4efd4-ovnkube-config\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410020    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-log-socket\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410044    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83dc92c5-fb74-4c28-babb-0259c9c4efd4-ovnkube-script-lib\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410073    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-kubelet\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410111    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-log-socket\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410124    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-kubelet\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410114    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-slash\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410085    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-node-log\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410152    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-slash\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410176    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83dc92c5-fb74-4c28-babb-0259c9c4efd4-ovn-node-metrics-cert\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410208    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410231    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-cni-bin\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410256    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-run-ovn-kubernetes\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410271    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410299    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-systemd-units\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410314    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-run-ovn-kubernetes\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410299    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-cni-bin\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410325    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-etc-openvswitch\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410334    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-systemd-units\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410358    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-etc-openvswitch\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410361    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-run-openvswitch\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410392    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-run-openvswitch\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410437    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-var-lib-openvswitch\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410465    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-run-ovn\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410490    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-cni-netd\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410515    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-run-netns\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410526    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-run-ovn\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410545    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-run-systemd\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.410743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410547    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-cni-netd\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.411604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410574    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28186efb-cfb3-4d1b-9224-e81db5a3ec1b-agent-certs\") pod \"konnectivity-agent-2gmzl\" (UID: \"28186efb-cfb3-4d1b-9224-e81db5a3ec1b\") " pod="kube-system/konnectivity-agent-2gmzl"
Sep 10 23:33:25.411604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410515    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-var-lib-openvswitch\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.411604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410581    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-host-run-netns\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.411604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410600    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28186efb-cfb3-4d1b-9224-e81db5a3ec1b-konnectivity-ca\") pod \"konnectivity-agent-2gmzl\" (UID: \"28186efb-cfb3-4d1b-9224-e81db5a3ec1b\") " pod="kube-system/konnectivity-agent-2gmzl"
Sep 10 23:33:25.411604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410622    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83dc92c5-fb74-4c28-babb-0259c9c4efd4-run-systemd\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.411604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410632    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83dc92c5-fb74-4c28-babb-0259c9c4efd4-env-overrides\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.411604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410661    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5nc4\" (UniqueName: \"kubernetes.io/projected/83dc92c5-fb74-4c28-babb-0259c9c4efd4-kube-api-access-d5nc4\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.411604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410727    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83dc92c5-fb74-4c28-babb-0259c9c4efd4-ovnkube-config\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.411604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.410871    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83dc92c5-fb74-4c28-babb-0259c9c4efd4-ovnkube-script-lib\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.411604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.411144    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83dc92c5-fb74-4c28-babb-0259c9c4efd4-env-overrides\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.411604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.411199    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28186efb-cfb3-4d1b-9224-e81db5a3ec1b-konnectivity-ca\") pod \"konnectivity-agent-2gmzl\" (UID: \"28186efb-cfb3-4d1b-9224-e81db5a3ec1b\") " pod="kube-system/konnectivity-agent-2gmzl"
Sep 10 23:33:25.412992 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.412965    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83dc92c5-fb74-4c28-babb-0259c9c4efd4-ovn-node-metrics-cert\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.413421 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.413399    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28186efb-cfb3-4d1b-9224-e81db5a3ec1b-agent-certs\") pod \"konnectivity-agent-2gmzl\" (UID: \"28186efb-cfb3-4d1b-9224-e81db5a3ec1b\") " pod="kube-system/konnectivity-agent-2gmzl"
Sep 10 23:33:25.418769 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.418729    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5nc4\" (UniqueName: \"kubernetes.io/projected/83dc92c5-fb74-4c28-babb-0259c9c4efd4-kube-api-access-d5nc4\") pod \"ovnkube-node-tzxwx\" (UID: \"83dc92c5-fb74-4c28-babb-0259c9c4efd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.491859 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.491781    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-phlkq"
Sep 10 23:33:25.499251 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.499219    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nhqwd"
Sep 10 23:33:25.511427 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.511249    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45"
Sep 10 23:33:25.519004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.518981    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hpfc4"
Sep 10 23:33:25.526694 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.526675    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9zd99"
Sep 10 23:33:25.534519 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.534501    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v9mjd"
Sep 10 23:33:25.542283 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.542262    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jrqbg"
Sep 10 23:33:25.551029 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.551009    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2gmzl"
Sep 10 23:33:25.557655 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.557639    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:25.813774 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.813701    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:25.813774 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.813750    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs\") pod \"network-metrics-daemon-4k2jt\" (UID: \"19caec11-5b78-4352-8b17-90d56d69a7de\") " pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:25.813953 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.813862    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:25.813953 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.813910    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs podName:19caec11-5b78-4352-8b17-90d56d69a7de nodeName:}" failed. No retries permitted until 2026-09-10 23:33:26.813894809 +0000 UTC m=+3.996052918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs") pod "network-metrics-daemon-4k2jt" (UID: "19caec11-5b78-4352-8b17-90d56d69a7de") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:25.814255 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.814236    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:25.814308 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.814298    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret podName:e04c068a-47d1-4208-b12f-4b25d729bf33 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:26.814283458 +0000 UTC m=+3.996441580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret") pod "global-pull-secret-syncer-w8hxs" (UID: "e04c068a-47d1-4208-b12f-4b25d729bf33") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:25.914381 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:25.914350    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72vl\" (UniqueName: \"kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl\") pod \"network-check-target-dnpld\" (UID: \"de7f431b-9317-47c1-a505-0fa7a1a7aeb4\") " pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:25.914569 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.914492    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:33:25.914569 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.914517    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:33:25.914569 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.914530    2574 projected.go:196] Error preparing data for projected volume kube-api-access-m72vl for pod openshift-network-diagnostics/network-check-target-dnpld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:25.914736 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:25.914594    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl podName:de7f431b-9317-47c1-a505-0fa7a1a7aeb4 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:26.914575026 +0000 UTC m=+4.096733148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m72vl" (UniqueName: "kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl") pod "network-check-target-dnpld" (UID: "de7f431b-9317-47c1-a505-0fa7a1a7aeb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:26.229201 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:26.229164    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 23:28:25 +0000 UTC" deadline="2028-06-12 03:51:45.155021168 +0000 UTC"
Sep 10 23:33:26.229201 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:26.229197    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15364h18m18.925828612s"
Sep 10 23:33:26.350158 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:26.349937    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83dc92c5_fb74_4c28_babb_0259c9c4efd4.slice/crio-40ab6729d233080020793a5eede2e34d8755149b30c2cb4a26ad5302d8d14a39 WatchSource:0}: Error finding container 40ab6729d233080020793a5eede2e34d8755149b30c2cb4a26ad5302d8d14a39: Status 404 returned error can't find the container with id 40ab6729d233080020793a5eede2e34d8755149b30c2cb4a26ad5302d8d14a39
Sep 10 23:33:26.352325 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:26.351578    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda17767f6_d38b_4500_9986_fae0a8436062.slice/crio-afed9725b1c3ef41446e9b788ccf1faa261caef6f1b80cccc7fc361bec2b8982 WatchSource:0}: Error finding container afed9725b1c3ef41446e9b788ccf1faa261caef6f1b80cccc7fc361bec2b8982: Status 404 returned error can't find the container with id afed9725b1c3ef41446e9b788ccf1faa261caef6f1b80cccc7fc361bec2b8982
Sep 10 23:33:26.361191 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:26.360863    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec31db2_a7b5_4d09_8871_4eea9449069c.slice/crio-4e0dfa1a138d7e64f9f22ffa2d23871c6c278e0a050b74a37d52dd33cb395cae WatchSource:0}: Error finding container 4e0dfa1a138d7e64f9f22ffa2d23871c6c278e0a050b74a37d52dd33cb395cae: Status 404 returned error can't find the container with id 4e0dfa1a138d7e64f9f22ffa2d23871c6c278e0a050b74a37d52dd33cb395cae
Sep 10 23:33:26.361191 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:26.361079    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a608109_2405_400e_af96_52621631a0f1.slice/crio-52e7dc14f9567331abaf6e07e580e67133fb88c850d2bfa725ca8d7a013c2090 WatchSource:0}: Error finding container 52e7dc14f9567331abaf6e07e580e67133fb88c850d2bfa725ca8d7a013c2090: Status 404 returned error can't find the container with id 52e7dc14f9567331abaf6e07e580e67133fb88c850d2bfa725ca8d7a013c2090
Sep 10 23:33:26.362170 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:33:26.362063    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff418d0b_69db_4755_8f64_656dcd13841b.slice/crio-0fc2b480b5b0d5f996afac6d97d51680748971b60e167b0373cd6917ebed4579 WatchSource:0}: Error finding container 0fc2b480b5b0d5f996afac6d97d51680748971b60e167b0373cd6917ebed4579: Status 404 returned error can't find the container with id 0fc2b480b5b0d5f996afac6d97d51680748971b60e167b0373cd6917ebed4579
Sep 10 23:33:26.822424 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:26.821387    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:26.822424 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:26.821458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs\") pod \"network-metrics-daemon-4k2jt\" (UID: \"19caec11-5b78-4352-8b17-90d56d69a7de\") " pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:26.822424 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:26.821634    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:26.822424 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:26.821704    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs podName:19caec11-5b78-4352-8b17-90d56d69a7de nodeName:}" failed. No retries permitted until 2026-09-10 23:33:28.821683 +0000 UTC m=+6.003841126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs") pod "network-metrics-daemon-4k2jt" (UID: "19caec11-5b78-4352-8b17-90d56d69a7de") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:26.822424 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:26.822270    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:26.822424 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:26.822352    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret podName:e04c068a-47d1-4208-b12f-4b25d729bf33 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:28.822319739 +0000 UTC m=+6.004477867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret") pod "global-pull-secret-syncer-w8hxs" (UID: "e04c068a-47d1-4208-b12f-4b25d729bf33") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:26.923665 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:26.922903    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72vl\" (UniqueName: \"kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl\") pod \"network-check-target-dnpld\" (UID: \"de7f431b-9317-47c1-a505-0fa7a1a7aeb4\") " pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:26.923665 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:26.923094    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:33:26.923665 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:26.923121    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:33:26.923665 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:26.923139    2574 projected.go:196] Error preparing data for projected volume kube-api-access-m72vl for pod openshift-network-diagnostics/network-check-target-dnpld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:26.923665 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:26.923242    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl podName:de7f431b-9317-47c1-a505-0fa7a1a7aeb4 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:28.923181506 +0000 UTC m=+6.105339629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m72vl" (UniqueName: "kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl") pod "network-check-target-dnpld" (UID: "de7f431b-9317-47c1-a505-0fa7a1a7aeb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:27.230468 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.230366    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 23:28:25 +0000 UTC" deadline="2028-04-17 15:55:14.322526767 +0000 UTC"
Sep 10 23:33:27.230468 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.230413    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14032h21m47.092118273s"
Sep 10 23:33:27.250905 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.250873    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:27.251045 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:27.251017    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:27.251485 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.251458    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:27.251617 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:27.251593    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:27.253967 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.253945    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:27.254085 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:27.254049    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:27.299643 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.298993    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-1.ec2.internal" event={"ID":"c136d63f0f74198e85586854afa827e1","Type":"ContainerStarted","Data":"7b9b0043c7e7c13d21e935d2cae8f58f0d6e623fdaae8696580e15531fd7fbf0"}
Sep 10 23:33:27.308766 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.308661    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v9mjd" event={"ID":"0ec31db2-a7b5-4d09-8871-4eea9449069c","Type":"ContainerStarted","Data":"4e0dfa1a138d7e64f9f22ffa2d23871c6c278e0a050b74a37d52dd33cb395cae"}
Sep 10 23:33:27.326320 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.326110    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hpfc4" event={"ID":"ff418d0b-69db-4755-8f64-656dcd13841b","Type":"ContainerStarted","Data":"0fc2b480b5b0d5f996afac6d97d51680748971b60e167b0373cd6917ebed4579"}
Sep 10 23:33:27.328561 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.328498    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jrqbg" event={"ID":"4fc47980-023d-4262-b0ce-d1e7e00e555d","Type":"ContainerStarted","Data":"8e188cfddbb9c384bd1b42db03df4482e769e9d4a9653c671e205a949a8e0374"}
Sep 10 23:33:27.337916 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.337843    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9zd99" event={"ID":"16227dff-3d81-4c11-98a6-7ff11e1d2ca4","Type":"ContainerStarted","Data":"9fb944c2d31fca4c5e08f3d6e555f83548eb46785ee85716f136bd8c8dd98b5e"}
Sep 10 23:33:27.361423 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.361371    2574 generic.go:356] "Generic (PLEG): container finished" podID="d41ca270205501ca8a2b3a06f04b5b69" containerID="c1df5eed5971baabccb4a8873596655929ce32cf6e6951842c71b4b71f6ad956" exitCode=0
Sep 10 23:33:27.361639 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.361615    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal" event={"ID":"d41ca270205501ca8a2b3a06f04b5b69","Type":"ContainerDied","Data":"c1df5eed5971baabccb4a8873596655929ce32cf6e6951842c71b4b71f6ad956"}
Sep 10 23:33:27.384454 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.384395    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-1.ec2.internal" podStartSLOduration=3.384374281 podStartE2EDuration="3.384374281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:27.314670305 +0000 UTC m=+4.496828465" watchObservedRunningTime="2026-09-10 23:33:27.384374281 +0000 UTC m=+4.566532413"
Sep 10 23:33:27.386961 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.386847    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nhqwd" event={"ID":"2a608109-2405-400e-af96-52621631a0f1","Type":"ContainerStarted","Data":"52e7dc14f9567331abaf6e07e580e67133fb88c850d2bfa725ca8d7a013c2090"}
Sep 10 23:33:27.399705 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.399647    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phlkq" event={"ID":"03930709-78f9-49ae-bd6f-f9a6481c8e8f","Type":"ContainerStarted","Data":"8d59f5d05ac5c432670b635c54e3ca7de97df13e87eb517c9191b15cc35add92"}
Sep 10 23:33:27.410048 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.410007    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2gmzl" event={"ID":"28186efb-cfb3-4d1b-9224-e81db5a3ec1b","Type":"ContainerStarted","Data":"b20279a609a6870d65c434fba33e3c89ee899a1a8b06294b0162b1cdb176824d"}
Sep 10 23:33:27.418012 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.417984    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45" event={"ID":"a17767f6-d38b-4500-9986-fae0a8436062","Type":"ContainerStarted","Data":"afed9725b1c3ef41446e9b788ccf1faa261caef6f1b80cccc7fc361bec2b8982"}
Sep 10 23:33:27.442558 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:27.442527    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx" event={"ID":"83dc92c5-fb74-4c28-babb-0259c9c4efd4","Type":"ContainerStarted","Data":"40ab6729d233080020793a5eede2e34d8755149b30c2cb4a26ad5302d8d14a39"}
Sep 10 23:33:28.471453 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:28.471412    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal" event={"ID":"d41ca270205501ca8a2b3a06f04b5b69","Type":"ContainerStarted","Data":"ab790544224c3ecfeeefeb56f48523e6def1248f75d579ea1a1ecc038ccbea8b"}
Sep 10 23:33:28.841624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:28.840692    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:28.841624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:28.840775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs\") pod \"network-metrics-daemon-4k2jt\" (UID: \"19caec11-5b78-4352-8b17-90d56d69a7de\") " pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:28.841624 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:28.840948    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:28.841624 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:28.841019    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs podName:19caec11-5b78-4352-8b17-90d56d69a7de nodeName:}" failed. No retries permitted until 2026-09-10 23:33:32.84099743 +0000 UTC m=+10.023155551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs") pod "network-metrics-daemon-4k2jt" (UID: "19caec11-5b78-4352-8b17-90d56d69a7de") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:28.841624 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:28.841436    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:28.841624 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:28.841490    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret podName:e04c068a-47d1-4208-b12f-4b25d729bf33 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:32.8414734 +0000 UTC m=+10.023631513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret") pod "global-pull-secret-syncer-w8hxs" (UID: "e04c068a-47d1-4208-b12f-4b25d729bf33") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:28.942389 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:28.941747    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72vl\" (UniqueName: \"kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl\") pod \"network-check-target-dnpld\" (UID: \"de7f431b-9317-47c1-a505-0fa7a1a7aeb4\") " pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:28.942389 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:28.941928    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:33:28.942389 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:28.941950    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:33:28.942389 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:28.941965    2574 projected.go:196] Error preparing data for projected volume kube-api-access-m72vl for pod openshift-network-diagnostics/network-check-target-dnpld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:28.942389 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:28.942030    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl podName:de7f431b-9317-47c1-a505-0fa7a1a7aeb4 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:32.942010738 +0000 UTC m=+10.124168849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m72vl" (UniqueName: "kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl") pod "network-check-target-dnpld" (UID: "de7f431b-9317-47c1-a505-0fa7a1a7aeb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:29.252753 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:29.251905    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:29.252753 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:29.252041    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:29.252753 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:29.252464    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:29.252753 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:29.252572    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:29.252753 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:29.252640    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:29.252753 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:29.252711    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:31.250139 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:31.250098    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:31.250627 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:31.250155    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:31.250627 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:31.250263    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:31.250627 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:31.250374    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:31.250627 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:31.250413    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:31.250627 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:31.250531    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:32.877140 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:32.877088    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:32.877577 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:32.877154    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs\") pod \"network-metrics-daemon-4k2jt\" (UID: \"19caec11-5b78-4352-8b17-90d56d69a7de\") " pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:32.877577 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:32.877270    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:32.877577 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:32.877352    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs podName:19caec11-5b78-4352-8b17-90d56d69a7de nodeName:}" failed. No retries permitted until 2026-09-10 23:33:40.877330439 +0000 UTC m=+18.059488563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs") pod "network-metrics-daemon-4k2jt" (UID: "19caec11-5b78-4352-8b17-90d56d69a7de") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:32.877577 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:32.877269    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:32.877577 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:32.877454    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret podName:e04c068a-47d1-4208-b12f-4b25d729bf33 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:40.87743282 +0000 UTC m=+18.059590943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret") pod "global-pull-secret-syncer-w8hxs" (UID: "e04c068a-47d1-4208-b12f-4b25d729bf33") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:32.978588 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:32.978545    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72vl\" (UniqueName: \"kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl\") pod \"network-check-target-dnpld\" (UID: \"de7f431b-9317-47c1-a505-0fa7a1a7aeb4\") " pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:32.978769 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:32.978699    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:33:32.978769 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:32.978734    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:33:32.978769 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:32.978746    2574 projected.go:196] Error preparing data for projected volume kube-api-access-m72vl for pod openshift-network-diagnostics/network-check-target-dnpld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:32.978928 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:32.978809    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl podName:de7f431b-9317-47c1-a505-0fa7a1a7aeb4 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:40.978795627 +0000 UTC m=+18.160953752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m72vl" (UniqueName: "kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl") pod "network-check-target-dnpld" (UID: "de7f431b-9317-47c1-a505-0fa7a1a7aeb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:33.254005 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:33.253926    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:33.254361 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:33.254211    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:33.254589 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:33.254241    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:33.254589 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:33.254456    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:33.254589 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:33.254545    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:33.254994 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:33.254964    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:35.250750 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:35.250701    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:35.250750 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:35.250734    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:35.250750 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:35.250706    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:35.251224 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:35.250839    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:35.251224 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:35.250944    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:35.251224 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:35.251019    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:37.250259 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:37.250234    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:37.250650 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:37.250235    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:37.250650 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:37.250330    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:37.250650 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:37.250409    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:37.250650 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:37.250512    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:37.250650 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:37.250613    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:39.250477 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:39.250434    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:39.250477 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:39.250468    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:39.250990 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:39.250433    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:39.250990 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:39.250568    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:39.250990 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:39.250653    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:39.250990 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:39.250755    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:40.935312 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:40.935267    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:40.935800 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:40.935337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs\") pod \"network-metrics-daemon-4k2jt\" (UID: \"19caec11-5b78-4352-8b17-90d56d69a7de\") " pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:40.935800 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:40.935387    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:40.935800 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:40.935706    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:40.935959 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:40.935811    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret podName:e04c068a-47d1-4208-b12f-4b25d729bf33 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:56.935554929 +0000 UTC m=+34.117713054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret") pod "global-pull-secret-syncer-w8hxs" (UID: "e04c068a-47d1-4208-b12f-4b25d729bf33") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:40.935959 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:40.935850    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs podName:19caec11-5b78-4352-8b17-90d56d69a7de nodeName:}" failed. No retries permitted until 2026-09-10 23:33:56.935839414 +0000 UTC m=+34.117997526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs") pod "network-metrics-daemon-4k2jt" (UID: "19caec11-5b78-4352-8b17-90d56d69a7de") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:41.036609 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:41.036573    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72vl\" (UniqueName: \"kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl\") pod \"network-check-target-dnpld\" (UID: \"de7f431b-9317-47c1-a505-0fa7a1a7aeb4\") " pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:41.036784 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:41.036758    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:33:41.036784 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:41.036782    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:33:41.036873 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:41.036794    2574 projected.go:196] Error preparing data for projected volume kube-api-access-m72vl for pod openshift-network-diagnostics/network-check-target-dnpld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:41.036873 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:41.036850    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl podName:de7f431b-9317-47c1-a505-0fa7a1a7aeb4 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:57.036832275 +0000 UTC m=+34.218990381 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m72vl" (UniqueName: "kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl") pod "network-check-target-dnpld" (UID: "de7f431b-9317-47c1-a505-0fa7a1a7aeb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:41.250885 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:41.250809    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:41.250885 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:41.250824    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:41.250885 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:41.250812    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:41.251130 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:41.250931    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:41.251322 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:41.251290    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:41.251458 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:41.251390    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:43.251332 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:43.251297    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:43.251739 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:43.251402    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:43.251739 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:43.251470    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:43.251739 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:43.251492    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:43.251739 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:43.251530    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:43.251739 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:43.251599    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:44.511468 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:44.511117    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v9mjd" event={"ID":"0ec31db2-a7b5-4d09-8871-4eea9449069c","Type":"ContainerStarted","Data":"0b0bb862c71bdb6aca8a61265ddc001c789de799b7b6a37f853634186f4f1856"}
Sep 10 23:33:44.529861 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:44.529807    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v9mjd" podStartSLOduration=2.513883452 podStartE2EDuration="20.529789159s" totalImagesPullingTime="18.015905707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:44.529420017 +0000 UTC m=+21.711578145" watchObservedRunningTime="2026-09-10 23:33:44.529789159 +0000 UTC m=+21.711947307"
Sep 10 23:33:44.530374 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:44.530339    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-1.ec2.internal" podStartSLOduration=20.530330393 podStartE2EDuration="20.530330393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:28.489243914 +0000 UTC m=+5.671402047" watchObservedRunningTime="2026-09-10 23:33:44.530330393 +0000 UTC m=+21.712488520"
Sep 10 23:33:45.250264 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.250105    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:45.250414 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.250109    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:45.250414 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:45.250331    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:45.250529 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:45.250438    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:45.250529 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.250143    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:45.250591 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:45.250540    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:45.521045 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.520499    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hpfc4" event={"ID":"ff418d0b-69db-4755-8f64-656dcd13841b","Type":"ContainerStarted","Data":"9b8522c25b8c70e37af10f10508be70e55d560bc76db3df3f8e84d44ded49004"}
Sep 10 23:33:45.522448 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.522393    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jrqbg" event={"ID":"4fc47980-023d-4262-b0ce-d1e7e00e555d","Type":"ContainerStarted","Data":"098db28a4ebd069b836f830e838087a43dec26a773dfa02926b2891adf59fcdf"}
Sep 10 23:33:45.524261 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.524234    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9zd99" event={"ID":"16227dff-3d81-4c11-98a6-7ff11e1d2ca4","Type":"ContainerStarted","Data":"4e29c15db7eb1ac8b8a7241466c73a81a6f4e876f5d5ef24c63481e441ffd511"}
Sep 10 23:33:45.526266 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.526239    2574 generic.go:356] "Generic (PLEG): container finished" podID="03930709-78f9-49ae-bd6f-f9a6481c8e8f" containerID="49d3590c49d9bde0cdc070a1b7f41227b80ba9a5bf64723431e08ebf9d387e3e" exitCode=0
Sep 10 23:33:45.526354 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.526329    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phlkq" event={"ID":"03930709-78f9-49ae-bd6f-f9a6481c8e8f","Type":"ContainerDied","Data":"49d3590c49d9bde0cdc070a1b7f41227b80ba9a5bf64723431e08ebf9d387e3e"}
Sep 10 23:33:45.528177 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.528152    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2gmzl" event={"ID":"28186efb-cfb3-4d1b-9224-e81db5a3ec1b","Type":"ContainerStarted","Data":"0271910cf53fd9d740d07acfec146ab4db48e6656dbc2a2a7fad56c4ee61be3e"}
Sep 10 23:33:45.529784 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.529748    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45" event={"ID":"a17767f6-d38b-4500-9986-fae0a8436062","Type":"ContainerStarted","Data":"7269f90b18ada94a6dd45207be6a4898dd85ee7d770c903e60bb6f9a746b09a6"}
Sep 10 23:33:45.532806 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.532780    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx" event={"ID":"83dc92c5-fb74-4c28-babb-0259c9c4efd4","Type":"ContainerStarted","Data":"a1ba036c3f0faa8c026095832004f4facffd49ed5cdb9a2f9ba9b50ed3f45387"}
Sep 10 23:33:45.532896 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.532832    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx" event={"ID":"83dc92c5-fb74-4c28-babb-0259c9c4efd4","Type":"ContainerStarted","Data":"689a056c0cbd2a9d611c69d9527bca0b189c140d4dbc9ce30c4d24621fcafa1e"}
Sep 10 23:33:45.532896 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.532861    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx" event={"ID":"83dc92c5-fb74-4c28-babb-0259c9c4efd4","Type":"ContainerStarted","Data":"214427feb8276dbcbcad7587533aebf03347caa8a1cafaf27ee9244d590fb175"}
Sep 10 23:33:45.532978 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.532893    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx" event={"ID":"83dc92c5-fb74-4c28-babb-0259c9c4efd4","Type":"ContainerStarted","Data":"744c822833a3168e84836d120f7c1fda9c73c76e97b77ceae6576f6bdc1746f6"}
Sep 10 23:33:45.532978 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.532942    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx" event={"ID":"83dc92c5-fb74-4c28-babb-0259c9c4efd4","Type":"ContainerStarted","Data":"d3b0a8180c013b714c87545f35a4b1d68436a758eb0568605f0db9ddbcb0e404"}
Sep 10 23:33:45.532978 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.532970    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx" event={"ID":"83dc92c5-fb74-4c28-babb-0259c9c4efd4","Type":"ContainerStarted","Data":"7e7899c96f92a58da8cf53787a7806b52c844ed00c91c31a17a4e14b5c400d7b"}
Sep 10 23:33:45.535730 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.535677    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hpfc4" podStartSLOduration=3.5247612310000003 podStartE2EDuration="21.535666489s" totalImagesPullingTime="18.010905258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:45.535444676 +0000 UTC m=+22.717602807" watchObservedRunningTime="2026-09-10 23:33:45.535666489 +0000 UTC m=+22.717824616"
Sep 10 23:33:45.588178 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.588142    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9zd99" podStartSLOduration=3.571944585 podStartE2EDuration="21.588129842s" totalImagesPullingTime="18.016185257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:45.569701914 +0000 UTC m=+22.751860042" watchObservedRunningTime="2026-09-10 23:33:45.588129842 +0000 UTC m=+22.770287967"
Sep 10 23:33:45.588275 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.588250    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jrqbg" podStartSLOduration=3.534368962 podStartE2EDuration="21.58824686s" totalImagesPullingTime="18.053877898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:45.588105351 +0000 UTC m=+22.770263492" watchObservedRunningTime="2026-09-10 23:33:45.58824686 +0000 UTC m=+22.770404987"
Sep 10 23:33:45.604115 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.604062    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2gmzl" podStartSLOduration=7.463377757 podStartE2EDuration="21.604053932s" totalImagesPullingTime="14.140676175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:45.603556448 +0000 UTC m=+22.785714575" watchObservedRunningTime="2026-09-10 23:33:45.604053932 +0000 UTC m=+22.786212060"
Sep 10 23:33:45.738148 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.738119    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:45.821441 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.821385    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:45.961848 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:45.961826    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 23:33:46.250878 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:46.250791    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T23:33:45.961844195Z","UUID":"a2d98820-f3f5-473d-ac9c-5b7e75302957","Handler":null,"Name":"","Endpoint":""}
Sep 10 23:33:46.252321 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:46.252301    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 23:33:46.252442 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:46.252335    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 23:33:46.329012 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:46.328988    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2gmzl"
Sep 10 23:33:46.329600 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:46.329569    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2gmzl"
Sep 10 23:33:46.537356 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:46.537265    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nhqwd" event={"ID":"2a608109-2405-400e-af96-52621631a0f1","Type":"ContainerStarted","Data":"355249178b01af2198b470b09ef09f18c309fc33f3ecb8a7416db28557f66491"}
Sep 10 23:33:46.540438 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:46.540404    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45" event={"ID":"a17767f6-d38b-4500-9986-fae0a8436062","Type":"ContainerStarted","Data":"87e0ee8f9f7cdf01bace960f353cb13dde2531dbe1f718ee302b7ab6b257d654"}
Sep 10 23:33:46.541573 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:46.541550    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2gmzl"
Sep 10 23:33:46.542316 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:46.542292    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2gmzl"
Sep 10 23:33:46.573886 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:46.573835    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nhqwd" podStartSLOduration=5.559566481 podStartE2EDuration="23.57381661s" totalImagesPullingTime="18.014250129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:46.554301348 +0000 UTC m=+23.736459479" watchObservedRunningTime="2026-09-10 23:33:46.57381661 +0000 UTC m=+23.755974739"
Sep 10 23:33:46.676274 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:46.676230    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:46.740603 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:46.740561    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:47.250795 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:47.250775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:47.250901 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:47.250780    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:47.250901 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:47.250874    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:47.251013 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:47.250981    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:47.251013 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:47.250780    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:47.251138 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:47.251093    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:47.545509 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:47.545466    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45" event={"ID":"a17767f6-d38b-4500-9986-fae0a8436062","Type":"ContainerStarted","Data":"ab4cb102a0b89d33881b94812faebc537088daa0c6c0a82956e71dc9f611f485"}
Sep 10 23:33:47.549426 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:47.549375    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx" event={"ID":"83dc92c5-fb74-4c28-babb-0259c9c4efd4","Type":"ContainerStarted","Data":"ba8c527a4402a004332b67617afeace5378825dbcd456186c63814bfef5ba4e3"}
Sep 10 23:33:49.250672 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:49.250644    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:49.251282 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:49.250650    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:49.251282 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:49.250787    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:49.251282 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:49.250650    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:49.251282 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:49.250837    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:49.251282 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:49.250917    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:49.484757 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:49.484702    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:49.589492 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:49.589402    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:50.427779 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:50.427572    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:50.496611 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:50.496585    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:50.559449 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:50.559421    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx" event={"ID":"83dc92c5-fb74-4c28-babb-0259c9c4efd4","Type":"ContainerStarted","Data":"10654a7415a650c1ebff49ad0c66c348f7f7973124244035153602f35ecb593d"}
Sep 10 23:33:50.559692 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:50.559665    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:50.561703 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:50.561683    2574 generic.go:356] "Generic (PLEG): container finished" podID="03930709-78f9-49ae-bd6f-f9a6481c8e8f" containerID="8b54e0765368da866be1c3f2649fabc42a52a9c8c88e8b7cbf58410bf7169cc3" exitCode=0
Sep 10 23:33:50.561784 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:50.561730    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phlkq" event={"ID":"03930709-78f9-49ae-bd6f-f9a6481c8e8f","Type":"ContainerDied","Data":"8b54e0765368da866be1c3f2649fabc42a52a9c8c88e8b7cbf58410bf7169cc3"}
Sep 10 23:33:50.574504 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:50.574483    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:50.586175 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:50.586138    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx" podStartSLOduration=8.523490324 podStartE2EDuration="26.586126224s" totalImagesPullingTime="18.0626359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:50.585045912 +0000 UTC m=+27.767204040" watchObservedRunningTime="2026-09-10 23:33:50.586126224 +0000 UTC m=+27.768284350"
Sep 10 23:33:50.586311 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:50.586292    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsd45" podStartSLOduration=6.128594878 podStartE2EDuration="26.586287215s" totalImagesPullingTime="20.457692337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:47.569775093 +0000 UTC m=+24.751933223" watchObservedRunningTime="2026-09-10 23:33:50.586287215 +0000 UTC m=+27.768445342"
Sep 10 23:33:50.779452 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:50.779383    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:50.846749 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:50.846707    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:50.908006 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:50.907977    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:51.098569 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.098488    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:51.199480 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.199437    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:51.253737 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.252682    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:51.253737 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:51.252845    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:51.253737 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.253246    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:51.253737 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:51.253331    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:51.254061 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.253853    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:51.254061 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:51.253945    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:51.564464 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.564420    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:51.565120 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.564515    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:51.578799 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.578769    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:33:51.793968 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.793944    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hpfc4_ff418d0b-69db-4755-8f64-656dcd13841b/dns-node-resolver/0.log"
Sep 10 23:33:51.895894 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.895869    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w8hxs"]
Sep 10 23:33:51.896031 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.896011    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:51.896143 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:51.896097    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:51.899327 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.899309    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dnpld"]
Sep 10 23:33:51.899431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.899395    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:51.899575 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:51.899541    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:51.900061 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.900038    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4k2jt"]
Sep 10 23:33:51.900164 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:51.900150    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:51.900269 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:51.900250    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:52.567932 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:52.567900    2574 generic.go:356] "Generic (PLEG): container finished" podID="03930709-78f9-49ae-bd6f-f9a6481c8e8f" containerID="58c09437430b76af365d34c636f9c0ea182ddf0a6a7ed21938f6f908555a7cd2" exitCode=0
Sep 10 23:33:52.568367 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:52.567985    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phlkq" event={"ID":"03930709-78f9-49ae-bd6f-f9a6481c8e8f","Type":"ContainerDied","Data":"58c09437430b76af365d34c636f9c0ea182ddf0a6a7ed21938f6f908555a7cd2"}
Sep 10 23:33:52.741415 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:52.741378    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:52.793685 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:52.793647    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9zd99_16227dff-3d81-4c11-98a6-7ff11e1d2ca4/node-ca/0.log"
Sep 10 23:33:52.795644 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:52.795623    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:53.250726 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:53.250681    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:53.250883 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:53.250754    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:53.250883 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:53.250835    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:53.251013 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:53.250907    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:53.386935 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:53.386899    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:53.485013 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:53.484978    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:53.656987 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:53.656962    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:54.250734 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:54.250693    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:54.250850 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:54.250810    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:54.478655 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:54.478608    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:54.575073 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:54.575048    2574 generic.go:356] "Generic (PLEG): container finished" podID="03930709-78f9-49ae-bd6f-f9a6481c8e8f" containerID="577253dc8fc030a6b9f736e79c6cfd03a06f1b28ac990779dc6d208ad9910e20" exitCode=0
Sep 10 23:33:54.575203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:54.575086    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phlkq" event={"ID":"03930709-78f9-49ae-bd6f-f9a6481c8e8f","Type":"ContainerDied","Data":"577253dc8fc030a6b9f736e79c6cfd03a06f1b28ac990779dc6d208ad9910e20"}
Sep 10 23:33:54.632639 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:54.632611    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:54.705701 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:54.705669    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:54.807105 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:54.807034    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:54.914213 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:54.914188    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:55.115871 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:55.115785    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:55.250361 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:55.250331    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:55.250517 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:55.250463    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:55.250574 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:55.250550    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:55.250726 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:55.250688    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:55.780100 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:55.780064    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:56.198288 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:56.198251    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:56.250302 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:56.250269    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:56.250464 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:56.250416    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:56.378387 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:56.378352    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:56.580599 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:56.580566    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:56.777189 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:56.777113    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:56.950154 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:56.950126    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:56.950573 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:56.950163    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs\") pod \"network-metrics-daemon-4k2jt\" (UID: \"19caec11-5b78-4352-8b17-90d56d69a7de\") " pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:56.950573 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:56.950257    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:56.950573 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:56.950278    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:56.950573 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:56.950320    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs podName:19caec11-5b78-4352-8b17-90d56d69a7de nodeName:}" failed. No retries permitted until 2026-09-10 23:34:28.950302511 +0000 UTC m=+66.132460619 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs") pod "network-metrics-daemon-4k2jt" (UID: "19caec11-5b78-4352-8b17-90d56d69a7de") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:56.950573 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:56.950344    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret podName:e04c068a-47d1-4208-b12f-4b25d729bf33 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:28.950327104 +0000 UTC m=+66.132485227 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret") pod "global-pull-secret-syncer-w8hxs" (UID: "e04c068a-47d1-4208-b12f-4b25d729bf33") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:57.051151 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:57.051078    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72vl\" (UniqueName: \"kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl\") pod \"network-check-target-dnpld\" (UID: \"de7f431b-9317-47c1-a505-0fa7a1a7aeb4\") " pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:57.051273 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:57.051241    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:33:57.051273 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:57.051261    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:33:57.051273 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:57.051271    2574 projected.go:196] Error preparing data for projected volume kube-api-access-m72vl for pod openshift-network-diagnostics/network-check-target-dnpld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:57.051395 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:57.051322    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl podName:de7f431b-9317-47c1-a505-0fa7a1a7aeb4 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:29.051308403 +0000 UTC m=+66.233466524 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m72vl" (UniqueName: "kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl") pod "network-check-target-dnpld" (UID: "de7f431b-9317-47c1-a505-0fa7a1a7aeb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:57.250561 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:57.250528    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:57.250738 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:57.250642    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:57.250738 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:57.250697    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:57.250862 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:57.250839    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:57.785615 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:57.785578    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:58.118300 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:58.118261    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:58.250487 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:58.250456    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:33:58.250653 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:58.250557    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:33:58.269898 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:58.269860    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:58.383549 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:58.383459    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:58.573994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:58.573955    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:58.970478 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:58.970305    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:59.070945 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:59.070882    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:59.250956 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:59.250903    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:33:59.251241 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:59.251003    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:33:59.251241 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:59.251029    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:33:59.251241 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:33:59.251083    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:33:59.370864 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:59.370841    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:33:59.590406 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:59.590334    2574 generic.go:356] "Generic (PLEG): container finished" podID="03930709-78f9-49ae-bd6f-f9a6481c8e8f" containerID="b7c0a95ebd128aabb1c3dfa713ef3d67c6c36179d23fc38df2cb3e01be30ba3f" exitCode=0
Sep 10 23:33:59.590406 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:59.590387    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phlkq" event={"ID":"03930709-78f9-49ae-bd6f-f9a6481c8e8f","Type":"ContainerDied","Data":"b7c0a95ebd128aabb1c3dfa713ef3d67c6c36179d23fc38df2cb3e01be30ba3f"}
Sep 10 23:33:59.977009 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:33:59.976978    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:00.106501 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:00.106455    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:00.207561 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:00.207502    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:00.250834 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:00.250776    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:34:00.250953 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:00.250867    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:34:00.309835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:00.309805    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:00.410460 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:00.410431    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:00.471757 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:00.471729    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:00.573813 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:00.573732    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:00.595584 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:00.595554    2574 generic.go:356] "Generic (PLEG): container finished" podID="03930709-78f9-49ae-bd6f-f9a6481c8e8f" containerID="af56ecae4f80240b53d25eef5fde68a9ea112fd13848acd8a64639ed84dc2532" exitCode=0
Sep 10 23:34:00.595732 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:00.595616    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phlkq" event={"ID":"03930709-78f9-49ae-bd6f-f9a6481c8e8f","Type":"ContainerDied","Data":"af56ecae4f80240b53d25eef5fde68a9ea112fd13848acd8a64639ed84dc2532"}
Sep 10 23:34:00.675247 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:00.675216    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:00.775054 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:00.775029    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:00.985680 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:00.985634    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:01.194131 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:01.194098    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:01.250936 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:01.250876    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:34:01.251045 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:01.250881    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:34:01.251045 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:01.250973    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:34:01.251118 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:01.251049    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:34:01.294801 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:01.294763    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:01.394827 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:01.394796    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:01.601013 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:01.600947    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phlkq" event={"ID":"03930709-78f9-49ae-bd6f-f9a6481c8e8f","Type":"ContainerStarted","Data":"d14b3ccd55ee5bc28fc5efd978e0d844a6aae05628f3fad4871ef37ef5934161"}
Sep 10 23:34:01.607958 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:01.607931    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:01.624160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:01.624123    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-phlkq" podStartSLOduration=9.704562307 podStartE2EDuration="38.624110089s" totalImagesPullingTime="28.919547782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:01.623604479 +0000 UTC m=+38.805762605" watchObservedRunningTime="2026-09-10 23:34:01.624110089 +0000 UTC m=+38.806268215"
Sep 10 23:34:01.678894 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:01.678865    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:01.790250 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:01.790216    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:02.007979 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:02.007951    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:02.081904 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:02.081871    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:02.250118 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:02.250096    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:34:02.250242 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:02.250181    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:34:02.570446 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:02.570417    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:02.770621 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:02.770584    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:02.830234 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:02.830165    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:02.969367 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:02.969341    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:03.070029 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:03.070003    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:03.250687 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:03.250665    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:34:03.250819 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:03.250794    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:34:03.250898 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:03.250883    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:34:03.251005 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:03.250989    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:34:03.377194 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:03.377170    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:03.776793 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:03.776768    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:04.250494 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:04.250467    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:34:04.250663 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:04.250567    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:34:04.373226 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:04.373192    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:04.774055 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:04.774026    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:04.967921 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:04.967893    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:05.250951 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:05.250918    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:34:05.251205 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:05.251025    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:34:05.251205 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:05.251091    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:34:05.251205 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:05.251184    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:34:05.374401 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:05.374360    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:05.576177 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:05.576097    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:05.638520 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:05.638482    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:06.250419 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:06.250392    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:34:06.250802 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:06.250481    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:34:07.250088 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:07.250062    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:34:07.250088 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:07.250076    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:34:07.250275 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:07.250161    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:34:07.250317 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:07.250279    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:34:08.249988 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:08.249957    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:34:08.250398 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:08.250065    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:34:08.373950 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:08.373923    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:08.473397 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:08.473369    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:09.250198 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:09.250165    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:34:09.250558 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:09.250274    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:34:09.250558 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:09.250333    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:34:09.250558 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:09.250424    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:34:09.617291 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:09.617255    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:09.673004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:09.672974    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:10.250666 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:10.250640    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:34:10.251109 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:10.250777    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:34:11.211006 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:11.210968    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:11.250946 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:11.250912    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:34:11.251267 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:11.251045    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8hxs" podUID="e04c068a-47d1-4208-b12f-4b25d729bf33"
Sep 10 23:34:11.251267 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:11.251083    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:34:11.251267 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:11.251178    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k2jt" podUID="19caec11-5b78-4352-8b17-90d56d69a7de"
Sep 10 23:34:11.266228 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:11.266198    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:12.250257 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:12.250229    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:34:12.250422 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:12.250327    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnpld" podUID="de7f431b-9317-47c1-a505-0fa7a1a7aeb4"
Sep 10 23:34:12.764952 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:12.764896    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:12.937448 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:12.937405    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:13.036625 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.036547    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:13.136552 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.136525    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:13.185239 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.185217    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-1.ec2.internal" event="NodeReady"
Sep 10 23:34:13.185373 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.185340    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 23:34:13.239471 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.239444    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c6ff5466c-g8fqw"]
Sep 10 23:34:13.260311 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.260287    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.262506 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.262484    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 23:34:13.262634 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.262560    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 23:34:13.262755 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.262736    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pdj78\""
Sep 10 23:34:13.262836 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.262760    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 23:34:13.263202 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.263185    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gwmnh"]
Sep 10 23:34:13.269295 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.269273    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 23:34:13.281837 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.281816    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c6ff5466c-g8fqw"]
Sep 10 23:34:13.281837 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.281840    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gwmnh"]
Sep 10 23:34:13.281995 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.281899    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gwmnh"
Sep 10 23:34:13.281995 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.281913    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:34:13.282090 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.281900    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:34:13.284248 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.284222    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 23:34:13.284419 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.284392    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 23:34:13.284419 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.284414    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 23:34:13.284626 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.284498    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wqzsr\""
Sep 10 23:34:13.284626 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.284541    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 23:34:13.284626 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.284595    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9ms7z\""
Sep 10 23:34:13.284803 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.284625    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 23:34:13.353763 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.353732    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wdjff"]
Sep 10 23:34:13.375885 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.375854    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c42rs"]
Sep 10 23:34:13.376049 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.375985    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.376593 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.376565    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6bb8fc70-f3e9-4626-ad11-046d186198fe-ca-trust-extracted\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.376729 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.376616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6bb8fc70-f3e9-4626-ad11-046d186198fe-trusted-ca\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.376729 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.376673    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6bb8fc70-f3e9-4626-ad11-046d186198fe-installation-pull-secrets\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.376836 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.376731    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6bb8fc70-f3e9-4626-ad11-046d186198fe-registry-certificates\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.376836 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.376781    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6bb8fc70-f3e9-4626-ad11-046d186198fe-registry-tls\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.376940 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.376878    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3-cert\") pod \"ingress-canary-gwmnh\" (UID: \"5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3\") " pod="openshift-ingress-canary/ingress-canary-gwmnh"
Sep 10 23:34:13.376994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.376943    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk8sq\" (UniqueName: \"kubernetes.io/projected/5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3-kube-api-access-vk8sq\") pod \"ingress-canary-gwmnh\" (UID: \"5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3\") " pod="openshift-ingress-canary/ingress-canary-gwmnh"
Sep 10 23:34:13.376994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.376976    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqtw6\" (UniqueName: \"kubernetes.io/projected/6bb8fc70-f3e9-4626-ad11-046d186198fe-kube-api-access-qqtw6\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.377089 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.377004    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bb8fc70-f3e9-4626-ad11-046d186198fe-bound-sa-token\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.377089 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.377044    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6bb8fc70-f3e9-4626-ad11-046d186198fe-image-registry-private-configuration\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.382214 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.382192    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 23:34:13.382339 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.382264    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n77qs\""
Sep 10 23:34:13.383082 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.383065    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 23:34:13.399859 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.399839    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c42rs"]
Sep 10 23:34:13.399930 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.399874    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wdjff"]
Sep 10 23:34:13.399968 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.399948    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.402227 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.402212    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 23:34:13.402316 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.402263    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 23:34:13.402430 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.402415    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 23:34:13.402464 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.402429    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 23:34:13.402630 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.402617    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6vndn\""
Sep 10 23:34:13.445153 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.445115    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:13.478010 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.477980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk8sq\" (UniqueName: \"kubernetes.io/projected/5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3-kube-api-access-vk8sq\") pod \"ingress-canary-gwmnh\" (UID: \"5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3\") " pod="openshift-ingress-canary/ingress-canary-gwmnh"
Sep 10 23:34:13.478010 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478011    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dffb260-3cf9-42bb-80b7-4a0341b93d03-tmp-dir\") pod \"dns-default-wdjff\" (UID: \"9dffb260-3cf9-42bb-80b7-4a0341b93d03\") " pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.478238 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478033    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqtw6\" (UniqueName: \"kubernetes.io/projected/6bb8fc70-f3e9-4626-ad11-046d186198fe-kube-api-access-qqtw6\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.478238 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478052    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bb8fc70-f3e9-4626-ad11-046d186198fe-bound-sa-token\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.478238 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478070    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6bb8fc70-f3e9-4626-ad11-046d186198fe-image-registry-private-configuration\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.478238 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478086    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm66q\" (UniqueName: \"kubernetes.io/projected/9dffb260-3cf9-42bb-80b7-4a0341b93d03-kube-api-access-qm66q\") pod \"dns-default-wdjff\" (UID: \"9dffb260-3cf9-42bb-80b7-4a0341b93d03\") " pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.478238 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478114    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6bb8fc70-f3e9-4626-ad11-046d186198fe-ca-trust-extracted\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.478238 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478139    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6bb8fc70-f3e9-4626-ad11-046d186198fe-trusted-ca\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.478238 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478155    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6bb8fc70-f3e9-4626-ad11-046d186198fe-installation-pull-secrets\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.478238 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478196    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6bb8fc70-f3e9-4626-ad11-046d186198fe-registry-certificates\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.478610 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478482    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6bb8fc70-f3e9-4626-ad11-046d186198fe-registry-tls\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.478610 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478544    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9dffb260-3cf9-42bb-80b7-4a0341b93d03-config-volume\") pod \"dns-default-wdjff\" (UID: \"9dffb260-3cf9-42bb-80b7-4a0341b93d03\") " pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.478802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478633    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3-cert\") pod \"ingress-canary-gwmnh\" (UID: \"5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3\") " pod="openshift-ingress-canary/ingress-canary-gwmnh"
Sep 10 23:34:13.478802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478686    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6bb8fc70-f3e9-4626-ad11-046d186198fe-ca-trust-extracted\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.478913 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.478667    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9dffb260-3cf9-42bb-80b7-4a0341b93d03-metrics-tls\") pod \"dns-default-wdjff\" (UID: \"9dffb260-3cf9-42bb-80b7-4a0341b93d03\") " pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.479475 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.479425    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6bb8fc70-f3e9-4626-ad11-046d186198fe-trusted-ca\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.479590 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.479513    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6bb8fc70-f3e9-4626-ad11-046d186198fe-registry-certificates\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.482191 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.482167    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6bb8fc70-f3e9-4626-ad11-046d186198fe-registry-tls\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.482304 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.482264    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6bb8fc70-f3e9-4626-ad11-046d186198fe-image-registry-private-configuration\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.482360 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.482308    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6bb8fc70-f3e9-4626-ad11-046d186198fe-installation-pull-secrets\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.482400 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.482354    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3-cert\") pod \"ingress-canary-gwmnh\" (UID: \"5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3\") " pod="openshift-ingress-canary/ingress-canary-gwmnh"
Sep 10 23:34:13.488907 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.488881    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk8sq\" (UniqueName: \"kubernetes.io/projected/5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3-kube-api-access-vk8sq\") pod \"ingress-canary-gwmnh\" (UID: \"5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3\") " pod="openshift-ingress-canary/ingress-canary-gwmnh"
Sep 10 23:34:13.489906 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.489881    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bb8fc70-f3e9-4626-ad11-046d186198fe-bound-sa-token\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.490107 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.490089    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqtw6\" (UniqueName: \"kubernetes.io/projected/6bb8fc70-f3e9-4626-ad11-046d186198fe-kube-api-access-qqtw6\") pod \"image-registry-5c6ff5466c-g8fqw\" (UID: \"6bb8fc70-f3e9-4626-ad11-046d186198fe\") " pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.515874 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.515842    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:13.571654 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.571575    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:13.579787 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.579754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a6a7231-4974-483e-afd7-accaf5f92561-crio-socket\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.579911 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.579805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9dffb260-3cf9-42bb-80b7-4a0341b93d03-config-volume\") pod \"dns-default-wdjff\" (UID: \"9dffb260-3cf9-42bb-80b7-4a0341b93d03\") " pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.579911 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.579858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a6a7231-4974-483e-afd7-accaf5f92561-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.579998 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.579917    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9dffb260-3cf9-42bb-80b7-4a0341b93d03-metrics-tls\") pod \"dns-default-wdjff\" (UID: \"9dffb260-3cf9-42bb-80b7-4a0341b93d03\") " pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.579998 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.579945    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a6a7231-4974-483e-afd7-accaf5f92561-data-volume\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.580103 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.580045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dffb260-3cf9-42bb-80b7-4a0341b93d03-tmp-dir\") pod \"dns-default-wdjff\" (UID: \"9dffb260-3cf9-42bb-80b7-4a0341b93d03\") " pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.580103 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.580084    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlwmn\" (UniqueName: \"kubernetes.io/projected/4a6a7231-4974-483e-afd7-accaf5f92561-kube-api-access-zlwmn\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.580204 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.580131    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm66q\" (UniqueName: \"kubernetes.io/projected/9dffb260-3cf9-42bb-80b7-4a0341b93d03-kube-api-access-qm66q\") pod \"dns-default-wdjff\" (UID: \"9dffb260-3cf9-42bb-80b7-4a0341b93d03\") " pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.580204 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.580153    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a6a7231-4974-483e-afd7-accaf5f92561-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.580345 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.580325    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dffb260-3cf9-42bb-80b7-4a0341b93d03-tmp-dir\") pod \"dns-default-wdjff\" (UID: \"9dffb260-3cf9-42bb-80b7-4a0341b93d03\") " pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.580419 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.580393    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9dffb260-3cf9-42bb-80b7-4a0341b93d03-config-volume\") pod \"dns-default-wdjff\" (UID: \"9dffb260-3cf9-42bb-80b7-4a0341b93d03\") " pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.582255 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.582232    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9dffb260-3cf9-42bb-80b7-4a0341b93d03-metrics-tls\") pod \"dns-default-wdjff\" (UID: \"9dffb260-3cf9-42bb-80b7-4a0341b93d03\") " pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.587723 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.587698    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm66q\" (UniqueName: \"kubernetes.io/projected/9dffb260-3cf9-42bb-80b7-4a0341b93d03-kube-api-access-qm66q\") pod \"dns-default-wdjff\" (UID: \"9dffb260-3cf9-42bb-80b7-4a0341b93d03\") " pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.590722 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.590685    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gwmnh"
Sep 10 23:34:13.665573 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.665537    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:13.681241 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.681185    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a6a7231-4974-483e-afd7-accaf5f92561-data-volume\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.681335 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.681258    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlwmn\" (UniqueName: \"kubernetes.io/projected/4a6a7231-4974-483e-afd7-accaf5f92561-kube-api-access-zlwmn\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.681335 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.681298    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a6a7231-4974-483e-afd7-accaf5f92561-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.681435 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.681411    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a6a7231-4974-483e-afd7-accaf5f92561-crio-socket\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.681489 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.681473    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a6a7231-4974-483e-afd7-accaf5f92561-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.681632 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.681614    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a6a7231-4974-483e-afd7-accaf5f92561-data-volume\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.682601 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.682128    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a6a7231-4974-483e-afd7-accaf5f92561-crio-socket\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.682601 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.682491    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a6a7231-4974-483e-afd7-accaf5f92561-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.684352 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.684325    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a6a7231-4974-483e-afd7-accaf5f92561-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.684477 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.684461    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:13.691035 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.691014    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlwmn\" (UniqueName: \"kubernetes.io/projected/4a6a7231-4974-483e-afd7-accaf5f92561-kube-api-access-zlwmn\") pod \"insights-runtime-extractor-c42rs\" (UID: \"4a6a7231-4974-483e-afd7-accaf5f92561\") " pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.709253 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.709017    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c42rs"
Sep 10 23:34:13.766538 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.766485    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:13.906672 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.906643    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gwmnh"]
Sep 10 23:34:13.910195 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:34:13.910134    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fbcb89f_36da_4cc6_9ae0_0f7afcf17ac3.slice/crio-59113dba2dc6ef45f8a59be4ecc627d71978db807c48ff771d48cbf42cc94cf8 WatchSource:0}: Error finding container 59113dba2dc6ef45f8a59be4ecc627d71978db807c48ff771d48cbf42cc94cf8: Status 404 returned error can't find the container with id 59113dba2dc6ef45f8a59be4ecc627d71978db807c48ff771d48cbf42cc94cf8
Sep 10 23:34:13.911153 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.911131    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c6ff5466c-g8fqw"]
Sep 10 23:34:13.914195 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:34:13.914172    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb8fc70_f3e9_4626_ad11_046d186198fe.slice/crio-3b0e643574aa840df1159b8fd299e9f784add4eba32806374ac3f13489dc9a1c WatchSource:0}: Error finding container 3b0e643574aa840df1159b8fd299e9f784add4eba32806374ac3f13489dc9a1c: Status 404 returned error can't find the container with id 3b0e643574aa840df1159b8fd299e9f784add4eba32806374ac3f13489dc9a1c
Sep 10 23:34:13.973777 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.973698    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wdjff"]
Sep 10 23:34:13.977049 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:34:13.977026    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dffb260_3cf9_42bb_80b7_4a0341b93d03.slice/crio-7eeb80c16d4229bfb6878cfc897397f7477a3398edd308f2d170779f50f18087 WatchSource:0}: Error finding container 7eeb80c16d4229bfb6878cfc897397f7477a3398edd308f2d170779f50f18087: Status 404 returned error can't find the container with id 7eeb80c16d4229bfb6878cfc897397f7477a3398edd308f2d170779f50f18087
Sep 10 23:34:13.999965 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:13.999940    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c42rs"]
Sep 10 23:34:14.004134 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:34:14.004112    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a6a7231_4974_483e_afd7_accaf5f92561.slice/crio-e0e4e831796cca74778a0407e95a22fd060c5b5c115b63a511e1c388fa7e089c WatchSource:0}: Error finding container e0e4e831796cca74778a0407e95a22fd060c5b5c115b63a511e1c388fa7e089c: Status 404 returned error can't find the container with id e0e4e831796cca74778a0407e95a22fd060c5b5c115b63a511e1c388fa7e089c
Sep 10 23:34:14.066354 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.066326    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:14.167399 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.167318    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:14.249994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.249962    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:34:14.252544 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.252514    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 23:34:14.252544 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.252542    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 23:34:14.252703 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.252553    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hvw46\""
Sep 10 23:34:14.566855 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.566763    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:14.633191 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.633095    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdjff" event={"ID":"9dffb260-3cf9-42bb-80b7-4a0341b93d03","Type":"ContainerStarted","Data":"7eeb80c16d4229bfb6878cfc897397f7477a3398edd308f2d170779f50f18087"}
Sep 10 23:34:14.634801 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.634742    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gwmnh" event={"ID":"5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3","Type":"ContainerStarted","Data":"59113dba2dc6ef45f8a59be4ecc627d71978db807c48ff771d48cbf42cc94cf8"}
Sep 10 23:34:14.636911 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.636681    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw" event={"ID":"6bb8fc70-f3e9-4626-ad11-046d186198fe","Type":"ContainerStarted","Data":"18fa5105c0c5659a592b4ca82be45019590518680c7f31f9fc80de9e17f07b1a"}
Sep 10 23:34:14.636911 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.636744    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw" event={"ID":"6bb8fc70-f3e9-4626-ad11-046d186198fe","Type":"ContainerStarted","Data":"3b0e643574aa840df1159b8fd299e9f784add4eba32806374ac3f13489dc9a1c"}
Sep 10 23:34:14.636911 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.636775    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:14.638508 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.638480    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c42rs" event={"ID":"4a6a7231-4974-483e-afd7-accaf5f92561","Type":"ContainerStarted","Data":"ab27810c777f27501fdcae1756864e8cc7c2d4f05541bc536020b1673bcb3ab7"}
Sep 10 23:34:14.638596 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.638530    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c42rs" event={"ID":"4a6a7231-4974-483e-afd7-accaf5f92561","Type":"ContainerStarted","Data":"e0e4e831796cca74778a0407e95a22fd060c5b5c115b63a511e1c388fa7e089c"}
Sep 10 23:34:14.658382 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.658159    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw" podStartSLOduration=2.658141768 podStartE2EDuration="2.658141768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:14.656276078 +0000 UTC m=+51.838434217" watchObservedRunningTime="2026-09-10 23:34:14.658141768 +0000 UTC m=+51.840299896"
Sep 10 23:34:14.662504 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.662479    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:14.872869 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.872764    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:14.977120 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:14.977035    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:15.278722 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:15.278621    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:15.337474 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:15.337436    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:15.719919 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:15.719885    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:15.787943 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:15.787907    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:15.790662 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:15.790638    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f"]
Sep 10 23:34:15.793173 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:15.793150    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f"
Sep 10 23:34:15.795767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:15.795744    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6v8dh\""
Sep 10 23:34:15.795869 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:15.795832    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 10 23:34:15.804207 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:15.804184    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f"]
Sep 10 23:34:15.901768 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:15.901723    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d949a473-de63-4bca-a901-c58279c185c4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-ltb5f\" (UID: \"d949a473-de63-4bca-a901-c58279c185c4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f"
Sep 10 23:34:16.003011 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.002930    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d949a473-de63-4bca-a901-c58279c185c4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-ltb5f\" (UID: \"d949a473-de63-4bca-a901-c58279c185c4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f"
Sep 10 23:34:16.003165 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:16.003124    2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 10 23:34:16.003231 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:16.003218    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d949a473-de63-4bca-a901-c58279c185c4-tls-certificates podName:d949a473-de63-4bca-a901-c58279c185c4 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:16.503199387 +0000 UTC m=+53.685357514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d949a473-de63-4bca-a901-c58279c185c4-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-ltb5f" (UID: "d949a473-de63-4bca-a901-c58279c185c4") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 10 23:34:16.064593 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.064551    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:16.126378 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.126334    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:16.307136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.307039    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:16.465378 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.465344    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:16.507283 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.507248    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d949a473-de63-4bca-a901-c58279c185c4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-ltb5f\" (UID: \"d949a473-de63-4bca-a901-c58279c185c4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f"
Sep 10 23:34:16.509933 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.509905    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d949a473-de63-4bca-a901-c58279c185c4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-ltb5f\" (UID: \"d949a473-de63-4bca-a901-c58279c185c4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f"
Sep 10 23:34:16.565458 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.565404    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:16.647357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.647324    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c42rs" event={"ID":"4a6a7231-4974-483e-afd7-accaf5f92561","Type":"ContainerStarted","Data":"824b48611a5aa760fde2be44b969e23011f2264866c1a835d33ac785b94cbf73"}
Sep 10 23:34:16.649162 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.649136    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdjff" event={"ID":"9dffb260-3cf9-42bb-80b7-4a0341b93d03","Type":"ContainerStarted","Data":"570ef31198966cd9b381bc28c9e158bdbe588c7552fcce6ce82df16009c7de16"}
Sep 10 23:34:16.650739 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.650701    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gwmnh" event={"ID":"5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3","Type":"ContainerStarted","Data":"a6559aed4ebb44cef56b1f96a553766c49c7992142c06022de0ee997f31ebe7c"}
Sep 10 23:34:16.667335 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.667280    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gwmnh" podStartSLOduration=1.0925152790000001 podStartE2EDuration="3.667260372s" totalImagesPullingTime="2.574745093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:16.667070139 +0000 UTC m=+53.849228272" watchObservedRunningTime="2026-09-10 23:34:16.667260372 +0000 UTC m=+53.849418494"
Sep 10 23:34:16.704480 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.704431    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f"
Sep 10 23:34:16.976283 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:16.976251    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f"]
Sep 10 23:34:16.978918 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:34:16.978893    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd949a473_de63_4bca_a901_c58279c185c4.slice/crio-cee177537b73eb687a999248a122c1cdf59c33f91a16aab188fc7ae5781816f8 WatchSource:0}: Error finding container cee177537b73eb687a999248a122c1cdf59c33f91a16aab188fc7ae5781816f8: Status 404 returned error can't find the container with id cee177537b73eb687a999248a122c1cdf59c33f91a16aab188fc7ae5781816f8
Sep 10 23:34:17.615279 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:17.615227    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:17.655648 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:17.655601    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f" event={"ID":"d949a473-de63-4bca-a901-c58279c185c4","Type":"ContainerStarted","Data":"cee177537b73eb687a999248a122c1cdf59c33f91a16aab188fc7ae5781816f8"}
Sep 10 23:34:17.657617 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:17.657584    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdjff" event={"ID":"9dffb260-3cf9-42bb-80b7-4a0341b93d03","Type":"ContainerStarted","Data":"e04588fb3eaf994f96f7fbf9b26109e4cf3a655430fb7d72ade6fb58c520e204"}
Sep 10 23:34:17.676996 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:17.676931    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wdjff" podStartSLOduration=2.173453365 podStartE2EDuration="4.676913694s" totalImagesPullingTime="2.503460329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:17.676083984 +0000 UTC m=+54.858242118" watchObservedRunningTime="2026-09-10 23:34:17.676913694 +0000 UTC m=+54.859071823"
Sep 10 23:34:17.683868 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:17.683828    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:17.749155 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:17.749117    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:18.042903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.042875    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9489d76c8-2ks2t"]
Sep 10 23:34:18.049096 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.049080    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.051475 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.051450    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 23:34:18.051475 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.051468    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tclpx\""
Sep 10 23:34:18.051624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.051471    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 23:34:18.051624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.051499    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 23:34:18.051624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.051468    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 23:34:18.052304 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.052288    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 23:34:18.052304 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.052294    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 23:34:18.052431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.052325    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 23:34:18.057272 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.057253    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9489d76c8-2ks2t"]
Sep 10 23:34:18.119119 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.119093    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-service-ca\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.119252 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.119128    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-console-config\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.119252 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.119146    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45f088b6-b106-4093-b304-f16646de11b6-console-serving-cert\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.119252 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.119189    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-oauth-serving-cert\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.119252 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.119235    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvdvj\" (UniqueName: \"kubernetes.io/projected/45f088b6-b106-4093-b304-f16646de11b6-kube-api-access-rvdvj\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.119252 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.119251    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45f088b6-b106-4093-b304-f16646de11b6-console-oauth-config\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.220016 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.219931    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-oauth-serving-cert\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.220016 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.219995    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvdvj\" (UniqueName: \"kubernetes.io/projected/45f088b6-b106-4093-b304-f16646de11b6-kube-api-access-rvdvj\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.220211 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.220039    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45f088b6-b106-4093-b304-f16646de11b6-console-oauth-config\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.220211 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.220098    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-service-ca\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.220211 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.220137    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-console-config\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.220211 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.220164    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45f088b6-b106-4093-b304-f16646de11b6-console-serving-cert\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.220707 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.220654    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-oauth-serving-cert\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.221039 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.221011    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-service-ca\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.221170 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.221110    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-console-config\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.223050 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.223030    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45f088b6-b106-4093-b304-f16646de11b6-console-serving-cert\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.223431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.223409    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45f088b6-b106-4093-b304-f16646de11b6-console-oauth-config\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.235798 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.235778    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvdvj\" (UniqueName: \"kubernetes.io/projected/45f088b6-b106-4093-b304-f16646de11b6-kube-api-access-rvdvj\") pod \"console-9489d76c8-2ks2t\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") " pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.358646 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.358604    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:18.375530 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.375455    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:18.436548 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.436510    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:18.632971 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.632933    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9489d76c8-2ks2t"]
Sep 10 23:34:18.642821 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:34:18.642790    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f088b6_b106_4093_b304_f16646de11b6.slice/crio-a4e9660f5914798e5e0296c55c0c9ab9176f9c7501ce7701705421e2915b49db WatchSource:0}: Error finding container a4e9660f5914798e5e0296c55c0c9ab9176f9c7501ce7701705421e2915b49db: Status 404 returned error can't find the container with id a4e9660f5914798e5e0296c55c0c9ab9176f9c7501ce7701705421e2915b49db
Sep 10 23:34:18.662023 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.661991    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9489d76c8-2ks2t" event={"ID":"45f088b6-b106-4093-b304-f16646de11b6","Type":"ContainerStarted","Data":"a4e9660f5914798e5e0296c55c0c9ab9176f9c7501ce7701705421e2915b49db"}
Sep 10 23:34:18.664127 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.664101    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c42rs" event={"ID":"4a6a7231-4974-483e-afd7-accaf5f92561","Type":"ContainerStarted","Data":"b1672a90d79c99b84d136c44f10cbf013f0294d3773331db1a8c2cf42035cd2b"}
Sep 10 23:34:18.664419 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.664395    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:18.684492 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:18.684451    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c42rs" podStartSLOduration=1.906893659 podStartE2EDuration="5.684437182s" totalImagesPullingTime="3.777543523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:34:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:18.684072018 +0000 UTC m=+55.866230147" watchObservedRunningTime="2026-09-10 23:34:18.684437182 +0000 UTC m=+55.866595306"
Sep 10 23:34:19.241263 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:19.241222    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:19.299851 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:19.299819    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:19.669894 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:19.669853    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f" event={"ID":"d949a473-de63-4bca-a901-c58279c185c4","Type":"ContainerStarted","Data":"b85f9d51e60629aba33f6550780ac1c41e13641f9e9e120671d7a31a9e114380"}
Sep 10 23:34:19.685808 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:19.685754    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f" podStartSLOduration=3.001267626 podStartE2EDuration="4.685733955s" totalImagesPullingTime="1.684466329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:19.685248822 +0000 UTC m=+56.867406973" watchObservedRunningTime="2026-09-10 23:34:19.685733955 +0000 UTC m=+56.867892105"
Sep 10 23:34:19.824032 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:19.823992    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:19.890069 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:19.890033    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:20.675183 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:20.675140    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f"
Sep 10 23:34:20.680519 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:20.680493    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-ltb5f"
Sep 10 23:34:20.817672 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:20.817630    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:20.898857 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:20.898818    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:21.278039 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:21.277947    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:21.680756 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:21.680676    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9489d76c8-2ks2t" event={"ID":"45f088b6-b106-4093-b304-f16646de11b6","Type":"ContainerStarted","Data":"be5a675e7d0c4270eaf30d7b7497b4afd36e270554da21600f591362563effaa"}
Sep 10 23:34:21.698395 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:21.698351    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9489d76c8-2ks2t" podStartSLOduration=0.829732097 podStartE2EDuration="3.69833531s" totalImagesPullingTime="2.868603213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:21.697997129 +0000 UTC m=+58.880155267" watchObservedRunningTime="2026-09-10 23:34:21.69833531 +0000 UTC m=+58.880493437"
Sep 10 23:34:21.848936 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:21.848856    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:21.967202 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:21.967166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:22.644876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:22.644839    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:22.743572 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:22.743529    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:23.378975 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:23.378943    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:23.481214 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:23.481187    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:23.580843 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:23.580680    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tzxwx"
Sep 10 23:34:23.738164 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:23.738088    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:23.838458 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:23.838430    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:23.938727 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:23.938690    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:24.039775 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:24.039692    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:25.568107 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:25.568066    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:25.734247 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:25.734215    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:25.879032 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:25.879002    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:27.975364 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:27.975332    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:28.203033 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.202979    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:28.226208 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.226132    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"]
Sep 10 23:34:28.229209 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.229194    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:28.232148 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.232129    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 10 23:34:28.232416 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.232401    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2pnph\""
Sep 10 23:34:28.232919 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.232900    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 23:34:28.233231 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.233215    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 23:34:28.233310 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.233238    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 23:34:28.233310 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.233216    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 10 23:34:28.243879 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.243858    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"]
Sep 10 23:34:28.260579 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.260549    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fmg79"]
Sep 10 23:34:28.262564 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.262549    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.264633 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.264612    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 23:34:28.265228 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.265208    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 23:34:28.265317 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.265299    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s2m6r\""
Sep 10 23:34:28.265504 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.265489    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 23:34:28.300369 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.300339    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-x89jk\" (UID: \"009aa0a7-cee8-4e1b-86dc-026f23b57fa3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:28.300369 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.300371    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-x89jk\" (UID: \"009aa0a7-cee8-4e1b-86dc-026f23b57fa3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:28.300586 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.300394    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td5wz\" (UniqueName: \"kubernetes.io/projected/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-kube-api-access-td5wz\") pod \"openshift-state-metrics-67dcf8c979-x89jk\" (UID: \"009aa0a7-cee8-4e1b-86dc-026f23b57fa3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:28.300586 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.300408    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-776mr\" (UniqueName: \"kubernetes.io/projected/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-kube-api-access-776mr\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.300586 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.300425    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-wtmp\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.300586 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.300512    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-accelerators-collector-config\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.300586 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.300543    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-x89jk\" (UID: \"009aa0a7-cee8-4e1b-86dc-026f23b57fa3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:28.300586 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.300566    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-root\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.300835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.300590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-metrics-client-ca\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.300835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.300629    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.300835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.300665    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-textfile\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.300835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.300689    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-sys\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.300835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.300726    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-tls\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.310212 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.310179    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:28.359110 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.359072    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:28.359261 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.359136    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:28.360478 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.360452    2574 patch_prober.go:28] interesting pod/console-9489d76c8-2ks2t container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body=
Sep 10 23:34:28.360585 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.360509    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9489d76c8-2ks2t" podUID="45f088b6-b106-4093-b304-f16646de11b6" containerName="console" probeResult="failure" output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused"
Sep 10 23:34:28.401931 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.401900    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-root\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.402011 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.401943    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-metrics-client-ca\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.402059 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402006    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-root\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.402113 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402077    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.402169 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402129    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-textfile\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.402226 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402191    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-sys\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.402283 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402227    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-tls\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.402283 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402251    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-sys\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.402435 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:28.402415    2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 10 23:34:28.402435 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402424    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-textfile\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.402559 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:28.402480    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-tls podName:5560adfe-08b6-4fdc-a1ae-e538c31b5f6c nodeName:}" failed. No retries permitted until 2026-09-10 23:34:28.90246157 +0000 UTC m=+66.084619692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-tls") pod "node-exporter-fmg79" (UID: "5560adfe-08b6-4fdc-a1ae-e538c31b5f6c") : secret "node-exporter-tls" not found
Sep 10 23:34:28.402559 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402501    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-metrics-client-ca\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.402559 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402506    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-x89jk\" (UID: \"009aa0a7-cee8-4e1b-86dc-026f23b57fa3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:28.402559 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402542    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-x89jk\" (UID: \"009aa0a7-cee8-4e1b-86dc-026f23b57fa3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:28.402861 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402571    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td5wz\" (UniqueName: \"kubernetes.io/projected/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-kube-api-access-td5wz\") pod \"openshift-state-metrics-67dcf8c979-x89jk\" (UID: \"009aa0a7-cee8-4e1b-86dc-026f23b57fa3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:28.402861 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:28.402581    2574 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 10 23:34:28.402861 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-776mr\" (UniqueName: \"kubernetes.io/projected/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-kube-api-access-776mr\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.402861 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402627    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-wtmp\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.402861 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:28.402691    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-openshift-state-metrics-tls podName:009aa0a7-cee8-4e1b-86dc-026f23b57fa3 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:28.902674016 +0000 UTC m=+66.084832122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-x89jk" (UID: "009aa0a7-cee8-4e1b-86dc-026f23b57fa3") : secret "openshift-state-metrics-tls" not found
Sep 10 23:34:28.402861 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402762    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-accelerators-collector-config\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.402861 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402833    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-x89jk\" (UID: \"009aa0a7-cee8-4e1b-86dc-026f23b57fa3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:28.402861 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.402841    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-wtmp\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.403243 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.403180    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-accelerators-collector-config\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.403277 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.403250    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-x89jk\" (UID: \"009aa0a7-cee8-4e1b-86dc-026f23b57fa3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:28.404671 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.404653    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.405073 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.405052    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-x89jk\" (UID: \"009aa0a7-cee8-4e1b-86dc-026f23b57fa3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:28.407545 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.407521    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:28.411543 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.411520    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td5wz\" (UniqueName: \"kubernetes.io/projected/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-kube-api-access-td5wz\") pod \"openshift-state-metrics-67dcf8c979-x89jk\" (UID: \"009aa0a7-cee8-4e1b-86dc-026f23b57fa3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:28.411687 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.411534    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-776mr\" (UniqueName: \"kubernetes.io/projected/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-kube-api-access-776mr\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.536638 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.536554    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:28.639314 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.639277    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:28.672050 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.672023    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wdjff"
Sep 10 23:34:28.907225 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.907193    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-tls\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.907415 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.907239    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-x89jk\" (UID: \"009aa0a7-cee8-4e1b-86dc-026f23b57fa3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:28.909604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.909574    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5560adfe-08b6-4fdc-a1ae-e538c31b5f6c-node-exporter-tls\") pod \"node-exporter-fmg79\" (UID: \"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c\") " pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:28.909707 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:28.909621    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/009aa0a7-cee8-4e1b-86dc-026f23b57fa3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-x89jk\" (UID: \"009aa0a7-cee8-4e1b-86dc-026f23b57fa3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:29.002577 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.002537    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:29.008603 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.008583    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:34:29.008682 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.008633    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs\") pod \"network-metrics-daemon-4k2jt\" (UID: \"19caec11-5b78-4352-8b17-90d56d69a7de\") " pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:34:29.011225 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.011205    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 23:34:29.011320 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.011211    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 23:34:29.021330 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.021311    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04c068a-47d1-4208-b12f-4b25d729bf33-original-pull-secret\") pod \"global-pull-secret-syncer-w8hxs\" (UID: \"e04c068a-47d1-4208-b12f-4b25d729bf33\") " pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:34:29.021406 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.021389    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19caec11-5b78-4352-8b17-90d56d69a7de-metrics-certs\") pod \"network-metrics-daemon-4k2jt\" (UID: \"19caec11-5b78-4352-8b17-90d56d69a7de\") " pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:34:29.102694 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.102658    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:29.109621 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.109600    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72vl\" (UniqueName: \"kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl\") pod \"network-check-target-dnpld\" (UID: \"de7f431b-9317-47c1-a505-0fa7a1a7aeb4\") " pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:34:29.112277 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.112257    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 23:34:29.122784 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.122764    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 23:34:29.133100 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.133080    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m72vl\" (UniqueName: \"kubernetes.io/projected/de7f431b-9317-47c1-a505-0fa7a1a7aeb4-kube-api-access-m72vl\") pod \"network-check-target-dnpld\" (UID: \"de7f431b-9317-47c1-a505-0fa7a1a7aeb4\") " pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:34:29.137827 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.137809    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"
Sep 10 23:34:29.171808 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.171784    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fmg79"
Sep 10 23:34:29.196300 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.196273    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8hxs"
Sep 10 23:34:29.197560 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:34:29.197533    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5560adfe_08b6_4fdc_a1ae_e538c31b5f6c.slice/crio-3b45fc5558e86732db214c224b83ec702fc6bf61c472150639f77673884a56a9 WatchSource:0}: Error finding container 3b45fc5558e86732db214c224b83ec702fc6bf61c472150639f77673884a56a9: Status 404 returned error can't find the container with id 3b45fc5558e86732db214c224b83ec702fc6bf61c472150639f77673884a56a9
Sep 10 23:34:29.206839 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.206808    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9ms7z\""
Sep 10 23:34:29.215022 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.214993    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k2jt"
Sep 10 23:34:29.221587 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.221242    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:29.262274 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.262251    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hvw46\""
Sep 10 23:34:29.269590 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.269390    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:34:29.300794 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.300611    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:29.442861 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.442726    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk"]
Sep 10 23:34:29.445262 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:34:29.445233    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009aa0a7_cee8_4e1b_86dc_026f23b57fa3.slice/crio-f360fcbb84d1e8c43b0818fea910fcc6ae2e03ab441806e72873c1d92aeda9a9 WatchSource:0}: Error finding container f360fcbb84d1e8c43b0818fea910fcc6ae2e03ab441806e72873c1d92aeda9a9: Status 404 returned error can't find the container with id f360fcbb84d1e8c43b0818fea910fcc6ae2e03ab441806e72873c1d92aeda9a9
Sep 10 23:34:29.490907 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.490880    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w8hxs"]
Sep 10 23:34:29.493604 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:34:29.493571    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04c068a_47d1_4208_b12f_4b25d729bf33.slice/crio-0f72b62d9895c74d4e35fb547bbb701ff99f6d35fbe5db308f76a0a9d836a189 WatchSource:0}: Error finding container 0f72b62d9895c74d4e35fb547bbb701ff99f6d35fbe5db308f76a0a9d836a189: Status 404 returned error can't find the container with id 0f72b62d9895c74d4e35fb547bbb701ff99f6d35fbe5db308f76a0a9d836a189
Sep 10 23:34:29.521408 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.521384    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4k2jt"]
Sep 10 23:34:29.523621 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:34:29.523596    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19caec11_5b78_4352_8b17_90d56d69a7de.slice/crio-f2bb1f9610756d1959a1e464b979e38c2098d7d480099da1f182c89a6efbf26a WatchSource:0}: Error finding container f2bb1f9610756d1959a1e464b979e38c2098d7d480099da1f182c89a6efbf26a: Status 404 returned error can't find the container with id f2bb1f9610756d1959a1e464b979e38c2098d7d480099da1f182c89a6efbf26a
Sep 10 23:34:29.572150 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.572124    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dnpld"]
Sep 10 23:34:29.575435 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:34:29.575412    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7f431b_9317_47c1_a505_0fa7a1a7aeb4.slice/crio-545afe064e81c10532f45bb61dfb78b119911c209a508fb3f8cd2732994c4d22 WatchSource:0}: Error finding container 545afe064e81c10532f45bb61dfb78b119911c209a508fb3f8cd2732994c4d22: Status 404 returned error can't find the container with id 545afe064e81c10532f45bb61dfb78b119911c209a508fb3f8cd2732994c4d22
Sep 10 23:34:29.710339 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.710305    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dnpld" event={"ID":"de7f431b-9317-47c1-a505-0fa7a1a7aeb4","Type":"ContainerStarted","Data":"545afe064e81c10532f45bb61dfb78b119911c209a508fb3f8cd2732994c4d22"}
Sep 10 23:34:29.711453 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.711428    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4k2jt" event={"ID":"19caec11-5b78-4352-8b17-90d56d69a7de","Type":"ContainerStarted","Data":"f2bb1f9610756d1959a1e464b979e38c2098d7d480099da1f182c89a6efbf26a"}
Sep 10 23:34:29.712671 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.712638    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w8hxs" event={"ID":"e04c068a-47d1-4208-b12f-4b25d729bf33","Type":"ContainerStarted","Data":"0f72b62d9895c74d4e35fb547bbb701ff99f6d35fbe5db308f76a0a9d836a189"}
Sep 10 23:34:29.713929 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.713909    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmg79" event={"ID":"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c","Type":"ContainerStarted","Data":"3b45fc5558e86732db214c224b83ec702fc6bf61c472150639f77673884a56a9"}
Sep 10 23:34:29.715971 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.715906    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk" event={"ID":"009aa0a7-cee8-4e1b-86dc-026f23b57fa3","Type":"ContainerStarted","Data":"a8d7c26720eee06729c86a8babdb469a4ceee29dce1fb99e23bfe78919720e0e"}
Sep 10 23:34:29.715971 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.715959    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk" event={"ID":"009aa0a7-cee8-4e1b-86dc-026f23b57fa3","Type":"ContainerStarted","Data":"42b3730bfd7941943ed8ae56ea8b446466cb7eca99b23df3d6d4f3e857bf7058"}
Sep 10 23:34:29.716118 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.715986    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk" event={"ID":"009aa0a7-cee8-4e1b-86dc-026f23b57fa3","Type":"ContainerStarted","Data":"f360fcbb84d1e8c43b0818fea910fcc6ae2e03ab441806e72873c1d92aeda9a9"}
Sep 10 23:34:29.760279 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.760245    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:29.810732 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.810680    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9489d76c8-2ks2t"]
Sep 10 23:34:29.924379 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.924337    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:29.984178 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:29.984080    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:30.055847 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:30.055746    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:30.580016 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:30.579962    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:30.679908 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:30.679870    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:30.745386 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:30.745342    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:31.159650 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.159597    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:31.213029 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.212997    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-65888bdb98-7h6cs"]
Sep 10 23:34:31.215907 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.215871    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.219052 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.219025    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 10 23:34:31.219161 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.219150    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 10 23:34:31.219307 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.219286    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 10 23:34:31.220026 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.219425    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7rgfw\""
Sep 10 23:34:31.220026 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.219543    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 10 23:34:31.220026 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.219643    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 10 23:34:31.220026 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.219870    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-17sj98o4qcrrf\""
Sep 10 23:34:31.224599 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.224575    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65888bdb98-7h6cs"]
Sep 10 23:34:31.233046 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.232963    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:31.328623 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.328565    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-metrics-client-ca\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.328799 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.328755    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-grpc-tls\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.328799 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.328793    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.328904 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.328824    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.328904 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.328878    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.328987 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.328947    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.328987 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.328982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-tls\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.329059 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.329000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnt95\" (UniqueName: \"kubernetes.io/projected/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-kube-api-access-gnt95\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.387745 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.387682    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:31.429993 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.429906    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.429993 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.429962    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-tls\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.429993 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.429989    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnt95\" (UniqueName: \"kubernetes.io/projected/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-kube-api-access-gnt95\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.430247 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.430034    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-metrics-client-ca\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.430396 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.430373    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-grpc-tls\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.430464 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.430429    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.430521 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.430465    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.430521 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.430497    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.430894 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.430865    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-metrics-client-ca\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.433195 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.433112    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.433316 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.433240    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.433316 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.433249    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-tls\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.433696 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.433659    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.433880 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.433861    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.435444 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.435404    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-secret-grpc-tls\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.438491 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.438463    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnt95\" (UniqueName: \"kubernetes.io/projected/cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7-kube-api-access-gnt95\") pod \"thanos-querier-65888bdb98-7h6cs\" (UID: \"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7\") " pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.532652 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.532618    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:31.728639 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.728082    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4k2jt" event={"ID":"19caec11-5b78-4352-8b17-90d56d69a7de","Type":"ContainerStarted","Data":"a4877921d69ed442ded01e9e44210ab1ec217d360337c9913af7456124ed3831"}
Sep 10 23:34:31.728639 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.728186    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4k2jt" event={"ID":"19caec11-5b78-4352-8b17-90d56d69a7de","Type":"ContainerStarted","Data":"9c3932e7ae102bfa3611976fdb1c1afc4e892e5fad91f1ae612c30cd3ad589fb"}
Sep 10 23:34:31.729786 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.729737    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:31.731517 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.730789    2574 generic.go:356] "Generic (PLEG): container finished" podID="5560adfe-08b6-4fdc-a1ae-e538c31b5f6c" containerID="6ac9314f5114ebd119330f7002d3aa6f617c91e3b261e02ffca7e51dc3a1e435" exitCode=0
Sep 10 23:34:31.731517 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.730874    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmg79" event={"ID":"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c","Type":"ContainerDied","Data":"6ac9314f5114ebd119330f7002d3aa6f617c91e3b261e02ffca7e51dc3a1e435"}
Sep 10 23:34:31.735219 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.735192    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk" event={"ID":"009aa0a7-cee8-4e1b-86dc-026f23b57fa3","Type":"ContainerStarted","Data":"688666a1ef9b680036f958da044f7599576a83a68ae3f2c665f03a524eebddda"}
Sep 10 23:34:31.744782 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.744735    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4k2jt" podStartSLOduration=67.490672011 podStartE2EDuration="1m8.74470179s" totalImagesPullingTime="1.254029779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:33:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:31.744041147 +0000 UTC m=+68.926199279" watchObservedRunningTime="2026-09-10 23:34:31.74470179 +0000 UTC m=+68.926859918"
Sep 10 23:34:31.761834 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.761790    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-x89jk" podStartSLOduration=2.242860854 podStartE2EDuration="3.761771728s" totalImagesPullingTime="1.518910874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:31.760651721 +0000 UTC m=+68.942809853" watchObservedRunningTime="2026-09-10 23:34:31.761771728 +0000 UTC m=+68.943929857"
Sep 10 23:34:31.849939 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.849902    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65888bdb98-7h6cs"]
Sep 10 23:34:31.856962 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:34:31.856931    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0c9ddd_83cf_450b_bbaf_682c3eae5dc7.slice/crio-eb0c979ca0be43787488b88c4747ce8bf34768c78dc0eebfc8eec240d686096c WatchSource:0}: Error finding container eb0c979ca0be43787488b88c4747ce8bf34768c78dc0eebfc8eec240d686096c: Status 404 returned error can't find the container with id eb0c979ca0be43787488b88c4747ce8bf34768c78dc0eebfc8eec240d686096c
Sep 10 23:34:31.878518 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.878470    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:31.977775 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:31.977705    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:32.742733 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:32.742677    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmg79" event={"ID":"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c","Type":"ContainerStarted","Data":"a472c2721263a00ec9fba325b130902e3d46fbcd1bb1221081fb661ffbd48002"}
Sep 10 23:34:32.743176 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:32.742770    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmg79" event={"ID":"5560adfe-08b6-4fdc-a1ae-e538c31b5f6c","Type":"ContainerStarted","Data":"973e12198becda9ff01754b20d4897e2a4ab5b2490c07f9ad22f57ee60d857b4"}
Sep 10 23:34:32.744580 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:32.744551    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs" event={"ID":"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7","Type":"ContainerStarted","Data":"eb0c979ca0be43787488b88c4747ce8bf34768c78dc0eebfc8eec240d686096c"}
Sep 10 23:34:32.764885 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:32.764836    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fmg79" podStartSLOduration=3.102806272 podStartE2EDuration="4.764818528s" totalImagesPullingTime="1.577809948s" totalInitContainerRuntime="84.202308ms" isStatefulPod=true podCreationTimestamp="2026-09-10 23:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:32.763636283 +0000 UTC m=+69.945794410" watchObservedRunningTime="2026-09-10 23:34:32.764818528 +0000 UTC m=+69.946976657"
Sep 10 23:34:33.004828 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.004743    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-746668944-tqpnn"]
Sep 10 23:34:33.007194 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.007172    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.014762 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.014741    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 23:34:33.025954 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.025863    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:33.027483 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.027458    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746668944-tqpnn"]
Sep 10 23:34:33.045433 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.045406    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-serving-cert\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.045552 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.045456    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-trusted-ca-bundle\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.045552 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.045534    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-config\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.045660 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.045570    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbgmn\" (UniqueName: \"kubernetes.io/projected/be9046cf-c4de-4455-bbae-2b3fc44c1d18-kube-api-access-cbgmn\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.045660 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.045638    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-service-ca\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.045779 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.045692    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-oauth-config\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.045779 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.045761    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-oauth-serving-cert\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.110726 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.110666    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:33.146339 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.146308    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-trusted-ca-bundle\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.146503 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.146364    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-config\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.146553 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.146529    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbgmn\" (UniqueName: \"kubernetes.io/projected/be9046cf-c4de-4455-bbae-2b3fc44c1d18-kube-api-access-cbgmn\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.146604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.146588    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-service-ca\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.146657 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.146639    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-oauth-config\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.146707 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.146688    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-oauth-serving-cert\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.146776 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.146731    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-serving-cert\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.147269 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.147242    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-config\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.147384 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.147293    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-trusted-ca-bundle\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.147738 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.147700    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-service-ca\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.147819 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.147785    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-oauth-serving-cert\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.149932 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.149909    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-oauth-config\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.150073 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.150046    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-serving-cert\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.156423 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.156400    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbgmn\" (UniqueName: \"kubernetes.io/projected/be9046cf-c4de-4455-bbae-2b3fc44c1d18-kube-api-access-cbgmn\") pod \"console-746668944-tqpnn\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") " pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.210289 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.210251    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:33.288342 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.288252    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:33.319833 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.319802    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:33.576836 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.576745    2574 patch_prober.go:28] interesting pod/image-registry-5c6ff5466c-g8fqw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 10 23:34:33.576836 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.576816    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw" podUID="6bb8fc70-f3e9-4626-ad11-046d186198fe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 23:34:33.721280 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.721217    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:33.821500 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:33.821459    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:34.451793 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:34.451742    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:35.638814 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.634735    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746668944-tqpnn"]
Sep 10 23:34:35.646545 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.646527    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c6ff5466c-g8fqw"
Sep 10 23:34:35.759559 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.759520    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dnpld" event={"ID":"de7f431b-9317-47c1-a505-0fa7a1a7aeb4","Type":"ContainerStarted","Data":"1cee849dff87fe088834281b4e3083a1799c201de824ca73d48d36dabe191580"}
Sep 10 23:34:35.759734 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.759643    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:34:35.761236 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.761212    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w8hxs" event={"ID":"e04c068a-47d1-4208-b12f-4b25d729bf33","Type":"ContainerStarted","Data":"e9c55e0d356b5533145aeba4c67add3b87256a9fd4f113e129c6ac361d0e9913"}
Sep 10 23:34:35.763468 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.763440    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs" event={"ID":"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7","Type":"ContainerStarted","Data":"9476a2eb39b11cb9054dda941c164973395f98c4ff68d120e8bb0244c6f5d7cc"}
Sep 10 23:34:35.763624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.763504    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs" event={"ID":"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7","Type":"ContainerStarted","Data":"ac712259d6f496ace0b419b80c6617748162fa2a0f02ef9e9d946a8e479f59d9"}
Sep 10 23:34:35.763624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.763545    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs" event={"ID":"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7","Type":"ContainerStarted","Data":"8c42348d4215ba24753ba1f3804ebcd600c356716f413104be11638133e9bbca"}
Sep 10 23:34:35.765090 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.765071    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746668944-tqpnn" event={"ID":"be9046cf-c4de-4455-bbae-2b3fc44c1d18","Type":"ContainerStarted","Data":"9ff44e0e39fed3b2bacc7f4e99979b549875bb3ccb2a3f5e72d410f52e622fa5"}
Sep 10 23:34:35.765172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.765108    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746668944-tqpnn" event={"ID":"be9046cf-c4de-4455-bbae-2b3fc44c1d18","Type":"ContainerStarted","Data":"91f0527f754b4cd1d608a4eaf8c03613ddc434bb8d6283827afe70c41901db95"}
Sep 10 23:34:35.776877 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.776828    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dnpld" podStartSLOduration=66.991604692 podStartE2EDuration="1m12.77681022s" totalImagesPullingTime="5.785205528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:33:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:35.775488843 +0000 UTC m=+72.957646971" watchObservedRunningTime="2026-09-10 23:34:35.77681022 +0000 UTC m=+72.958968349"
Sep 10 23:34:35.790946 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.790898    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w8hxs" podStartSLOduration=65.93005074 podStartE2EDuration="1m11.790886321s" totalImagesPullingTime="5.860835581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:35.78987868 +0000 UTC m=+72.972036808" watchObservedRunningTime="2026-09-10 23:34:35.790886321 +0000 UTC m=+72.973044451"
Sep 10 23:34:35.807728 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.807671    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-746668944-tqpnn" podStartSLOduration=3.8076591090000003 podStartE2EDuration="3.807659109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:35.807498256 +0000 UTC m=+72.989656386" watchObservedRunningTime="2026-09-10 23:34:35.807659109 +0000 UTC m=+72.989817236"
Sep 10 23:34:35.820465 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.820427    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:35.890442 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:35.890363    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:36.635008 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:36.634978    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:36.738113 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:36.738084    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:36.772601 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:36.772561    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs" event={"ID":"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7","Type":"ContainerStarted","Data":"359e388d7853f9517688208c47e31709b138c7667713bfe5ebd2ffdba6cda6ad"}
Sep 10 23:34:36.772739 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:36.772634    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs" event={"ID":"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7","Type":"ContainerStarted","Data":"522bd88e5bd8c21283ae71836d574057d367e2e3073e5b3cbdfdc5825a2c2cb3"}
Sep 10 23:34:36.772739 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:36.772669    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs" event={"ID":"cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7","Type":"ContainerStarted","Data":"1633af45e9d2e61fd9e31ba038ac6d9cf3a7c410c7d072a823868478df0f4874"}
Sep 10 23:34:36.797744 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:36.797607    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs" podStartSLOduration=1.331889222 podStartE2EDuration="5.797585961s" totalImagesPullingTime="4.465696739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:36.795661315 +0000 UTC m=+73.977819457" watchObservedRunningTime="2026-09-10 23:34:36.797585961 +0000 UTC m=+73.979744090"
Sep 10 23:34:37.781828 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:37.781786    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:38.374777 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:38.374740    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:38.434360 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:38.434331    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:41.015996 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:41.015957    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:41.115838 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:41.115806    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:42.993508 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:42.993459    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:43.092648 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:43.092609    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:43.193153 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:43.193118    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:43.319987 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:43.319909    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:43.319987 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:43.319956    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:43.328345 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:43.325073    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:43.791452 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:43.791424    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-65888bdb98-7h6cs"
Sep 10 23:34:43.807281 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:43.807252    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:34:43.972183 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:43.972146    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:44.076300 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:44.076225    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:44.175560 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:44.175525    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:45.697732 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:45.697676    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:45.789260 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:45.789226    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:46.023186 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:46.023110    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:46.123762 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:46.123731    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:50.091395 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:50.091356    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:50.144909 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:50.144873    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:34:54.831645 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:54.831604    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9489d76c8-2ks2t" podUID="45f088b6-b106-4093-b304-f16646de11b6" containerName="console" containerID="cri-o://be5a675e7d0c4270eaf30d7b7497b4afd36e270554da21600f591362563effaa" gracePeriod=15
Sep 10 23:34:55.065553 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.065526    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:55.220157 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.220123    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-service-ca\") pod \"45f088b6-b106-4093-b304-f16646de11b6\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") "
Sep 10 23:34:55.220351 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.220197    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45f088b6-b106-4093-b304-f16646de11b6-console-serving-cert\") pod \"45f088b6-b106-4093-b304-f16646de11b6\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") "
Sep 10 23:34:55.220351 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.220220    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvdvj\" (UniqueName: \"kubernetes.io/projected/45f088b6-b106-4093-b304-f16646de11b6-kube-api-access-rvdvj\") pod \"45f088b6-b106-4093-b304-f16646de11b6\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") "
Sep 10 23:34:55.220351 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.220242    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45f088b6-b106-4093-b304-f16646de11b6-console-oauth-config\") pod \"45f088b6-b106-4093-b304-f16646de11b6\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") "
Sep 10 23:34:55.220351 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.220265    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-console-config\") pod \"45f088b6-b106-4093-b304-f16646de11b6\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") "
Sep 10 23:34:55.220351 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.220289    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-oauth-serving-cert\") pod \"45f088b6-b106-4093-b304-f16646de11b6\" (UID: \"45f088b6-b106-4093-b304-f16646de11b6\") "
Sep 10 23:34:55.220620 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.220504    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-service-ca" (OuterVolumeSpecName: "service-ca") pod "45f088b6-b106-4093-b304-f16646de11b6" (UID: "45f088b6-b106-4093-b304-f16646de11b6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:34:55.220815 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.220784    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-console-config" (OuterVolumeSpecName: "console-config") pod "45f088b6-b106-4093-b304-f16646de11b6" (UID: "45f088b6-b106-4093-b304-f16646de11b6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:34:55.220815 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.220793    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "45f088b6-b106-4093-b304-f16646de11b6" (UID: "45f088b6-b106-4093-b304-f16646de11b6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:34:55.222668 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.222632    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45f088b6-b106-4093-b304-f16646de11b6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "45f088b6-b106-4093-b304-f16646de11b6" (UID: "45f088b6-b106-4093-b304-f16646de11b6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:34:55.222789 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.222669    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45f088b6-b106-4093-b304-f16646de11b6-kube-api-access-rvdvj" (OuterVolumeSpecName: "kube-api-access-rvdvj") pod "45f088b6-b106-4093-b304-f16646de11b6" (UID: "45f088b6-b106-4093-b304-f16646de11b6"). InnerVolumeSpecName "kube-api-access-rvdvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:34:55.222789 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.222696    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45f088b6-b106-4093-b304-f16646de11b6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "45f088b6-b106-4093-b304-f16646de11b6" (UID: "45f088b6-b106-4093-b304-f16646de11b6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:34:55.321175 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.321136    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-service-ca\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:34:55.321175 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.321167    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45f088b6-b106-4093-b304-f16646de11b6-console-serving-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:34:55.321175 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.321176    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvdvj\" (UniqueName: \"kubernetes.io/projected/45f088b6-b106-4093-b304-f16646de11b6-kube-api-access-rvdvj\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:34:55.321175 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.321185    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45f088b6-b106-4093-b304-f16646de11b6-console-oauth-config\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:34:55.321421 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.321195    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-console-config\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:34:55.321421 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.321204    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45f088b6-b106-4093-b304-f16646de11b6-oauth-serving-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:34:55.847573 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.847536    2574 generic.go:356] "Generic (PLEG): container finished" podID="45f088b6-b106-4093-b304-f16646de11b6" containerID="be5a675e7d0c4270eaf30d7b7497b4afd36e270554da21600f591362563effaa" exitCode=0
Sep 10 23:34:55.847994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.847587    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9489d76c8-2ks2t"
Sep 10 23:34:55.847994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.847631    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9489d76c8-2ks2t" event={"ID":"45f088b6-b106-4093-b304-f16646de11b6","Type":"ContainerDied","Data":"be5a675e7d0c4270eaf30d7b7497b4afd36e270554da21600f591362563effaa"}
Sep 10 23:34:55.847994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.847686    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9489d76c8-2ks2t" event={"ID":"45f088b6-b106-4093-b304-f16646de11b6","Type":"ContainerDied","Data":"a4e9660f5914798e5e0296c55c0c9ab9176f9c7501ce7701705421e2915b49db"}
Sep 10 23:34:55.847994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.847707    2574 scope.go:117] "RemoveContainer" containerID="be5a675e7d0c4270eaf30d7b7497b4afd36e270554da21600f591362563effaa"
Sep 10 23:34:55.855816 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.855798    2574 scope.go:117] "RemoveContainer" containerID="be5a675e7d0c4270eaf30d7b7497b4afd36e270554da21600f591362563effaa"
Sep 10 23:34:55.856133 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:34:55.856106    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be5a675e7d0c4270eaf30d7b7497b4afd36e270554da21600f591362563effaa\": container with ID starting with be5a675e7d0c4270eaf30d7b7497b4afd36e270554da21600f591362563effaa not found: ID does not exist" containerID="be5a675e7d0c4270eaf30d7b7497b4afd36e270554da21600f591362563effaa"
Sep 10 23:34:55.856240 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.856141    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be5a675e7d0c4270eaf30d7b7497b4afd36e270554da21600f591362563effaa"} err="failed to get container status \"be5a675e7d0c4270eaf30d7b7497b4afd36e270554da21600f591362563effaa\": rpc error: code = NotFound desc = could not find container \"be5a675e7d0c4270eaf30d7b7497b4afd36e270554da21600f591362563effaa\": container with ID starting with be5a675e7d0c4270eaf30d7b7497b4afd36e270554da21600f591362563effaa not found: ID does not exist"
Sep 10 23:34:55.867189 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.867165    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9489d76c8-2ks2t"]
Sep 10 23:34:55.874585 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:55.874554    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9489d76c8-2ks2t"]
Sep 10 23:34:57.254890 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:34:57.254855    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45f088b6-b106-4093-b304-f16646de11b6" path="/var/lib/kubelet/pods/45f088b6-b106-4093-b304-f16646de11b6/volumes"
Sep 10 23:35:06.774700 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:06.774668    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dnpld"
Sep 10 23:35:08.379008 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:08.378972    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:35:08.447850 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:08.447821    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:35:09.518753 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:09.518697    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:35:09.573413 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:09.573372    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:35:42.639653 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:42.639609    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:35:47.431730 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:47.431677    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:35:47.707156 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:47.707072    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:35:50.869220 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:50.869189    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:35:52.516849 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.516811    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"]
Sep 10 23:35:52.517207 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.517100    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45f088b6-b106-4093-b304-f16646de11b6" containerName="console"
Sep 10 23:35:52.517207 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.517112    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f088b6-b106-4093-b304-f16646de11b6" containerName="console"
Sep 10 23:35:52.517207 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.517167    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="45f088b6-b106-4093-b304-f16646de11b6" containerName="console"
Sep 10 23:35:52.519028 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.519010    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.521629 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.521602    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 23:35:52.521800 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.521630    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 23:35:52.521800 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.521604    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 23:35:52.521800 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.521689    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 23:35:52.521924 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.521842    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xftw2\""
Sep 10 23:35:52.522730 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.522694    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 23:35:52.526593 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.526578    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 23:35:52.532550 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.532527    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"]
Sep 10 23:35:52.623756 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.623729    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/737ef4e4-bb1d-4340-a215-1bc916bd7b16-metrics-client-ca\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.623902 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.623765    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/737ef4e4-bb1d-4340-a215-1bc916bd7b16-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.623902 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.623783    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/737ef4e4-bb1d-4340-a215-1bc916bd7b16-secret-telemeter-client\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.623902 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.623806    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/737ef4e4-bb1d-4340-a215-1bc916bd7b16-serving-certs-ca-bundle\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.623902 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.623868    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/737ef4e4-bb1d-4340-a215-1bc916bd7b16-telemeter-client-tls\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.623902 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.623887    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq87w\" (UniqueName: \"kubernetes.io/projected/737ef4e4-bb1d-4340-a215-1bc916bd7b16-kube-api-access-sq87w\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.624081 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.623908    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/737ef4e4-bb1d-4340-a215-1bc916bd7b16-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.624081 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.623926    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/737ef4e4-bb1d-4340-a215-1bc916bd7b16-federate-client-tls\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.724438 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.724404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/737ef4e4-bb1d-4340-a215-1bc916bd7b16-federate-client-tls\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.724438 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.724443    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/737ef4e4-bb1d-4340-a215-1bc916bd7b16-metrics-client-ca\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.724665 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.724468    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/737ef4e4-bb1d-4340-a215-1bc916bd7b16-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.724665 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.724581    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/737ef4e4-bb1d-4340-a215-1bc916bd7b16-secret-telemeter-client\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.724665 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.724623    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/737ef4e4-bb1d-4340-a215-1bc916bd7b16-serving-certs-ca-bundle\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.724920 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.724704    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/737ef4e4-bb1d-4340-a215-1bc916bd7b16-telemeter-client-tls\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.724920 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.724766    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq87w\" (UniqueName: \"kubernetes.io/projected/737ef4e4-bb1d-4340-a215-1bc916bd7b16-kube-api-access-sq87w\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.724920 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.724876    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/737ef4e4-bb1d-4340-a215-1bc916bd7b16-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.725420 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.725395    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/737ef4e4-bb1d-4340-a215-1bc916bd7b16-metrics-client-ca\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.725573 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.725557    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/737ef4e4-bb1d-4340-a215-1bc916bd7b16-serving-certs-ca-bundle\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.726026 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.726001    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/737ef4e4-bb1d-4340-a215-1bc916bd7b16-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.727048 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.727028    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/737ef4e4-bb1d-4340-a215-1bc916bd7b16-federate-client-tls\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.727309 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.727287    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/737ef4e4-bb1d-4340-a215-1bc916bd7b16-secret-telemeter-client\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.727378 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.727336    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/737ef4e4-bb1d-4340-a215-1bc916bd7b16-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.727548 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.727525    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/737ef4e4-bb1d-4340-a215-1bc916bd7b16-telemeter-client-tls\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.733126 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.733104    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq87w\" (UniqueName: \"kubernetes.io/projected/737ef4e4-bb1d-4340-a215-1bc916bd7b16-kube-api-access-sq87w\") pod \"telemeter-client-5bbc5fdcc5-qsrxd\" (UID: \"737ef4e4-bb1d-4340-a215-1bc916bd7b16\") " pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:52.828066 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:52.828005    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"
Sep 10 23:35:53.104640 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:53.104593    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd"]
Sep 10 23:35:53.107438 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:35:53.107408    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737ef4e4_bb1d_4340_a215_1bc916bd7b16.slice/crio-1dbf978295f15991328afb3bea5eb2d08ce8ff6119aec6fbb9b056851ee85ee1 WatchSource:0}: Error finding container 1dbf978295f15991328afb3bea5eb2d08ce8ff6119aec6fbb9b056851ee85ee1: Status 404 returned error can't find the container with id 1dbf978295f15991328afb3bea5eb2d08ce8ff6119aec6fbb9b056851ee85ee1
Sep 10 23:35:54.052866 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:54.052833    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd" event={"ID":"737ef4e4-bb1d-4340-a215-1bc916bd7b16","Type":"ContainerStarted","Data":"1dbf978295f15991328afb3bea5eb2d08ce8ff6119aec6fbb9b056851ee85ee1"}
Sep 10 23:35:55.058129 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:55.058092    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd" event={"ID":"737ef4e4-bb1d-4340-a215-1bc916bd7b16","Type":"ContainerStarted","Data":"9c290528eacd064cc43efa3e9069d7b0eaa9ceabfa14d43e36ec7a149ac3b69d"}
Sep 10 23:35:57.067394 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.067347    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd" event={"ID":"737ef4e4-bb1d-4340-a215-1bc916bd7b16","Type":"ContainerStarted","Data":"a97d8cee8d7360d218a6e5e102e73fd9346766b25807ee6caa4231213d37f4ef"}
Sep 10 23:35:57.067809 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.067404    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd" event={"ID":"737ef4e4-bb1d-4340-a215-1bc916bd7b16","Type":"ContainerStarted","Data":"14f72f8eaa6a44b0eaa67f7972e1672496acf7ec526fbdf3edbbc9e724ff62af"}
Sep 10 23:35:57.090573 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.090520    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5bbc5fdcc5-qsrxd" podStartSLOduration=2.154143542 podStartE2EDuration="5.090503677s" totalImagesPullingTime="2.936360135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:35:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:35:57.088823292 +0000 UTC m=+154.270981421" watchObservedRunningTime="2026-09-10 23:35:57.090503677 +0000 UTC m=+154.272661805"
Sep 10 23:35:57.173021 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.172990    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-858d895d6d-dw69r"]
Sep 10 23:35:57.175136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.175120    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.187511 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.187486    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858d895d6d-dw69r"]
Sep 10 23:35:57.234235 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.234186    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:35:57.258897 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.258875    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-config\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.259005 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.258905    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-trusted-ca-bundle\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.259005 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.258926    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-oauth-config\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.259005 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.258960    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-serving-cert\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.259105 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.259013    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-service-ca\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.259105 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.259049    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58f7b\" (UniqueName: \"kubernetes.io/projected/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-kube-api-access-58f7b\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.259105 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.259065    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-oauth-serving-cert\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.292786 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.292761    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:35:57.360149 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.360129    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-serving-cert\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.360245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.360157    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-service-ca\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.360372 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.360345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58f7b\" (UniqueName: \"kubernetes.io/projected/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-kube-api-access-58f7b\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.360437 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.360394    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-oauth-serving-cert\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.360489 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.360430    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-config\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.360489 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.360477    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-trusted-ca-bundle\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.360590 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.360526    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-oauth-config\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.361003 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.360983    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-service-ca\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.361084 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.361068    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-oauth-serving-cert\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.361179 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.361155    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-config\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.361375 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.361358    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-trusted-ca-bundle\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.362646 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.362629    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-serving-cert\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.362791 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.362774    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-oauth-config\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.370082 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.370061    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58f7b\" (UniqueName: \"kubernetes.io/projected/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-kube-api-access-58f7b\") pod \"console-858d895d6d-dw69r\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") " pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.377265 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.377243    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:35:57.478829 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.478801    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:35:57.483558 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.483537    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:35:57.753910 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.753885    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858d895d6d-dw69r"]
Sep 10 23:35:57.756376 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:35:57.756338    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3afdb2ff_bd77_4d38_a0b1_06cc85576fbd.slice/crio-61091ff77e5959715c48fff1b11fe677f51aa49ac7561b01c2d3532e8941e3ff WatchSource:0}: Error finding container 61091ff77e5959715c48fff1b11fe677f51aa49ac7561b01c2d3532e8941e3ff: Status 404 returned error can't find the container with id 61091ff77e5959715c48fff1b11fe677f51aa49ac7561b01c2d3532e8941e3ff
Sep 10 23:35:57.974901 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:57.974866    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:35:58.072659 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:58.072564    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858d895d6d-dw69r" event={"ID":"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd","Type":"ContainerStarted","Data":"145c866c60722505edbde6df74cbc9032d2bf7baeda9a0a7627f50242c33062e"}
Sep 10 23:35:58.072659 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:58.072623    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858d895d6d-dw69r" event={"ID":"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd","Type":"ContainerStarted","Data":"61091ff77e5959715c48fff1b11fe677f51aa49ac7561b01c2d3532e8941e3ff"}
Sep 10 23:35:58.091485 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:58.091436    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-858d895d6d-dw69r" podStartSLOduration=1.091422686 podStartE2EDuration="1.091422686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:35:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:35:58.090725564 +0000 UTC m=+155.272883683" watchObservedRunningTime="2026-09-10 23:35:58.091422686 +0000 UTC m=+155.273580813"
Sep 10 23:35:58.094925 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:35:58.094897    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:36:07.483959 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:07.483913    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:36:07.484345 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:07.483990    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:36:07.488599 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:07.488575    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:36:08.112646 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:08.112614    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:36:08.159016 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:08.158985    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746668944-tqpnn"]
Sep 10 23:36:08.265493 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:08.265461    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:36:08.323906 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:08.323875    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:36:08.390367 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:08.390287    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:36:33.177638 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.177547    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-746668944-tqpnn" podUID="be9046cf-c4de-4455-bbae-2b3fc44c1d18" containerName="console" containerID="cri-o://9ff44e0e39fed3b2bacc7f4e99979b549875bb3ccb2a3f5e72d410f52e622fa5" gracePeriod=15
Sep 10 23:36:33.411862 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.411837    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:36:33.430140 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.430056    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-trusted-ca-bundle\") pod \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") "
Sep 10 23:36:33.430140 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.430100    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbgmn\" (UniqueName: \"kubernetes.io/projected/be9046cf-c4de-4455-bbae-2b3fc44c1d18-kube-api-access-cbgmn\") pod \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") "
Sep 10 23:36:33.430300 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.430149    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-service-ca\") pod \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") "
Sep 10 23:36:33.430568 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.430538    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "be9046cf-c4de-4455-bbae-2b3fc44c1d18" (UID: "be9046cf-c4de-4455-bbae-2b3fc44c1d18"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:36:33.430676 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.430593    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-service-ca" (OuterVolumeSpecName: "service-ca") pod "be9046cf-c4de-4455-bbae-2b3fc44c1d18" (UID: "be9046cf-c4de-4455-bbae-2b3fc44c1d18"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:36:33.432538 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.432512    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be9046cf-c4de-4455-bbae-2b3fc44c1d18-kube-api-access-cbgmn" (OuterVolumeSpecName: "kube-api-access-cbgmn") pod "be9046cf-c4de-4455-bbae-2b3fc44c1d18" (UID: "be9046cf-c4de-4455-bbae-2b3fc44c1d18"). InnerVolumeSpecName "kube-api-access-cbgmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:36:33.530725 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.530675    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-config\") pod \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") "
Sep 10 23:36:33.530725 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.530726    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-oauth-serving-cert\") pod \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") "
Sep 10 23:36:33.530918 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.530759    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-serving-cert\") pod \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") "
Sep 10 23:36:33.530918 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.530782    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-oauth-config\") pod \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\" (UID: \"be9046cf-c4de-4455-bbae-2b3fc44c1d18\") "
Sep 10 23:36:33.531024 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.530940    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-trusted-ca-bundle\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:36:33.531024 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.530951    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbgmn\" (UniqueName: \"kubernetes.io/projected/be9046cf-c4de-4455-bbae-2b3fc44c1d18-kube-api-access-cbgmn\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:36:33.531024 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.530961    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-service-ca\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:36:33.531177 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.531024    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-config" (OuterVolumeSpecName: "console-config") pod "be9046cf-c4de-4455-bbae-2b3fc44c1d18" (UID: "be9046cf-c4de-4455-bbae-2b3fc44c1d18"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:36:33.531177 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.531127    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "be9046cf-c4de-4455-bbae-2b3fc44c1d18" (UID: "be9046cf-c4de-4455-bbae-2b3fc44c1d18"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:36:33.532836 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.532810    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "be9046cf-c4de-4455-bbae-2b3fc44c1d18" (UID: "be9046cf-c4de-4455-bbae-2b3fc44c1d18"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:36:33.532944 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.532909    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "be9046cf-c4de-4455-bbae-2b3fc44c1d18" (UID: "be9046cf-c4de-4455-bbae-2b3fc44c1d18"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:36:33.631381 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.631353    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-oauth-config\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:36:33.631381 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.631375    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-config\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:36:33.631381 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.631386    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be9046cf-c4de-4455-bbae-2b3fc44c1d18-oauth-serving-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:36:33.631564 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:33.631395    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be9046cf-c4de-4455-bbae-2b3fc44c1d18-console-serving-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:36:34.199245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:34.199211    2574 generic.go:356] "Generic (PLEG): container finished" podID="be9046cf-c4de-4455-bbae-2b3fc44c1d18" containerID="9ff44e0e39fed3b2bacc7f4e99979b549875bb3ccb2a3f5e72d410f52e622fa5" exitCode=0
Sep 10 23:36:34.199660 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:34.199250    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746668944-tqpnn" event={"ID":"be9046cf-c4de-4455-bbae-2b3fc44c1d18","Type":"ContainerDied","Data":"9ff44e0e39fed3b2bacc7f4e99979b549875bb3ccb2a3f5e72d410f52e622fa5"}
Sep 10 23:36:34.199660 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:34.199254    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746668944-tqpnn"
Sep 10 23:36:34.199660 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:34.199291    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746668944-tqpnn" event={"ID":"be9046cf-c4de-4455-bbae-2b3fc44c1d18","Type":"ContainerDied","Data":"91f0527f754b4cd1d608a4eaf8c03613ddc434bb8d6283827afe70c41901db95"}
Sep 10 23:36:34.199660 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:34.199311    2574 scope.go:117] "RemoveContainer" containerID="9ff44e0e39fed3b2bacc7f4e99979b549875bb3ccb2a3f5e72d410f52e622fa5"
Sep 10 23:36:34.207677 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:34.207659    2574 scope.go:117] "RemoveContainer" containerID="9ff44e0e39fed3b2bacc7f4e99979b549875bb3ccb2a3f5e72d410f52e622fa5"
Sep 10 23:36:34.207963 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:36:34.207941    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ff44e0e39fed3b2bacc7f4e99979b549875bb3ccb2a3f5e72d410f52e622fa5\": container with ID starting with 9ff44e0e39fed3b2bacc7f4e99979b549875bb3ccb2a3f5e72d410f52e622fa5 not found: ID does not exist" containerID="9ff44e0e39fed3b2bacc7f4e99979b549875bb3ccb2a3f5e72d410f52e622fa5"
Sep 10 23:36:34.208022 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:34.207971    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ff44e0e39fed3b2bacc7f4e99979b549875bb3ccb2a3f5e72d410f52e622fa5"} err="failed to get container status \"9ff44e0e39fed3b2bacc7f4e99979b549875bb3ccb2a3f5e72d410f52e622fa5\": rpc error: code = NotFound desc = could not find container \"9ff44e0e39fed3b2bacc7f4e99979b549875bb3ccb2a3f5e72d410f52e622fa5\": container with ID starting with 9ff44e0e39fed3b2bacc7f4e99979b549875bb3ccb2a3f5e72d410f52e622fa5 not found: ID does not exist"
Sep 10 23:36:34.221093 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:34.221069    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746668944-tqpnn"]
Sep 10 23:36:34.224891 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:34.224871    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-746668944-tqpnn"]
Sep 10 23:36:35.254185 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:35.254151    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be9046cf-c4de-4455-bbae-2b3fc44c1d18" path="/var/lib/kubelet/pods/be9046cf-c4de-4455-bbae-2b3fc44c1d18/volumes"
Sep 10 23:36:46.468790 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:46.468752    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:36:46.560128 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:36:46.560087    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:02.662422 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:02.662383    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:02.726411 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:02.726381    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:13.593251 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:13.593218    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:14.583292 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:14.583254    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:14.682772 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:14.682730    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:23.406367 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:23.406313    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:23.512449 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:23.512353    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:42.828602 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.828562    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69674fb8f8-fkc9h"]
Sep 10 23:37:42.829193 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.828979    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be9046cf-c4de-4455-bbae-2b3fc44c1d18" containerName="console"
Sep 10 23:37:42.829193 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.828998    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="be9046cf-c4de-4455-bbae-2b3fc44c1d18" containerName="console"
Sep 10 23:37:42.829193 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.829070    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="be9046cf-c4de-4455-bbae-2b3fc44c1d18" containerName="console"
Sep 10 23:37:42.833120 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.833095    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:42.843129 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.843107    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69674fb8f8-fkc9h"]
Sep 10 23:37:42.880509 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.880483    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:42.913148 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.913128    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-trusted-ca-bundle\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:42.913245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.913161    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-service-ca\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:42.913245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.913179    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-config\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:42.913245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.913196    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-serving-cert\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:42.913349 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.913280    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzw87\" (UniqueName: \"kubernetes.io/projected/ccafe3cd-0a09-45b2-87d4-6653a6294434-kube-api-access-zzw87\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:42.913349 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.913308    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-oauth-config\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:42.913349 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:42.913325    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-oauth-serving-cert\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.014028 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.014003    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzw87\" (UniqueName: \"kubernetes.io/projected/ccafe3cd-0a09-45b2-87d4-6653a6294434-kube-api-access-zzw87\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.014028 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.014030    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-oauth-config\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.014204 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.014048    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-oauth-serving-cert\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.014204 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.014081    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-trusted-ca-bundle\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.014204 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.014119    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-service-ca\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.014367 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.014213    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-config\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.014367 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.014250    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-serving-cert\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.014912 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.014890    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-service-ca\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.015011 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.014927    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-config\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.015011 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.014890    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-oauth-serving-cert\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.015108 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.015082    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-trusted-ca-bundle\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.016397 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.016375    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-oauth-config\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.016755 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.016738    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-serving-cert\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.021501 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.021476    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzw87\" (UniqueName: \"kubernetes.io/projected/ccafe3cd-0a09-45b2-87d4-6653a6294434-kube-api-access-zzw87\") pod \"console-69674fb8f8-fkc9h\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") " pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.142342 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.142311    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:43.413578 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.413495    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69674fb8f8-fkc9h"]
Sep 10 23:37:43.416055 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:37:43.416027    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccafe3cd_0a09_45b2_87d4_6653a6294434.slice/crio-67c3d816ffad283313b99e8bb9aa91ec82202e1f7fd0cdfd4985c46a58ed4956 WatchSource:0}: Error finding container 67c3d816ffad283313b99e8bb9aa91ec82202e1f7fd0cdfd4985c46a58ed4956: Status 404 returned error can't find the container with id 67c3d816ffad283313b99e8bb9aa91ec82202e1f7fd0cdfd4985c46a58ed4956
Sep 10 23:37:43.433460 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:43.433435    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69674fb8f8-fkc9h" event={"ID":"ccafe3cd-0a09-45b2-87d4-6653a6294434","Type":"ContainerStarted","Data":"67c3d816ffad283313b99e8bb9aa91ec82202e1f7fd0cdfd4985c46a58ed4956"}
Sep 10 23:37:44.438686 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:44.438652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69674fb8f8-fkc9h" event={"ID":"ccafe3cd-0a09-45b2-87d4-6653a6294434","Type":"ContainerStarted","Data":"80a5a1855c0a9d95732309e3531eaebf719c14c8da6efc9fc8644a75ec4a09bc"}
Sep 10 23:37:44.458151 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:44.458106    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69674fb8f8-fkc9h" podStartSLOduration=2.458089893 podStartE2EDuration="2.458089893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:44.456880072 +0000 UTC m=+261.639038205" watchObservedRunningTime="2026-09-10 23:37:44.458089893 +0000 UTC m=+261.640248101"
Sep 10 23:37:48.295059 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:48.294979    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:48.393584 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:48.393542    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:49.001078 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.001041    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"]
Sep 10 23:37:49.004325 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.004308    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"
Sep 10 23:37:49.006822 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.006799    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vl76f\""
Sep 10 23:37:49.007047 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.007032    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:37:49.007890 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.007856    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:37:49.015861 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.015842    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"]
Sep 10 23:37:49.155150 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.155124    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd20323d-2d71-474c-a0cc-611daf941cbe-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx\" (UID: \"fd20323d-2d71-474c-a0cc-611daf941cbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"
Sep 10 23:37:49.155150 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.155152    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkdsd\" (UniqueName: \"kubernetes.io/projected/fd20323d-2d71-474c-a0cc-611daf941cbe-kube-api-access-qkdsd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx\" (UID: \"fd20323d-2d71-474c-a0cc-611daf941cbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"
Sep 10 23:37:49.155294 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.155176    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd20323d-2d71-474c-a0cc-611daf941cbe-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx\" (UID: \"fd20323d-2d71-474c-a0cc-611daf941cbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"
Sep 10 23:37:49.256223 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.256171    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd20323d-2d71-474c-a0cc-611daf941cbe-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx\" (UID: \"fd20323d-2d71-474c-a0cc-611daf941cbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"
Sep 10 23:37:49.256223 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.256199    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkdsd\" (UniqueName: \"kubernetes.io/projected/fd20323d-2d71-474c-a0cc-611daf941cbe-kube-api-access-qkdsd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx\" (UID: \"fd20323d-2d71-474c-a0cc-611daf941cbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"
Sep 10 23:37:49.256333 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.256222    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd20323d-2d71-474c-a0cc-611daf941cbe-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx\" (UID: \"fd20323d-2d71-474c-a0cc-611daf941cbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"
Sep 10 23:37:49.256617 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.256599    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd20323d-2d71-474c-a0cc-611daf941cbe-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx\" (UID: \"fd20323d-2d71-474c-a0cc-611daf941cbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"
Sep 10 23:37:49.256617 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.256610    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd20323d-2d71-474c-a0cc-611daf941cbe-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx\" (UID: \"fd20323d-2d71-474c-a0cc-611daf941cbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"
Sep 10 23:37:49.264624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.264599    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkdsd\" (UniqueName: \"kubernetes.io/projected/fd20323d-2d71-474c-a0cc-611daf941cbe-kube-api-access-qkdsd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx\" (UID: \"fd20323d-2d71-474c-a0cc-611daf941cbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"
Sep 10 23:37:49.313545 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.313524    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"
Sep 10 23:37:49.585262 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:49.585239    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"]
Sep 10 23:37:49.587835 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:37:49.587807    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd20323d_2d71_474c_a0cc_611daf941cbe.slice/crio-0103ca85e5ee5ee28e2a52d86630dd1dddb7fcbd713f4ba874be7ad3022fe1e9 WatchSource:0}: Error finding container 0103ca85e5ee5ee28e2a52d86630dd1dddb7fcbd713f4ba874be7ad3022fe1e9: Status 404 returned error can't find the container with id 0103ca85e5ee5ee28e2a52d86630dd1dddb7fcbd713f4ba874be7ad3022fe1e9
Sep 10 23:37:50.464649 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:50.464611    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx" event={"ID":"fd20323d-2d71-474c-a0cc-611daf941cbe","Type":"ContainerStarted","Data":"0103ca85e5ee5ee28e2a52d86630dd1dddb7fcbd713f4ba874be7ad3022fe1e9"}
Sep 10 23:37:53.143343 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:53.143308    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:53.143818 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:53.143376    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:53.148785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:53.148759    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:53.482164 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:53.482085    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:37:53.534016 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:53.533984    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858d895d6d-dw69r"]
Sep 10 23:37:53.672955 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:53.672917    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:53.773821 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:53.773722    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:55.486694 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:55.486623    2574 generic.go:356] "Generic (PLEG): container finished" podID="fd20323d-2d71-474c-a0cc-611daf941cbe" containerID="562f75fa849e8090529d99d87bec5e00f699a9d4f5c76af5c8ab0629ae77bef6" exitCode=0
Sep 10 23:37:55.486694 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:55.486688    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx" event={"ID":"fd20323d-2d71-474c-a0cc-611daf941cbe","Type":"ContainerDied","Data":"562f75fa849e8090529d99d87bec5e00f699a9d4f5c76af5c8ab0629ae77bef6"}
Sep 10 23:37:58.499578 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:58.499543    2574 generic.go:356] "Generic (PLEG): container finished" podID="fd20323d-2d71-474c-a0cc-611daf941cbe" containerID="e0a88090ec484509361fea297ae35e893f55d3511461c6fd724f93ca62633f5b" exitCode=0
Sep 10 23:37:58.500154 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:37:58.499604    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx" event={"ID":"fd20323d-2d71-474c-a0cc-611daf941cbe","Type":"ContainerDied","Data":"e0a88090ec484509361fea297ae35e893f55d3511461c6fd724f93ca62633f5b"}
Sep 10 23:38:06.536851 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:06.536787    2574 generic.go:356] "Generic (PLEG): container finished" podID="fd20323d-2d71-474c-a0cc-611daf941cbe" containerID="1a671a02c9fbd83398e31ffcb6e3b5e310da93e8ff771590efbcb5384b3dcd6a" exitCode=0
Sep 10 23:38:06.537148 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:06.536880    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx" event={"ID":"fd20323d-2d71-474c-a0cc-611daf941cbe","Type":"ContainerDied","Data":"1a671a02c9fbd83398e31ffcb6e3b5e310da93e8ff771590efbcb5384b3dcd6a"}
Sep 10 23:38:07.658394 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:07.658373    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"
Sep 10 23:38:07.707477 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:07.707448    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd20323d-2d71-474c-a0cc-611daf941cbe-util\") pod \"fd20323d-2d71-474c-a0cc-611daf941cbe\" (UID: \"fd20323d-2d71-474c-a0cc-611daf941cbe\") "
Sep 10 23:38:07.707608 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:07.707503    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd20323d-2d71-474c-a0cc-611daf941cbe-bundle\") pod \"fd20323d-2d71-474c-a0cc-611daf941cbe\" (UID: \"fd20323d-2d71-474c-a0cc-611daf941cbe\") "
Sep 10 23:38:07.707608 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:07.707556    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkdsd\" (UniqueName: \"kubernetes.io/projected/fd20323d-2d71-474c-a0cc-611daf941cbe-kube-api-access-qkdsd\") pod \"fd20323d-2d71-474c-a0cc-611daf941cbe\" (UID: \"fd20323d-2d71-474c-a0cc-611daf941cbe\") "
Sep 10 23:38:07.708143 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:07.708120    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd20323d-2d71-474c-a0cc-611daf941cbe-bundle" (OuterVolumeSpecName: "bundle") pod "fd20323d-2d71-474c-a0cc-611daf941cbe" (UID: "fd20323d-2d71-474c-a0cc-611daf941cbe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:38:07.709772 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:07.709741    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd20323d-2d71-474c-a0cc-611daf941cbe-kube-api-access-qkdsd" (OuterVolumeSpecName: "kube-api-access-qkdsd") pod "fd20323d-2d71-474c-a0cc-611daf941cbe" (UID: "fd20323d-2d71-474c-a0cc-611daf941cbe"). InnerVolumeSpecName "kube-api-access-qkdsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:38:07.712776 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:07.712757    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd20323d-2d71-474c-a0cc-611daf941cbe-util" (OuterVolumeSpecName: "util") pod "fd20323d-2d71-474c-a0cc-611daf941cbe" (UID: "fd20323d-2d71-474c-a0cc-611daf941cbe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:38:07.808245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:07.808192    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkdsd\" (UniqueName: \"kubernetes.io/projected/fd20323d-2d71-474c-a0cc-611daf941cbe-kube-api-access-qkdsd\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:07.808245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:07.808213    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd20323d-2d71-474c-a0cc-611daf941cbe-util\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:07.808245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:07.808222    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd20323d-2d71-474c-a0cc-611daf941cbe-bundle\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:08.545318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:08.545282    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx" event={"ID":"fd20323d-2d71-474c-a0cc-611daf941cbe","Type":"ContainerDied","Data":"0103ca85e5ee5ee28e2a52d86630dd1dddb7fcbd713f4ba874be7ad3022fe1e9"}
Sep 10 23:38:08.545481 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:08.545354    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0103ca85e5ee5ee28e2a52d86630dd1dddb7fcbd713f4ba874be7ad3022fe1e9"
Sep 10 23:38:08.545481 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:08.545301    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgdpx"
Sep 10 23:38:10.018939 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:10.018905    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:11.876558 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:11.876526    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:11.988008 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:11.987982    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx"]
Sep 10 23:38:11.988243 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:11.988232    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd20323d-2d71-474c-a0cc-611daf941cbe" containerName="util"
Sep 10 23:38:11.988289 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:11.988246    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd20323d-2d71-474c-a0cc-611daf941cbe" containerName="util"
Sep 10 23:38:11.988289 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:11.988266    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd20323d-2d71-474c-a0cc-611daf941cbe" containerName="pull"
Sep 10 23:38:11.988289 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:11.988271    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd20323d-2d71-474c-a0cc-611daf941cbe" containerName="pull"
Sep 10 23:38:11.988289 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:11.988280    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd20323d-2d71-474c-a0cc-611daf941cbe" containerName="extract"
Sep 10 23:38:11.988289 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:11.988285    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd20323d-2d71-474c-a0cc-611daf941cbe" containerName="extract"
Sep 10 23:38:11.988452 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:11.988324    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd20323d-2d71-474c-a0cc-611daf941cbe" containerName="extract"
Sep 10 23:38:11.991338 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:11.991323    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx"
Sep 10 23:38:11.993741 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:11.993705    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:38:11.993849 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:11.993705    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 23:38:11.993849 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:11.993758    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ssfdz\""
Sep 10 23:38:12.004967 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:12.004937    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx"]
Sep 10 23:38:12.039024 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:12.039000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02078640-a58d-4778-ae8e-9ba3f0da7238-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-779bx\" (UID: \"02078640-a58d-4778-ae8e-9ba3f0da7238\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx"
Sep 10 23:38:12.039097 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:12.039033    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt7z2\" (UniqueName: \"kubernetes.io/projected/02078640-a58d-4778-ae8e-9ba3f0da7238-kube-api-access-gt7z2\") pod \"cert-manager-operator-controller-manager-55c444bf86-779bx\" (UID: \"02078640-a58d-4778-ae8e-9ba3f0da7238\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx"
Sep 10 23:38:12.139609 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:12.139562    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02078640-a58d-4778-ae8e-9ba3f0da7238-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-779bx\" (UID: \"02078640-a58d-4778-ae8e-9ba3f0da7238\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx"
Sep 10 23:38:12.139609 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:12.139589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt7z2\" (UniqueName: \"kubernetes.io/projected/02078640-a58d-4778-ae8e-9ba3f0da7238-kube-api-access-gt7z2\") pod \"cert-manager-operator-controller-manager-55c444bf86-779bx\" (UID: \"02078640-a58d-4778-ae8e-9ba3f0da7238\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx"
Sep 10 23:38:12.139919 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:12.139902    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02078640-a58d-4778-ae8e-9ba3f0da7238-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-779bx\" (UID: \"02078640-a58d-4778-ae8e-9ba3f0da7238\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx"
Sep 10 23:38:12.147828 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:12.147810    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt7z2\" (UniqueName: \"kubernetes.io/projected/02078640-a58d-4778-ae8e-9ba3f0da7238-kube-api-access-gt7z2\") pod \"cert-manager-operator-controller-manager-55c444bf86-779bx\" (UID: \"02078640-a58d-4778-ae8e-9ba3f0da7238\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx"
Sep 10 23:38:12.300114 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:12.300094    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx"
Sep 10 23:38:12.574355 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:12.574326    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx"]
Sep 10 23:38:12.576336 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:38:12.576305    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02078640_a58d_4778_ae8e_9ba3f0da7238.slice/crio-d17fc9628cf52977a7750d7eb393ab25c978eeacd7d71d3707ed965aebc58f35 WatchSource:0}: Error finding container d17fc9628cf52977a7750d7eb393ab25c978eeacd7d71d3707ed965aebc58f35: Status 404 returned error can't find the container with id d17fc9628cf52977a7750d7eb393ab25c978eeacd7d71d3707ed965aebc58f35
Sep 10 23:38:13.565021 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:13.564977    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx" event={"ID":"02078640-a58d-4778-ae8e-9ba3f0da7238","Type":"ContainerStarted","Data":"d17fc9628cf52977a7750d7eb393ab25c978eeacd7d71d3707ed965aebc58f35"}
Sep 10 23:38:13.633157 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:13.633118    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:13.733662 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:13.733621    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:14.576407 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:14.576285    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx" event={"ID":"02078640-a58d-4778-ae8e-9ba3f0da7238","Type":"ContainerStarted","Data":"bbb251c134417b8f1a402473787cbe3b6f62b8cb46e00e3310fc2943220a4793"}
Sep 10 23:38:14.602742 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:14.602674    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-779bx" podStartSLOduration=1.868641765 podStartE2EDuration="3.602657674s" totalImagesPullingTime="1.734015909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:14.600530791 +0000 UTC m=+291.782688919" watchObservedRunningTime="2026-09-10 23:38:14.602657674 +0000 UTC m=+291.784815802"
Sep 10 23:38:14.950915 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:14.950879    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:15.069777 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:15.069744    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:15.267121 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:15.267044    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:15.410613 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:15.410582    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:15.872477 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:15.872448    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"]
Sep 10 23:38:15.875613 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:15.875596    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"
Sep 10 23:38:15.878980 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:15.878955    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:38:15.878980 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:15.878958    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vl76f\""
Sep 10 23:38:15.879819 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:15.879804    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:38:15.886352 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:15.886330    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"]
Sep 10 23:38:15.968011 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:15.967979    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-785s6\" (UniqueName: \"kubernetes.io/projected/fc710113-af12-48fa-8083-275f0508ec73-kube-api-access-785s6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5\" (UID: \"fc710113-af12-48fa-8083-275f0508ec73\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"
Sep 10 23:38:15.968142 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:15.968032    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc710113-af12-48fa-8083-275f0508ec73-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5\" (UID: \"fc710113-af12-48fa-8083-275f0508ec73\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"
Sep 10 23:38:15.968142 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:15.968096    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc710113-af12-48fa-8083-275f0508ec73-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5\" (UID: \"fc710113-af12-48fa-8083-275f0508ec73\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"
Sep 10 23:38:16.068726 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:16.068688    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-785s6\" (UniqueName: \"kubernetes.io/projected/fc710113-af12-48fa-8083-275f0508ec73-kube-api-access-785s6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5\" (UID: \"fc710113-af12-48fa-8083-275f0508ec73\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"
Sep 10 23:38:16.068845 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:16.068756    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc710113-af12-48fa-8083-275f0508ec73-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5\" (UID: \"fc710113-af12-48fa-8083-275f0508ec73\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"
Sep 10 23:38:16.068845 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:16.068783    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc710113-af12-48fa-8083-275f0508ec73-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5\" (UID: \"fc710113-af12-48fa-8083-275f0508ec73\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"
Sep 10 23:38:16.069073 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:16.069057    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc710113-af12-48fa-8083-275f0508ec73-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5\" (UID: \"fc710113-af12-48fa-8083-275f0508ec73\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"
Sep 10 23:38:16.069129 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:16.069100    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc710113-af12-48fa-8083-275f0508ec73-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5\" (UID: \"fc710113-af12-48fa-8083-275f0508ec73\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"
Sep 10 23:38:16.078896 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:16.078877    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-785s6\" (UniqueName: \"kubernetes.io/projected/fc710113-af12-48fa-8083-275f0508ec73-kube-api-access-785s6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5\" (UID: \"fc710113-af12-48fa-8083-275f0508ec73\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"
Sep 10 23:38:16.184850 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:16.184796    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"
Sep 10 23:38:16.453615 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:16.453525    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"]
Sep 10 23:38:16.456151 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:38:16.456124    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc710113_af12_48fa_8083_275f0508ec73.slice/crio-78a7e6bd0198bdd181c7aa888bd11f00a49071f7e561b966a54d889be91285a1 WatchSource:0}: Error finding container 78a7e6bd0198bdd181c7aa888bd11f00a49071f7e561b966a54d889be91285a1: Status 404 returned error can't find the container with id 78a7e6bd0198bdd181c7aa888bd11f00a49071f7e561b966a54d889be91285a1
Sep 10 23:38:16.586134 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:16.586100    2574 generic.go:356] "Generic (PLEG): container finished" podID="fc710113-af12-48fa-8083-275f0508ec73" containerID="90112b8eadb48898cfff744b6c7a44d93cede701ba6ecfc0c8be73a4f31d9909" exitCode=0
Sep 10 23:38:16.586243 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:16.586178    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5" event={"ID":"fc710113-af12-48fa-8083-275f0508ec73","Type":"ContainerDied","Data":"90112b8eadb48898cfff744b6c7a44d93cede701ba6ecfc0c8be73a4f31d9909"}
Sep 10 23:38:16.586243 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:16.586237    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5" event={"ID":"fc710113-af12-48fa-8083-275f0508ec73","Type":"ContainerStarted","Data":"78a7e6bd0198bdd181c7aa888bd11f00a49071f7e561b966a54d889be91285a1"}
Sep 10 23:38:17.649062 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:17.649024    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:17.858967 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:17.858935    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:18.556170 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.556136    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-858d895d6d-dw69r" podUID="3afdb2ff-bd77-4d38-a0b1-06cc85576fbd" containerName="console" containerID="cri-o://145c866c60722505edbde6df74cbc9032d2bf7baeda9a0a7627f50242c33062e" gracePeriod=15
Sep 10 23:38:18.596925 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.596898    2574 generic.go:356] "Generic (PLEG): container finished" podID="fc710113-af12-48fa-8083-275f0508ec73" containerID="7c629a22052e3e2f7ba3fd2ba2b2143dacbbcfa211b0ad753e2f5f500b5ded96" exitCode=0
Sep 10 23:38:18.597031 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.596980    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5" event={"ID":"fc710113-af12-48fa-8083-275f0508ec73","Type":"ContainerDied","Data":"7c629a22052e3e2f7ba3fd2ba2b2143dacbbcfa211b0ad753e2f5f500b5ded96"}
Sep 10 23:38:18.755489 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.755457    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz"]
Sep 10 23:38:18.758618 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.758599    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz"
Sep 10 23:38:18.761071 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.761052    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 23:38:18.761166 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.761084    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 23:38:18.761235 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.761164    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4q77p\""
Sep 10 23:38:18.770269 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.770247    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz"]
Sep 10 23:38:18.789893 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.789870    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8401f19-3404-40f9-882b-15dd34570ebc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j2nqz\" (UID: \"d8401f19-3404-40f9-882b-15dd34570ebc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz"
Sep 10 23:38:18.790025 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.789943    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xglt6\" (UniqueName: \"kubernetes.io/projected/d8401f19-3404-40f9-882b-15dd34570ebc-kube-api-access-xglt6\") pod \"cert-manager-cainjector-559cdd8c87-j2nqz\" (UID: \"d8401f19-3404-40f9-882b-15dd34570ebc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz"
Sep 10 23:38:18.853973 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.853954    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:38:18.891260 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.891233    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-oauth-config\") pod \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") "
Sep 10 23:38:18.891260 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.891262    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-trusted-ca-bundle\") pod \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") "
Sep 10 23:38:18.891407 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.891280    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58f7b\" (UniqueName: \"kubernetes.io/projected/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-kube-api-access-58f7b\") pod \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") "
Sep 10 23:38:18.891407 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.891301    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-config\") pod \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") "
Sep 10 23:38:18.891506 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.891483    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-serving-cert\") pod \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") "
Sep 10 23:38:18.891584 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.891569    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-oauth-serving-cert\") pod \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") "
Sep 10 23:38:18.891639 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.891600    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-service-ca\") pod \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\" (UID: \"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd\") "
Sep 10 23:38:18.891688 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.891668    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-config" (OuterVolumeSpecName: "console-config") pod "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd" (UID: "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:38:18.891771 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.891701    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd" (UID: "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:38:18.891902 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.891879    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8401f19-3404-40f9-882b-15dd34570ebc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j2nqz\" (UID: \"d8401f19-3404-40f9-882b-15dd34570ebc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz"
Sep 10 23:38:18.892002 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.891960    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xglt6\" (UniqueName: \"kubernetes.io/projected/d8401f19-3404-40f9-882b-15dd34570ebc-kube-api-access-xglt6\") pod \"cert-manager-cainjector-559cdd8c87-j2nqz\" (UID: \"d8401f19-3404-40f9-882b-15dd34570ebc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz"
Sep 10 23:38:18.892071 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.892008    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-trusted-ca-bundle\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:18.892071 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.892023    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-config\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:18.892071 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.892026    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd" (UID: "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:38:18.892217 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.892097    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-service-ca" (OuterVolumeSpecName: "service-ca") pod "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd" (UID: "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:38:18.893488 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.893455    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd" (UID: "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:38:18.893565 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.893487    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd" (UID: "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:38:18.893565 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.893519    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-kube-api-access-58f7b" (OuterVolumeSpecName: "kube-api-access-58f7b") pod "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd" (UID: "3afdb2ff-bd77-4d38-a0b1-06cc85576fbd"). InnerVolumeSpecName "kube-api-access-58f7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:38:18.900600 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.900579    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8401f19-3404-40f9-882b-15dd34570ebc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j2nqz\" (UID: \"d8401f19-3404-40f9-882b-15dd34570ebc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz"
Sep 10 23:38:18.900686 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.900630    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xglt6\" (UniqueName: \"kubernetes.io/projected/d8401f19-3404-40f9-882b-15dd34570ebc-kube-api-access-xglt6\") pod \"cert-manager-cainjector-559cdd8c87-j2nqz\" (UID: \"d8401f19-3404-40f9-882b-15dd34570ebc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz"
Sep 10 23:38:18.992318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.992271    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-oauth-config\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:18.992318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.992290    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58f7b\" (UniqueName: \"kubernetes.io/projected/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-kube-api-access-58f7b\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:18.992318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.992299    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-console-serving-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:18.992318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.992307    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-oauth-serving-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:18.992318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:18.992315    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd-service-ca\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:19.087244 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.087225    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz"
Sep 10 23:38:19.354407 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.354376    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz"]
Sep 10 23:38:19.357902 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:38:19.357877    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8401f19_3404_40f9_882b_15dd34570ebc.slice/crio-7cb9b2e921b80598f62f709a593f86a523391eb8b418a76ebd1842f9fcbb20ef WatchSource:0}: Error finding container 7cb9b2e921b80598f62f709a593f86a523391eb8b418a76ebd1842f9fcbb20ef: Status 404 returned error can't find the container with id 7cb9b2e921b80598f62f709a593f86a523391eb8b418a76ebd1842f9fcbb20ef
Sep 10 23:38:19.603251 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.603177    2574 generic.go:356] "Generic (PLEG): container finished" podID="fc710113-af12-48fa-8083-275f0508ec73" containerID="6581c4afa6fae45eb9fca47af51718527bbacf3319381b97b138f154c59360c3" exitCode=0
Sep 10 23:38:19.603458 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.603253    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5" event={"ID":"fc710113-af12-48fa-8083-275f0508ec73","Type":"ContainerDied","Data":"6581c4afa6fae45eb9fca47af51718527bbacf3319381b97b138f154c59360c3"}
Sep 10 23:38:19.604507 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.604487    2574 generic.go:356] "Generic (PLEG): container finished" podID="3afdb2ff-bd77-4d38-a0b1-06cc85576fbd" containerID="145c866c60722505edbde6df74cbc9032d2bf7baeda9a0a7627f50242c33062e" exitCode=0
Sep 10 23:38:19.604603 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.604543    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858d895d6d-dw69r"
Sep 10 23:38:19.604603 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.604560    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858d895d6d-dw69r" event={"ID":"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd","Type":"ContainerDied","Data":"145c866c60722505edbde6df74cbc9032d2bf7baeda9a0a7627f50242c33062e"}
Sep 10 23:38:19.604603 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.604589    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858d895d6d-dw69r" event={"ID":"3afdb2ff-bd77-4d38-a0b1-06cc85576fbd","Type":"ContainerDied","Data":"61091ff77e5959715c48fff1b11fe677f51aa49ac7561b01c2d3532e8941e3ff"}
Sep 10 23:38:19.604735 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.604608    2574 scope.go:117] "RemoveContainer" containerID="145c866c60722505edbde6df74cbc9032d2bf7baeda9a0a7627f50242c33062e"
Sep 10 23:38:19.605925 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.605857    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz" event={"ID":"d8401f19-3404-40f9-882b-15dd34570ebc","Type":"ContainerStarted","Data":"7cb9b2e921b80598f62f709a593f86a523391eb8b418a76ebd1842f9fcbb20ef"}
Sep 10 23:38:19.612445 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.612428    2574 scope.go:117] "RemoveContainer" containerID="145c866c60722505edbde6df74cbc9032d2bf7baeda9a0a7627f50242c33062e"
Sep 10 23:38:19.612734 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:38:19.612693    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"145c866c60722505edbde6df74cbc9032d2bf7baeda9a0a7627f50242c33062e\": container with ID starting with 145c866c60722505edbde6df74cbc9032d2bf7baeda9a0a7627f50242c33062e not found: ID does not exist" containerID="145c866c60722505edbde6df74cbc9032d2bf7baeda9a0a7627f50242c33062e"
Sep 10 23:38:19.612792 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.612743    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"145c866c60722505edbde6df74cbc9032d2bf7baeda9a0a7627f50242c33062e"} err="failed to get container status \"145c866c60722505edbde6df74cbc9032d2bf7baeda9a0a7627f50242c33062e\": rpc error: code = NotFound desc = could not find container \"145c866c60722505edbde6df74cbc9032d2bf7baeda9a0a7627f50242c33062e\": container with ID starting with 145c866c60722505edbde6df74cbc9032d2bf7baeda9a0a7627f50242c33062e not found: ID does not exist"
Sep 10 23:38:19.632786 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.632764    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858d895d6d-dw69r"]
Sep 10 23:38:19.636643 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:19.636615    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-858d895d6d-dw69r"]
Sep 10 23:38:20.430462 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:20.430396    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:20.530676 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:20.530630    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:20.748939 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:20.748915    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"
Sep 10 23:38:20.806665 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:20.806636    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc710113-af12-48fa-8083-275f0508ec73-bundle\") pod \"fc710113-af12-48fa-8083-275f0508ec73\" (UID: \"fc710113-af12-48fa-8083-275f0508ec73\") "
Sep 10 23:38:20.806849 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:20.806751    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-785s6\" (UniqueName: \"kubernetes.io/projected/fc710113-af12-48fa-8083-275f0508ec73-kube-api-access-785s6\") pod \"fc710113-af12-48fa-8083-275f0508ec73\" (UID: \"fc710113-af12-48fa-8083-275f0508ec73\") "
Sep 10 23:38:20.806849 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:20.806791    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc710113-af12-48fa-8083-275f0508ec73-util\") pod \"fc710113-af12-48fa-8083-275f0508ec73\" (UID: \"fc710113-af12-48fa-8083-275f0508ec73\") "
Sep 10 23:38:20.807165 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:20.807135    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc710113-af12-48fa-8083-275f0508ec73-bundle" (OuterVolumeSpecName: "bundle") pod "fc710113-af12-48fa-8083-275f0508ec73" (UID: "fc710113-af12-48fa-8083-275f0508ec73"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:38:20.809365 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:20.809334    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc710113-af12-48fa-8083-275f0508ec73-kube-api-access-785s6" (OuterVolumeSpecName: "kube-api-access-785s6") pod "fc710113-af12-48fa-8083-275f0508ec73" (UID: "fc710113-af12-48fa-8083-275f0508ec73"). InnerVolumeSpecName "kube-api-access-785s6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:38:20.815298 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:20.815265    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc710113-af12-48fa-8083-275f0508ec73-util" (OuterVolumeSpecName: "util") pod "fc710113-af12-48fa-8083-275f0508ec73" (UID: "fc710113-af12-48fa-8083-275f0508ec73"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:38:20.907926 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:20.907893    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc710113-af12-48fa-8083-275f0508ec73-util\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:20.907926 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:20.907926    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc710113-af12-48fa-8083-275f0508ec73-bundle\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:20.908115 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:20.907937    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-785s6\" (UniqueName: \"kubernetes.io/projected/fc710113-af12-48fa-8083-275f0508ec73-kube-api-access-785s6\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:21.256194 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:21.256156    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3afdb2ff-bd77-4d38-a0b1-06cc85576fbd" path="/var/lib/kubelet/pods/3afdb2ff-bd77-4d38-a0b1-06cc85576fbd/volumes"
Sep 10 23:38:21.620865 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:21.620831    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5"
Sep 10 23:38:21.620865 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:21.620846    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bw5" event={"ID":"fc710113-af12-48fa-8083-275f0508ec73","Type":"ContainerDied","Data":"78a7e6bd0198bdd181c7aa888bd11f00a49071f7e561b966a54d889be91285a1"}
Sep 10 23:38:21.621317 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:21.620902    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78a7e6bd0198bdd181c7aa888bd11f00a49071f7e561b966a54d889be91285a1"
Sep 10 23:38:22.626443 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:22.626407    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz" event={"ID":"d8401f19-3404-40f9-882b-15dd34570ebc","Type":"ContainerStarted","Data":"3906502fd729bf602ebd3a6b7c41dc0fb23f836d79e9b4a642ccfd0486594a44"}
Sep 10 23:38:22.643731 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:22.643650    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2nqz" podStartSLOduration=1.8877166760000001 podStartE2EDuration="4.643628725s" totalImagesPullingTime="2.755912049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:38:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:22.641773434 +0000 UTC m=+299.823931564" watchObservedRunningTime="2026-09-10 23:38:22.643628725 +0000 UTC m=+299.825786854"
Sep 10 23:38:23.215969 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.215942    2574 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 23:38:23.352299 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.352171    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-djmrp"]
Sep 10 23:38:23.367841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.352431    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc710113-af12-48fa-8083-275f0508ec73" containerName="pull"
Sep 10 23:38:23.367841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.352442    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc710113-af12-48fa-8083-275f0508ec73" containerName="pull"
Sep 10 23:38:23.367841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.352450    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3afdb2ff-bd77-4d38-a0b1-06cc85576fbd" containerName="console"
Sep 10 23:38:23.367841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.352456    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3afdb2ff-bd77-4d38-a0b1-06cc85576fbd" containerName="console"
Sep 10 23:38:23.367841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.352467    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc710113-af12-48fa-8083-275f0508ec73" containerName="extract"
Sep 10 23:38:23.367841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.352472    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc710113-af12-48fa-8083-275f0508ec73" containerName="extract"
Sep 10 23:38:23.367841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.352484    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc710113-af12-48fa-8083-275f0508ec73" containerName="util"
Sep 10 23:38:23.367841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.352489    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc710113-af12-48fa-8083-275f0508ec73" containerName="util"
Sep 10 23:38:23.367841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.352535    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3afdb2ff-bd77-4d38-a0b1-06cc85576fbd" containerName="console"
Sep 10 23:38:23.367841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.352542    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc710113-af12-48fa-8083-275f0508ec73" containerName="extract"
Sep 10 23:38:23.367841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.356798    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-djmrp"
Sep 10 23:38:23.367841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.358942    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zl4sh\""
Sep 10 23:38:23.367841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.364927    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-djmrp"]
Sep 10 23:38:23.428104 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.428073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvfvf\" (UniqueName: \"kubernetes.io/projected/139bb983-9653-483a-9a0e-9565eff0ef7b-kube-api-access-bvfvf\") pod \"cert-manager-webhook-6486ffd997-djmrp\" (UID: \"139bb983-9653-483a-9a0e-9565eff0ef7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djmrp"
Sep 10 23:38:23.428229 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.428120    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/139bb983-9653-483a-9a0e-9565eff0ef7b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-djmrp\" (UID: \"139bb983-9653-483a-9a0e-9565eff0ef7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djmrp"
Sep 10 23:38:23.528667 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.528602    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/139bb983-9653-483a-9a0e-9565eff0ef7b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-djmrp\" (UID: \"139bb983-9653-483a-9a0e-9565eff0ef7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djmrp"
Sep 10 23:38:23.528794 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.528663    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvfvf\" (UniqueName: \"kubernetes.io/projected/139bb983-9653-483a-9a0e-9565eff0ef7b-kube-api-access-bvfvf\") pod \"cert-manager-webhook-6486ffd997-djmrp\" (UID: \"139bb983-9653-483a-9a0e-9565eff0ef7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djmrp"
Sep 10 23:38:23.536695 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.536668    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/139bb983-9653-483a-9a0e-9565eff0ef7b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-djmrp\" (UID: \"139bb983-9653-483a-9a0e-9565eff0ef7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djmrp"
Sep 10 23:38:23.536810 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.536699    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvfvf\" (UniqueName: \"kubernetes.io/projected/139bb983-9653-483a-9a0e-9565eff0ef7b-kube-api-access-bvfvf\") pod \"cert-manager-webhook-6486ffd997-djmrp\" (UID: \"139bb983-9653-483a-9a0e-9565eff0ef7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djmrp"
Sep 10 23:38:23.665362 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.665334    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-djmrp"
Sep 10 23:38:23.933820 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:23.933797    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-djmrp"]
Sep 10 23:38:23.936211 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:38:23.936185    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod139bb983_9653_483a_9a0e_9565eff0ef7b.slice/crio-6a3abeeb03b7d90ac04d2405784b8becb0ac44bde2611e85eff7aee343e05af2 WatchSource:0}: Error finding container 6a3abeeb03b7d90ac04d2405784b8becb0ac44bde2611e85eff7aee343e05af2: Status 404 returned error can't find the container with id 6a3abeeb03b7d90ac04d2405784b8becb0ac44bde2611e85eff7aee343e05af2
Sep 10 23:38:24.035752 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:24.035699    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:24.136622 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:24.136583    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:24.251098 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:24.251007    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:24.635500 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:24.635463    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-djmrp" event={"ID":"139bb983-9653-483a-9a0e-9565eff0ef7b","Type":"ContainerStarted","Data":"45cfbe425da4b27e889c509ca25360d30ece9abc3181f917a09a06105ad23e49"}
Sep 10 23:38:24.635667 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:24.635512    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-djmrp" event={"ID":"139bb983-9653-483a-9a0e-9565eff0ef7b","Type":"ContainerStarted","Data":"6a3abeeb03b7d90ac04d2405784b8becb0ac44bde2611e85eff7aee343e05af2"}
Sep 10 23:38:24.635667 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:24.635542    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-djmrp"
Sep 10 23:38:24.657857 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:24.657807    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-djmrp" podStartSLOduration=1.6577931769999998 podStartE2EDuration="1.657793177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:38:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:24.655970435 +0000 UTC m=+301.838128573" watchObservedRunningTime="2026-09-10 23:38:24.657793177 +0000 UTC m=+301.839951315"
Sep 10 23:38:25.451996 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:25.451967    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:30.641692 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:30.641661    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-djmrp"
Sep 10 23:38:31.474821 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:31.474788    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:31.574546 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:31.574512    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:33.268151 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.268119    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"]
Sep 10 23:38:33.334683 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.334657    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"]
Sep 10 23:38:33.334841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.334771    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"
Sep 10 23:38:33.337457 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.337424    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:38:33.338187 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.338167    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vl76f\""
Sep 10 23:38:33.338293 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.338191    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:38:33.406968 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.406943    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2283ff1-bcd3-4a9c-9020-5f62082df03e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr\" (UID: \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"
Sep 10 23:38:33.407067 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.406974    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vcv2\" (UniqueName: \"kubernetes.io/projected/b2283ff1-bcd3-4a9c-9020-5f62082df03e-kube-api-access-7vcv2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr\" (UID: \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"
Sep 10 23:38:33.407067 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.407039    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2283ff1-bcd3-4a9c-9020-5f62082df03e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr\" (UID: \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"
Sep 10 23:38:33.507480 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.507451    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2283ff1-bcd3-4a9c-9020-5f62082df03e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr\" (UID: \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"
Sep 10 23:38:33.507603 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.507515    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2283ff1-bcd3-4a9c-9020-5f62082df03e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr\" (UID: \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"
Sep 10 23:38:33.507603 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.507544    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vcv2\" (UniqueName: \"kubernetes.io/projected/b2283ff1-bcd3-4a9c-9020-5f62082df03e-kube-api-access-7vcv2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr\" (UID: \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"
Sep 10 23:38:33.507826 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.507805    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2283ff1-bcd3-4a9c-9020-5f62082df03e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr\" (UID: \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"
Sep 10 23:38:33.507898 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.507852    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2283ff1-bcd3-4a9c-9020-5f62082df03e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr\" (UID: \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"
Sep 10 23:38:33.515198 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.515166    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vcv2\" (UniqueName: \"kubernetes.io/projected/b2283ff1-bcd3-4a9c-9020-5f62082df03e-kube-api-access-7vcv2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr\" (UID: \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"
Sep 10 23:38:33.576756 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.576647    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:33.643996 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.643971    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"
Sep 10 23:38:33.926974 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:33.926951    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"]
Sep 10 23:38:33.929464 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:38:33.929434    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2283ff1_bcd3_4a9c_9020_5f62082df03e.slice/crio-5ffdec5b76a8c64431bbccced923ffd1f2d2e6fa8ca6f74e2069c0abb4b740d8 WatchSource:0}: Error finding container 5ffdec5b76a8c64431bbccced923ffd1f2d2e6fa8ca6f74e2069c0abb4b740d8: Status 404 returned error can't find the container with id 5ffdec5b76a8c64431bbccced923ffd1f2d2e6fa8ca6f74e2069c0abb4b740d8
Sep 10 23:38:34.678949 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:34.678914    2574 generic.go:356] "Generic (PLEG): container finished" podID="b2283ff1-bcd3-4a9c-9020-5f62082df03e" containerID="929a8a668cc757231912adc0311b9fcdd53ed7747b12a2256b92ca111c5a1858" exitCode=0
Sep 10 23:38:34.678949 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:34.678951    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr" event={"ID":"b2283ff1-bcd3-4a9c-9020-5f62082df03e","Type":"ContainerDied","Data":"929a8a668cc757231912adc0311b9fcdd53ed7747b12a2256b92ca111c5a1858"}
Sep 10 23:38:34.679342 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:34.678984    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr" event={"ID":"b2283ff1-bcd3-4a9c-9020-5f62082df03e","Type":"ContainerStarted","Data":"5ffdec5b76a8c64431bbccced923ffd1f2d2e6fa8ca6f74e2069c0abb4b740d8"}
Sep 10 23:38:34.679442 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:34.679425    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:38:35.685121 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:35.685049    2574 generic.go:356] "Generic (PLEG): container finished" podID="b2283ff1-bcd3-4a9c-9020-5f62082df03e" containerID="d696896d17a04e0b94f162aacbbab6632125c9642aa46531eddba79e96b4b899" exitCode=0
Sep 10 23:38:35.685121 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:35.685100    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr" event={"ID":"b2283ff1-bcd3-4a9c-9020-5f62082df03e","Type":"ContainerDied","Data":"d696896d17a04e0b94f162aacbbab6632125c9642aa46531eddba79e96b4b899"}
Sep 10 23:38:36.691098 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:36.691066    2574 generic.go:356] "Generic (PLEG): container finished" podID="b2283ff1-bcd3-4a9c-9020-5f62082df03e" containerID="9791fbb4f8415bbe3a5fd7325e123e019467ab923e124d60a057f3703b861174" exitCode=0
Sep 10 23:38:36.691467 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:36.691129    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr" event={"ID":"b2283ff1-bcd3-4a9c-9020-5f62082df03e","Type":"ContainerDied","Data":"9791fbb4f8415bbe3a5fd7325e123e019467ab923e124d60a057f3703b861174"}
Sep 10 23:38:37.819041 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:37.819013    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"
Sep 10 23:38:37.940862 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:37.940830    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2283ff1-bcd3-4a9c-9020-5f62082df03e-util\") pod \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\" (UID: \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\") "
Sep 10 23:38:37.941053 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:37.940883    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vcv2\" (UniqueName: \"kubernetes.io/projected/b2283ff1-bcd3-4a9c-9020-5f62082df03e-kube-api-access-7vcv2\") pod \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\" (UID: \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\") "
Sep 10 23:38:37.941053 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:37.940941    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2283ff1-bcd3-4a9c-9020-5f62082df03e-bundle\") pod \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\" (UID: \"b2283ff1-bcd3-4a9c-9020-5f62082df03e\") "
Sep 10 23:38:37.941627 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:37.941604    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2283ff1-bcd3-4a9c-9020-5f62082df03e-bundle" (OuterVolumeSpecName: "bundle") pod "b2283ff1-bcd3-4a9c-9020-5f62082df03e" (UID: "b2283ff1-bcd3-4a9c-9020-5f62082df03e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:38:37.943048 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:37.943024    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2283ff1-bcd3-4a9c-9020-5f62082df03e-kube-api-access-7vcv2" (OuterVolumeSpecName: "kube-api-access-7vcv2") pod "b2283ff1-bcd3-4a9c-9020-5f62082df03e" (UID: "b2283ff1-bcd3-4a9c-9020-5f62082df03e"). InnerVolumeSpecName "kube-api-access-7vcv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:38:37.946707 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:37.946659    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2283ff1-bcd3-4a9c-9020-5f62082df03e-util" (OuterVolumeSpecName: "util") pod "b2283ff1-bcd3-4a9c-9020-5f62082df03e" (UID: "b2283ff1-bcd3-4a9c-9020-5f62082df03e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:38:38.041386 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:38.041348    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2283ff1-bcd3-4a9c-9020-5f62082df03e-bundle\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:38.041386 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:38.041380    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2283ff1-bcd3-4a9c-9020-5f62082df03e-util\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:38.041386 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:38.041389    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vcv2\" (UniqueName: \"kubernetes.io/projected/b2283ff1-bcd3-4a9c-9020-5f62082df03e-kube-api-access-7vcv2\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:38.701265 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:38.701237    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr"
Sep 10 23:38:38.701265 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:38.701242    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqjjjr" event={"ID":"b2283ff1-bcd3-4a9c-9020-5f62082df03e","Type":"ContainerDied","Data":"5ffdec5b76a8c64431bbccced923ffd1f2d2e6fa8ca6f74e2069c0abb4b740d8"}
Sep 10 23:38:38.701466 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:38.701281    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ffdec5b76a8c64431bbccced923ffd1f2d2e6fa8ca6f74e2069c0abb4b740d8"
Sep 10 23:38:49.842214 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.842178    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"]
Sep 10 23:38:49.842681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.842454    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2283ff1-bcd3-4a9c-9020-5f62082df03e" containerName="pull"
Sep 10 23:38:49.842681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.842468    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2283ff1-bcd3-4a9c-9020-5f62082df03e" containerName="pull"
Sep 10 23:38:49.842681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.842477    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2283ff1-bcd3-4a9c-9020-5f62082df03e" containerName="extract"
Sep 10 23:38:49.842681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.842483    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2283ff1-bcd3-4a9c-9020-5f62082df03e" containerName="extract"
Sep 10 23:38:49.842681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.842500    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2283ff1-bcd3-4a9c-9020-5f62082df03e" containerName="util"
Sep 10 23:38:49.842681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.842507    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2283ff1-bcd3-4a9c-9020-5f62082df03e" containerName="util"
Sep 10 23:38:49.842681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.842563    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2283ff1-bcd3-4a9c-9020-5f62082df03e" containerName="extract"
Sep 10 23:38:49.844514 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.844498    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"
Sep 10 23:38:49.847013 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.846989    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:38:49.847146 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.847095    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vl76f\""
Sep 10 23:38:49.847219 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.847188    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:38:49.853777 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.853756    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"]
Sep 10 23:38:49.938002 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.937966    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/139e869d-1f09-4b51-af32-495e2712fc1a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc\" (UID: \"139e869d-1f09-4b51-af32-495e2712fc1a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"
Sep 10 23:38:49.938002 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.938005    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/139e869d-1f09-4b51-af32-495e2712fc1a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc\" (UID: \"139e869d-1f09-4b51-af32-495e2712fc1a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"
Sep 10 23:38:49.938211 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:49.938043    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98hwt\" (UniqueName: \"kubernetes.io/projected/139e869d-1f09-4b51-af32-495e2712fc1a-kube-api-access-98hwt\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc\" (UID: \"139e869d-1f09-4b51-af32-495e2712fc1a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"
Sep 10 23:38:50.038902 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:50.038866    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/139e869d-1f09-4b51-af32-495e2712fc1a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc\" (UID: \"139e869d-1f09-4b51-af32-495e2712fc1a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"
Sep 10 23:38:50.038902 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:50.038901    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/139e869d-1f09-4b51-af32-495e2712fc1a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc\" (UID: \"139e869d-1f09-4b51-af32-495e2712fc1a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"
Sep 10 23:38:50.039120 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:50.038938    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98hwt\" (UniqueName: \"kubernetes.io/projected/139e869d-1f09-4b51-af32-495e2712fc1a-kube-api-access-98hwt\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc\" (UID: \"139e869d-1f09-4b51-af32-495e2712fc1a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"
Sep 10 23:38:50.039231 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:50.039211    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/139e869d-1f09-4b51-af32-495e2712fc1a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc\" (UID: \"139e869d-1f09-4b51-af32-495e2712fc1a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"
Sep 10 23:38:50.039337 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:50.039318    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/139e869d-1f09-4b51-af32-495e2712fc1a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc\" (UID: \"139e869d-1f09-4b51-af32-495e2712fc1a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"
Sep 10 23:38:50.052597 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:50.052570    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98hwt\" (UniqueName: \"kubernetes.io/projected/139e869d-1f09-4b51-af32-495e2712fc1a-kube-api-access-98hwt\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc\" (UID: \"139e869d-1f09-4b51-af32-495e2712fc1a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"
Sep 10 23:38:50.153571 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:50.153545    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"
Sep 10 23:38:50.432096 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:50.432071    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"]
Sep 10 23:38:50.433947 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:38:50.433921    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139e869d_1f09_4b51_af32_495e2712fc1a.slice/crio-ed6b01e2211b24917f0ad775f2e77daf5ffc9d690f56286343e8ec3299252a31 WatchSource:0}: Error finding container ed6b01e2211b24917f0ad775f2e77daf5ffc9d690f56286343e8ec3299252a31: Status 404 returned error can't find the container with id ed6b01e2211b24917f0ad775f2e77daf5ffc9d690f56286343e8ec3299252a31
Sep 10 23:38:50.655512 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:50.655473    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:50.750598 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:50.750505    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:50.752279 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:50.752250    2574 generic.go:356] "Generic (PLEG): container finished" podID="139e869d-1f09-4b51-af32-495e2712fc1a" containerID="a9b8958f5d4de163b9e4e48ab75150e35bc4c7ba8184283259c2d91684e104c5" exitCode=0
Sep 10 23:38:50.752401 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:50.752306    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc" event={"ID":"139e869d-1f09-4b51-af32-495e2712fc1a","Type":"ContainerDied","Data":"a9b8958f5d4de163b9e4e48ab75150e35bc4c7ba8184283259c2d91684e104c5"}
Sep 10 23:38:50.752401 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:50.752345    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc" event={"ID":"139e869d-1f09-4b51-af32-495e2712fc1a","Type":"ContainerStarted","Data":"ed6b01e2211b24917f0ad775f2e77daf5ffc9d690f56286343e8ec3299252a31"}
Sep 10 23:38:51.262804 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.262768    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:51.529149 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.529108    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:51.632681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.632645    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:51.671449 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.671417    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"]
Sep 10 23:38:51.673550 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.673534    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.675832 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.675810    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 23:38:51.676042 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.676027    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fds9x\""
Sep 10 23:38:51.676142 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.676120    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 23:38:51.676200 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.676140    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 23:38:51.676384 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.676370    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 23:38:51.692977 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.692952    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"]
Sep 10 23:38:51.754253 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.754226    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea932581-a725-4781-b116-1f744f067766-manifests\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.754372 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.754257    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea932581-a725-4781-b116-1f744f067766-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.754372 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.754281    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea932581-a725-4781-b116-1f744f067766-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.754372 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.754340    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea932581-a725-4781-b116-1f744f067766-tmp\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.754538 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.754390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdxm2\" (UniqueName: \"kubernetes.io/projected/ea932581-a725-4781-b116-1f744f067766-kube-api-access-bdxm2\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.758638 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.758614    2574 generic.go:356] "Generic (PLEG): container finished" podID="139e869d-1f09-4b51-af32-495e2712fc1a" containerID="4fc2df326f3a6119e924361decc75f2ec0b6bc086a1159883e41110595a082ef" exitCode=0
Sep 10 23:38:51.758770 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.758684    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc" event={"ID":"139e869d-1f09-4b51-af32-495e2712fc1a","Type":"ContainerDied","Data":"4fc2df326f3a6119e924361decc75f2ec0b6bc086a1159883e41110595a082ef"}
Sep 10 23:38:51.818581 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.818543    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:51.855420 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.855392    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdxm2\" (UniqueName: \"kubernetes.io/projected/ea932581-a725-4781-b116-1f744f067766-kube-api-access-bdxm2\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.855571 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.855442    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea932581-a725-4781-b116-1f744f067766-manifests\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.855642 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.855574    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea932581-a725-4781-b116-1f744f067766-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.855694 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.855639    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea932581-a725-4781-b116-1f744f067766-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.855840 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.855818    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea932581-a725-4781-b116-1f744f067766-tmp\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.855914 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.855845    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea932581-a725-4781-b116-1f744f067766-manifests\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.858083 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.858053    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea932581-a725-4781-b116-1f744f067766-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.858187 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.858123    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea932581-a725-4781-b116-1f744f067766-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.858321 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.858307    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea932581-a725-4781-b116-1f744f067766-tmp\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.866762 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.866740    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdxm2\" (UniqueName: \"kubernetes.io/projected/ea932581-a725-4781-b116-1f744f067766-kube-api-access-bdxm2\") pod \"opendatahub-operator-controller-manager-bc8465fcf-lglqh\" (UID: \"ea932581-a725-4781-b116-1f744f067766\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:51.918216 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.918186    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:51.983976 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:51.983952    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:52.014846 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:52.014816    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:52.115504 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:52.115469    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:52.218322 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:52.218214    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:52.258075 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:52.258051    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"]
Sep 10 23:38:52.260476 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:38:52.260451    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea932581_a725_4781_b116_1f744f067766.slice/crio-ee51655c903889702538e8f6361f68325c7e1871d668ac9fa818da1a61a862a8 WatchSource:0}: Error finding container ee51655c903889702538e8f6361f68325c7e1871d668ac9fa818da1a61a862a8: Status 404 returned error can't find the container with id ee51655c903889702538e8f6361f68325c7e1871d668ac9fa818da1a61a862a8
Sep 10 23:38:52.320259 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:52.320216    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:52.765449 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:52.765409    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh" event={"ID":"ea932581-a725-4781-b116-1f744f067766","Type":"ContainerStarted","Data":"ee51655c903889702538e8f6361f68325c7e1871d668ac9fa818da1a61a862a8"}
Sep 10 23:38:52.767971 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:52.767938    2574 generic.go:356] "Generic (PLEG): container finished" podID="139e869d-1f09-4b51-af32-495e2712fc1a" containerID="2ca61faf40424578fc056d2418ef4577aa58eb2cb9cf23e1b26f43c6f1e645bc" exitCode=0
Sep 10 23:38:52.768112 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:52.767988    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc" event={"ID":"139e869d-1f09-4b51-af32-495e2712fc1a","Type":"ContainerDied","Data":"2ca61faf40424578fc056d2418ef4577aa58eb2cb9cf23e1b26f43c6f1e645bc"}
Sep 10 23:38:54.278285 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:54.278259    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"
Sep 10 23:38:54.376401 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:54.376363    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98hwt\" (UniqueName: \"kubernetes.io/projected/139e869d-1f09-4b51-af32-495e2712fc1a-kube-api-access-98hwt\") pod \"139e869d-1f09-4b51-af32-495e2712fc1a\" (UID: \"139e869d-1f09-4b51-af32-495e2712fc1a\") "
Sep 10 23:38:54.376585 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:54.376455    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/139e869d-1f09-4b51-af32-495e2712fc1a-util\") pod \"139e869d-1f09-4b51-af32-495e2712fc1a\" (UID: \"139e869d-1f09-4b51-af32-495e2712fc1a\") "
Sep 10 23:38:54.376585 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:54.376513    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/139e869d-1f09-4b51-af32-495e2712fc1a-bundle\") pod \"139e869d-1f09-4b51-af32-495e2712fc1a\" (UID: \"139e869d-1f09-4b51-af32-495e2712fc1a\") "
Sep 10 23:38:54.377601 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:54.377571    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/139e869d-1f09-4b51-af32-495e2712fc1a-bundle" (OuterVolumeSpecName: "bundle") pod "139e869d-1f09-4b51-af32-495e2712fc1a" (UID: "139e869d-1f09-4b51-af32-495e2712fc1a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:38:54.379123 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:54.379089    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/139e869d-1f09-4b51-af32-495e2712fc1a-kube-api-access-98hwt" (OuterVolumeSpecName: "kube-api-access-98hwt") pod "139e869d-1f09-4b51-af32-495e2712fc1a" (UID: "139e869d-1f09-4b51-af32-495e2712fc1a"). InnerVolumeSpecName "kube-api-access-98hwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:38:54.383067 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:54.383030    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/139e869d-1f09-4b51-af32-495e2712fc1a-util" (OuterVolumeSpecName: "util") pod "139e869d-1f09-4b51-af32-495e2712fc1a" (UID: "139e869d-1f09-4b51-af32-495e2712fc1a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:38:54.477676 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:54.477640    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/139e869d-1f09-4b51-af32-495e2712fc1a-util\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:54.477676 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:54.477671    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/139e869d-1f09-4b51-af32-495e2712fc1a-bundle\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:54.477676 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:54.477683    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98hwt\" (UniqueName: \"kubernetes.io/projected/139e869d-1f09-4b51-af32-495e2712fc1a-kube-api-access-98hwt\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:38:54.782073 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:54.782044    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc"
Sep 10 23:38:54.782242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:54.782045    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dh2jc" event={"ID":"139e869d-1f09-4b51-af32-495e2712fc1a","Type":"ContainerDied","Data":"ed6b01e2211b24917f0ad775f2e77daf5ffc9d690f56286343e8ec3299252a31"}
Sep 10 23:38:54.782242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:54.782181    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed6b01e2211b24917f0ad775f2e77daf5ffc9d690f56286343e8ec3299252a31"
Sep 10 23:38:55.788115 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:55.788077    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh" event={"ID":"ea932581-a725-4781-b116-1f744f067766","Type":"ContainerStarted","Data":"793042a14346265a739fb598619ecc2d27f4f58f74a20d79eee5a99ad95605f3"}
Sep 10 23:38:56.793972 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:56.793937    2574 generic.go:356] "Generic (PLEG): container finished" podID="ea932581-a725-4781-b116-1f744f067766" containerID="793042a14346265a739fb598619ecc2d27f4f58f74a20d79eee5a99ad95605f3" exitCode=0
Sep 10 23:38:56.794443 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:56.794035    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh" event={"ID":"ea932581-a725-4781-b116-1f744f067766","Type":"ContainerDied","Data":"793042a14346265a739fb598619ecc2d27f4f58f74a20d79eee5a99ad95605f3"}
Sep 10 23:38:57.800249 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:57.800214    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh" event={"ID":"ea932581-a725-4781-b116-1f744f067766","Type":"ContainerStarted","Data":"ecb17f7741fcae7a64d4ee1bcbf3ca3c924093b3bad4a5dbf96766cfc80828be"}
Sep 10 23:38:57.800677 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:57.800359    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:38:57.837324 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:57.837270    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh" podStartSLOduration=2.391032532 podStartE2EDuration="6.837252955s" totalImagesPullingTime="3.431686761s" totalInitContainerRuntime="1.014533662s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:38:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:57.836340257 +0000 UTC m=+335.018498385" watchObservedRunningTime="2026-09-10 23:38:57.837252955 +0000 UTC m=+335.019411083"
Sep 10 23:38:59.862904 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:59.862867    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:59.964261 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:38:59.964228    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:03.235961 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:03.235919    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:03.335568 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:03.335531    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:08.807065 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:08.807033    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-lglqh"
Sep 10 23:39:10.493212 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:10.493180    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:10.593576 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:10.593541    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:21.214479 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.214392    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:21.309912 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.309847    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"]
Sep 10 23:39:21.310229 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.310211    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="139e869d-1f09-4b51-af32-495e2712fc1a" containerName="pull"
Sep 10 23:39:21.310316 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.310231    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="139e869d-1f09-4b51-af32-495e2712fc1a" containerName="pull"
Sep 10 23:39:21.310316 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.310247    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="139e869d-1f09-4b51-af32-495e2712fc1a" containerName="util"
Sep 10 23:39:21.310316 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.310255    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="139e869d-1f09-4b51-af32-495e2712fc1a" containerName="util"
Sep 10 23:39:21.310316 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.310268    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="139e869d-1f09-4b51-af32-495e2712fc1a" containerName="extract"
Sep 10 23:39:21.310316 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.310278    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="139e869d-1f09-4b51-af32-495e2712fc1a" containerName="extract"
Sep 10 23:39:21.310539 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.310361    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="139e869d-1f09-4b51-af32-495e2712fc1a" containerName="extract"
Sep 10 23:39:21.313376 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.313356    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"
Sep 10 23:39:21.317370 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.317349    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:21.317657 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.317642    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 23:39:21.317752 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.317731    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xg6xs\""
Sep 10 23:39:21.317822 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.317758    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 23:39:21.317876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.317757    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 23:39:21.317876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.317837    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 23:39:21.325397 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.325376    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"]
Sep 10 23:39:21.389845 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.389815    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1-tls-certs\") pod \"kube-auth-proxy-5fb577d9c6-twfq9\" (UID: \"a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"
Sep 10 23:39:21.389845 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.389844    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1-tmp\") pod \"kube-auth-proxy-5fb577d9c6-twfq9\" (UID: \"a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"
Sep 10 23:39:21.390042 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.389878    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwm9m\" (UniqueName: \"kubernetes.io/projected/a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1-kube-api-access-mwm9m\") pod \"kube-auth-proxy-5fb577d9c6-twfq9\" (UID: \"a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"
Sep 10 23:39:21.490435 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.490362    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwm9m\" (UniqueName: \"kubernetes.io/projected/a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1-kube-api-access-mwm9m\") pod \"kube-auth-proxy-5fb577d9c6-twfq9\" (UID: \"a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"
Sep 10 23:39:21.490561 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.490449    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1-tls-certs\") pod \"kube-auth-proxy-5fb577d9c6-twfq9\" (UID: \"a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"
Sep 10 23:39:21.490561 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.490478    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1-tmp\") pod \"kube-auth-proxy-5fb577d9c6-twfq9\" (UID: \"a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"
Sep 10 23:39:21.492681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.492650    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1-tmp\") pod \"kube-auth-proxy-5fb577d9c6-twfq9\" (UID: \"a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"
Sep 10 23:39:21.492833 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.492814    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1-tls-certs\") pod \"kube-auth-proxy-5fb577d9c6-twfq9\" (UID: \"a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"
Sep 10 23:39:21.503599 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.503573    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwm9m\" (UniqueName: \"kubernetes.io/projected/a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1-kube-api-access-mwm9m\") pod \"kube-auth-proxy-5fb577d9c6-twfq9\" (UID: \"a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"
Sep 10 23:39:21.517802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.517779    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j4xjx"]
Sep 10 23:39:21.520870 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.520855    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx"
Sep 10 23:39:21.524905 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.524887    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 23:39:21.525370 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.525357    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fvnrc\""
Sep 10 23:39:21.531992 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.531971    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j4xjx"]
Sep 10 23:39:21.556113 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.556089    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:21.594764 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.594320    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtfhj\" (UniqueName: \"kubernetes.io/projected/0dc796ac-3294-454e-9e5c-945179171754-kube-api-access-jtfhj\") pod \"odh-model-controller-7998c67dc4-j4xjx\" (UID: \"0dc796ac-3294-454e-9e5c-945179171754\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx"
Sep 10 23:39:21.594764 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.594410    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dc796ac-3294-454e-9e5c-945179171754-cert\") pod \"odh-model-controller-7998c67dc4-j4xjx\" (UID: \"0dc796ac-3294-454e-9e5c-945179171754\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx"
Sep 10 23:39:21.622954 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.622924    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"
Sep 10 23:39:21.670290 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.670117    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:21.695537 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.695490    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtfhj\" (UniqueName: \"kubernetes.io/projected/0dc796ac-3294-454e-9e5c-945179171754-kube-api-access-jtfhj\") pod \"odh-model-controller-7998c67dc4-j4xjx\" (UID: \"0dc796ac-3294-454e-9e5c-945179171754\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx"
Sep 10 23:39:21.695660 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.695588    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dc796ac-3294-454e-9e5c-945179171754-cert\") pod \"odh-model-controller-7998c67dc4-j4xjx\" (UID: \"0dc796ac-3294-454e-9e5c-945179171754\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx"
Sep 10 23:39:21.695753 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:39:21.695733    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 23:39:21.695803 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:39:21.695798    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc796ac-3294-454e-9e5c-945179171754-cert podName:0dc796ac-3294-454e-9e5c-945179171754 nodeName:}" failed. No retries permitted until 2026-09-10 23:39:22.195780328 +0000 UTC m=+359.377938434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0dc796ac-3294-454e-9e5c-945179171754-cert") pod "odh-model-controller-7998c67dc4-j4xjx" (UID: "0dc796ac-3294-454e-9e5c-945179171754") : secret "odh-model-controller-webhook-cert" not found
Sep 10 23:39:21.723575 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.723547    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtfhj\" (UniqueName: \"kubernetes.io/projected/0dc796ac-3294-454e-9e5c-945179171754-kube-api-access-jtfhj\") pod \"odh-model-controller-7998c67dc4-j4xjx\" (UID: \"0dc796ac-3294-454e-9e5c-945179171754\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx"
Sep 10 23:39:21.810298 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.810225    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:21.897986 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.897960    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9"]
Sep 10 23:39:21.899835 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:39:21.899810    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ef1b2c_5db2_4c97_97d5_69fbc9e541b1.slice/crio-add03d92e2a7150b56192cdeb1a5ca1722274ca10d90e4958ca03117eab659b3 WatchSource:0}: Error finding container add03d92e2a7150b56192cdeb1a5ca1722274ca10d90e4958ca03117eab659b3: Status 404 returned error can't find the container with id add03d92e2a7150b56192cdeb1a5ca1722274ca10d90e4958ca03117eab659b3
Sep 10 23:39:21.909122 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:21.909097    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9" event={"ID":"a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1","Type":"ContainerStarted","Data":"add03d92e2a7150b56192cdeb1a5ca1722274ca10d90e4958ca03117eab659b3"}
Sep 10 23:39:22.199599 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.199558    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dc796ac-3294-454e-9e5c-945179171754-cert\") pod \"odh-model-controller-7998c67dc4-j4xjx\" (UID: \"0dc796ac-3294-454e-9e5c-945179171754\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx"
Sep 10 23:39:22.199786 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:39:22.199696    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 23:39:22.199786 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:39:22.199772    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc796ac-3294-454e-9e5c-945179171754-cert podName:0dc796ac-3294-454e-9e5c-945179171754 nodeName:}" failed. No retries permitted until 2026-09-10 23:39:23.199756787 +0000 UTC m=+360.381914894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0dc796ac-3294-454e-9e5c-945179171754-cert") pod "odh-model-controller-7998c67dc4-j4xjx" (UID: "0dc796ac-3294-454e-9e5c-945179171754") : secret "odh-model-controller-webhook-cert" not found
Sep 10 23:39:22.273437 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.273394    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:22.285876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.285839    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xc6ww"]
Sep 10 23:39:22.290287 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.290266    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xc6ww"
Sep 10 23:39:22.293466 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.293443    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 23:39:22.311129 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.311109    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xc6ww"]
Sep 10 23:39:22.375790 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.375759    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:22.401042 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.401013    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pklwd\" (UniqueName: \"kubernetes.io/projected/fdcd576f-c48f-4000-93e0-4589decdbffe-kube-api-access-pklwd\") pod \"model-serving-api-54d89bd5fc-xc6ww\" (UID: \"fdcd576f-c48f-4000-93e0-4589decdbffe\") " pod="opendatahub/model-serving-api-54d89bd5fc-xc6ww"
Sep 10 23:39:22.401186 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.401058    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdcd576f-c48f-4000-93e0-4589decdbffe-tls-certs\") pod \"model-serving-api-54d89bd5fc-xc6ww\" (UID: \"fdcd576f-c48f-4000-93e0-4589decdbffe\") " pod="opendatahub/model-serving-api-54d89bd5fc-xc6ww"
Sep 10 23:39:22.501687 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.501620    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdcd576f-c48f-4000-93e0-4589decdbffe-tls-certs\") pod \"model-serving-api-54d89bd5fc-xc6ww\" (UID: \"fdcd576f-c48f-4000-93e0-4589decdbffe\") " pod="opendatahub/model-serving-api-54d89bd5fc-xc6ww"
Sep 10 23:39:22.501855 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.501735    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pklwd\" (UniqueName: \"kubernetes.io/projected/fdcd576f-c48f-4000-93e0-4589decdbffe-kube-api-access-pklwd\") pod \"model-serving-api-54d89bd5fc-xc6ww\" (UID: \"fdcd576f-c48f-4000-93e0-4589decdbffe\") " pod="opendatahub/model-serving-api-54d89bd5fc-xc6ww"
Sep 10 23:39:22.504310 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.504285    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdcd576f-c48f-4000-93e0-4589decdbffe-tls-certs\") pod \"model-serving-api-54d89bd5fc-xc6ww\" (UID: \"fdcd576f-c48f-4000-93e0-4589decdbffe\") " pod="opendatahub/model-serving-api-54d89bd5fc-xc6ww"
Sep 10 23:39:22.510990 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.510858    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pklwd\" (UniqueName: \"kubernetes.io/projected/fdcd576f-c48f-4000-93e0-4589decdbffe-kube-api-access-pklwd\") pod \"model-serving-api-54d89bd5fc-xc6ww\" (UID: \"fdcd576f-c48f-4000-93e0-4589decdbffe\") " pod="opendatahub/model-serving-api-54d89bd5fc-xc6ww"
Sep 10 23:39:22.515764 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.515732    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:22.600632 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.600579    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xc6ww"
Sep 10 23:39:22.626794 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.626680    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:22.634942 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.634857    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"]
Sep 10 23:39:22.638499 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.638478    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.641117 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.640967    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 23:39:22.641228 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.640967    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 23:39:22.641495 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.641473    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qfs4f\""
Sep 10 23:39:22.641633 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.641614    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 23:39:22.641725 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.641698    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 23:39:22.651861 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.651836    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"]
Sep 10 23:39:22.698697 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.698608    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:22.703336 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.703308    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.703478 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.703353    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.703478 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.703371    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx88p\" (UniqueName: \"kubernetes.io/projected/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-kube-api-access-jx88p\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.703478 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.703431    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.703643 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.703484    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.703643 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.703533    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.703643 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.703562    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.804568 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.804483    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.804568 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.804553    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.804816 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.804583    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.804816 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.804622    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.804816 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.804657    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.804816 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.804686    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx88p\" (UniqueName: \"kubernetes.io/projected/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-kube-api-access-jx88p\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.804816 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.804790    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.805253 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.805224    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.807299 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.807276    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.807412 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.807379    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.807541 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.807523    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.807747 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.807728    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.813064 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.813044    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx88p\" (UniqueName: \"kubernetes.io/projected/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-kube-api-access-jx88p\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.813285 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.813267    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-plvn2\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:22.888905 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.888840    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xc6ww"]
Sep 10 23:39:22.891136 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:39:22.891104    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdcd576f_c48f_4000_93e0_4589decdbffe.slice/crio-f7adde360c979e8a2eff4d7268bf2f57bbb3eef96c52a605150582eef155775e WatchSource:0}: Error finding container f7adde360c979e8a2eff4d7268bf2f57bbb3eef96c52a605150582eef155775e: Status 404 returned error can't find the container with id f7adde360c979e8a2eff4d7268bf2f57bbb3eef96c52a605150582eef155775e
Sep 10 23:39:22.916581 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.916533    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xc6ww" event={"ID":"fdcd576f-c48f-4000-93e0-4589decdbffe","Type":"ContainerStarted","Data":"f7adde360c979e8a2eff4d7268bf2f57bbb3eef96c52a605150582eef155775e"}
Sep 10 23:39:22.950846 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:22.950785    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:23.208233 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:23.208194    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dc796ac-3294-454e-9e5c-945179171754-cert\") pod \"odh-model-controller-7998c67dc4-j4xjx\" (UID: \"0dc796ac-3294-454e-9e5c-945179171754\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx"
Sep 10 23:39:23.212626 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:23.212441    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dc796ac-3294-454e-9e5c-945179171754-cert\") pod \"odh-model-controller-7998c67dc4-j4xjx\" (UID: \"0dc796ac-3294-454e-9e5c-945179171754\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx"
Sep 10 23:39:23.236820 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:23.236791    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"]
Sep 10 23:39:23.240064 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:39:23.240033    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1aeb7c8_d35c_4106_abd5_1c2cbc47ec2c.slice/crio-1942c6af18cf8129ae393ed9e4ffe601aded97f27130047a999fb89c9427671c WatchSource:0}: Error finding container 1942c6af18cf8129ae393ed9e4ffe601aded97f27130047a999fb89c9427671c: Status 404 returned error can't find the container with id 1942c6af18cf8129ae393ed9e4ffe601aded97f27130047a999fb89c9427671c
Sep 10 23:39:23.332506 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:23.332426    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fvnrc\""
Sep 10 23:39:23.340597 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:23.340296    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx"
Sep 10 23:39:23.620533 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:23.620494    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:23.925500 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:23.925410    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2" event={"ID":"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c","Type":"ContainerStarted","Data":"1942c6af18cf8129ae393ed9e4ffe601aded97f27130047a999fb89c9427671c"}
Sep 10 23:39:25.347341 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:25.347304    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 23:39:25.608084 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:25.608048    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j4xjx"]
Sep 10 23:39:25.799122 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:39:25.799074    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc796ac_3294_454e_9e5c_945179171754.slice/crio-3905618e648ab54ef74ef2e5bdd02f0975d80231743afce8d0467d5e74587a42 WatchSource:0}: Error finding container 3905618e648ab54ef74ef2e5bdd02f0975d80231743afce8d0467d5e74587a42: Status 404 returned error can't find the container with id 3905618e648ab54ef74ef2e5bdd02f0975d80231743afce8d0467d5e74587a42
Sep 10 23:39:25.937322 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:25.937273    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xc6ww" event={"ID":"fdcd576f-c48f-4000-93e0-4589decdbffe","Type":"ContainerStarted","Data":"f23aa14238e25c77f207997141c94d242bc39c5cf278b090674e653ef53e0544"}
Sep 10 23:39:25.937512 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:25.937444    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-xc6ww"
Sep 10 23:39:25.939141 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:25.939112    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9" event={"ID":"a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1","Type":"ContainerStarted","Data":"1cc983086d3df95c4576b624f846f661a51d6292f963988980517fca0ac9f193"}
Sep 10 23:39:25.940497 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:25.940468    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx" event={"ID":"0dc796ac-3294-454e-9e5c-945179171754","Type":"ContainerStarted","Data":"3905618e648ab54ef74ef2e5bdd02f0975d80231743afce8d0467d5e74587a42"}
Sep 10 23:39:25.955014 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:25.954956    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-xc6ww" podStartSLOduration=1.5019913520000001 podStartE2EDuration="3.954941885s" totalImagesPullingTime="2.452950533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:39:25.952502977 +0000 UTC m=+363.134661105" watchObservedRunningTime="2026-09-10 23:39:25.954941885 +0000 UTC m=+363.137100004"
Sep 10 23:39:25.970080 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:25.970037    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-twfq9" podStartSLOduration=1.526835019 podStartE2EDuration="4.970022881s" totalImagesPullingTime="3.443187862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:39:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:39:25.967726395 +0000 UTC m=+363.149884524" watchObservedRunningTime="2026-09-10 23:39:25.970022881 +0000 UTC m=+363.152181009"
Sep 10 23:39:27.235949 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:27.235904    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:39:27.236357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:27.235982    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:39:27.952540 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:27.952505    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2" event={"ID":"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c","Type":"ContainerStarted","Data":"a4c01e14678769022a9785b18fac1a9dfe8fa284261e07f3a4a3962a27348723"}
Sep 10 23:39:27.952744 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:27.952602    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:27.977449 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:27.977382    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2" podStartSLOduration=1.984594345 podStartE2EDuration="5.977362745s" totalImagesPullingTime="3.9927684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:39:27.974435947 +0000 UTC m=+365.156594075" watchObservedRunningTime="2026-09-10 23:39:27.977362745 +0000 UTC m=+365.159520875"
Sep 10 23:39:28.623840 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:28.623784    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:28.724936 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:28.724885    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:28.959874 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:28.959782    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-plvn2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 23:39:28.959874 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:28.959859    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2" podUID="b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 23:39:29.398310 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.398275    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:29.500502 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.500472    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:29.819637 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.819553    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:29.899325 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.899291    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67f45b7f9f-t5tjg"]
Sep 10 23:39:29.902589 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.902573    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:29.917097 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.917070    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f45b7f9f-t5tjg"]
Sep 10 23:39:29.964269 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.964239    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71465f0a-72a2-4e7f-8990-0ab31c41ce47-trusted-ca-bundle\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:29.964440 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.964307    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71465f0a-72a2-4e7f-8990-0ab31c41ce47-console-serving-cert\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:29.964440 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.964375    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71465f0a-72a2-4e7f-8990-0ab31c41ce47-console-oauth-config\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:29.964571 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.964446    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n7cg\" (UniqueName: \"kubernetes.io/projected/71465f0a-72a2-4e7f-8990-0ab31c41ce47-kube-api-access-9n7cg\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:29.964571 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.964482    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71465f0a-72a2-4e7f-8990-0ab31c41ce47-oauth-serving-cert\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:29.964571 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.964516    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71465f0a-72a2-4e7f-8990-0ab31c41ce47-console-config\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:29.964754 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.964590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71465f0a-72a2-4e7f-8990-0ab31c41ce47-service-ca\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:29.965016 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.964991    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx" event={"ID":"0dc796ac-3294-454e-9e5c-945179171754","Type":"ContainerStarted","Data":"61191224b945bd239be95d2216c7db6bec2afdbcf8a543a737e49732ea712188"}
Sep 10 23:39:29.965275 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.965253    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx"
Sep 10 23:39:29.984603 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.984554    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx" podStartSLOduration=5.356733244 podStartE2EDuration="8.984536445s" totalImagesPullingTime="3.627803201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:39:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:39:29.984399942 +0000 UTC m=+367.166558071" watchObservedRunningTime="2026-09-10 23:39:29.984536445 +0000 UTC m=+367.166694573"
Sep 10 23:39:29.989662 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:29.989638    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:30.065239 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.065210    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71465f0a-72a2-4e7f-8990-0ab31c41ce47-console-serving-cert\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.065402 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.065260    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71465f0a-72a2-4e7f-8990-0ab31c41ce47-console-oauth-config\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.065402 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.065321    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n7cg\" (UniqueName: \"kubernetes.io/projected/71465f0a-72a2-4e7f-8990-0ab31c41ce47-kube-api-access-9n7cg\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.065402 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.065368    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71465f0a-72a2-4e7f-8990-0ab31c41ce47-oauth-serving-cert\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.065402 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.065398    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71465f0a-72a2-4e7f-8990-0ab31c41ce47-console-config\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.065626 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.065428    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71465f0a-72a2-4e7f-8990-0ab31c41ce47-service-ca\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.065626 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.065463    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71465f0a-72a2-4e7f-8990-0ab31c41ce47-trusted-ca-bundle\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.066158 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.066128    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71465f0a-72a2-4e7f-8990-0ab31c41ce47-oauth-serving-cert\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.066304 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.066283    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71465f0a-72a2-4e7f-8990-0ab31c41ce47-service-ca\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.066373 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.066278    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71465f0a-72a2-4e7f-8990-0ab31c41ce47-console-config\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.066432 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.066411    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71465f0a-72a2-4e7f-8990-0ab31c41ce47-trusted-ca-bundle\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.068303 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.068274    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71465f0a-72a2-4e7f-8990-0ab31c41ce47-console-oauth-config\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.068391 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.068281    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71465f0a-72a2-4e7f-8990-0ab31c41ce47-console-serving-cert\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.080586 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.080534    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n7cg\" (UniqueName: \"kubernetes.io/projected/71465f0a-72a2-4e7f-8990-0ab31c41ce47-kube-api-access-9n7cg\") pod \"console-67f45b7f9f-t5tjg\" (UID: \"71465f0a-72a2-4e7f-8990-0ab31c41ce47\") " pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.107976 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.107948    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:30.211520 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.211490    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:30.219132 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.219099    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:30.487327 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.487200    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f45b7f9f-t5tjg"]
Sep 10 23:39:30.489543 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:39:30.489509    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71465f0a_72a2_4e7f_8990_0ab31c41ce47.slice/crio-05b454a95c0c8d93c0871ac3046695dc2dc6e591959f6ab7bc26b81c367afe9d WatchSource:0}: Error finding container 05b454a95c0c8d93c0871ac3046695dc2dc6e591959f6ab7bc26b81c367afe9d: Status 404 returned error can't find the container with id 05b454a95c0c8d93c0871ac3046695dc2dc6e591959f6ab7bc26b81c367afe9d
Sep 10 23:39:30.705556 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.705517    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:30.806312 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.806222    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:30.972029 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.971991    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f45b7f9f-t5tjg" event={"ID":"71465f0a-72a2-4e7f-8990-0ab31c41ce47","Type":"ContainerStarted","Data":"d38d6099ead573f9d0a4eb659136f27b115f9716681b192765a38d4d5421ad0d"}
Sep 10 23:39:30.972527 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.972052    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f45b7f9f-t5tjg" event={"ID":"71465f0a-72a2-4e7f-8990-0ab31c41ce47","Type":"ContainerStarted","Data":"05b454a95c0c8d93c0871ac3046695dc2dc6e591959f6ab7bc26b81c367afe9d"}
Sep 10 23:39:30.994011 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:30.993959    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67f45b7f9f-t5tjg" podStartSLOduration=1.993943383 podStartE2EDuration="1.993943383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:39:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:39:30.992009563 +0000 UTC m=+368.174167692" watchObservedRunningTime="2026-09-10 23:39:30.993943383 +0000 UTC m=+368.176101511"
Sep 10 23:39:31.848156 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:31.848124    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:31.952387 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:31.952347    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:31.959635 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:31.959613    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:32.528524 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:32.528488    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:32.836542 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:32.836457    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:33.185282 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.185238    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:33.245167 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.245134    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"]
Sep 10 23:39:33.245375 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.245353    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2" podUID="b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" containerName="discovery" containerID="cri-o://a4c01e14678769022a9785b18fac1a9dfe8fa284261e07f3a4a3962a27348723" gracePeriod=30
Sep 10 23:39:33.303763 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.303726    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:33.409493 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.409441    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:33.491224 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.491197    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:33.559221 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.559191    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"]
Sep 10 23:39:33.559558 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.559509    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" containerName="discovery"
Sep 10 23:39:33.559558 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.559520    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" containerName="discovery"
Sep 10 23:39:33.559629 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.559589    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" containerName="discovery"
Sep 10 23:39:33.562650 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.562630    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.566009 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.565981    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 23:39:33.566009 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.565993    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 23:39:33.566289 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.566273    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 23:39:33.566343 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.566317    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 23:39:33.566589 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.566569    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h8tbj\""
Sep 10 23:39:33.566674 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.566604    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:39:33.572643 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.572622    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"]
Sep 10 23:39:33.596387 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.596355    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-cacerts\") pod \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") "
Sep 10 23:39:33.596483 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.596395    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-local-certs\") pod \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") "
Sep 10 23:39:33.596483 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.596426    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-csr-ca-configmap\") pod \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") "
Sep 10 23:39:33.596483 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.596471    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-kubeconfig\") pod \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") "
Sep 10 23:39:33.596597 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.596504    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-token\") pod \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") "
Sep 10 23:39:33.596597 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.596585    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jx88p\" (UniqueName: \"kubernetes.io/projected/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-kube-api-access-jx88p\") pod \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") "
Sep 10 23:39:33.596684 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.596615    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-csr-dns-cert\") pod \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\" (UID: \"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c\") "
Sep 10 23:39:33.596917 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.596889    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" (UID: "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:39:33.598795 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.598762    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" (UID: "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:33.598895 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.598786    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-kube-api-access-jx88p" (OuterVolumeSpecName: "kube-api-access-jx88p") pod "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" (UID: "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c"). InnerVolumeSpecName "kube-api-access-jx88p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:39:33.598954 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.598913    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-local-certs" (OuterVolumeSpecName: "local-certs") pod "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" (UID: "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:39:33.599062 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.599043    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" (UID: "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:33.599062 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.599051    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" (UID: "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:39:33.599167 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.599076    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-cacerts" (OuterVolumeSpecName: "cacerts") pod "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" (UID: "b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:33.697842 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.697803    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3e2b7381-2dc3-46f3-9236-8eca519d5c83-manager-config\") pod \"lws-controller-manager-bffb6dd48-x7kqr\" (UID: \"3e2b7381-2dc3-46f3-9236-8eca519d5c83\") " pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.697842 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.697845    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gxmm\" (UniqueName: \"kubernetes.io/projected/3e2b7381-2dc3-46f3-9236-8eca519d5c83-kube-api-access-5gxmm\") pod \"lws-controller-manager-bffb6dd48-x7kqr\" (UID: \"3e2b7381-2dc3-46f3-9236-8eca519d5c83\") " pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.698001 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.697876    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e2b7381-2dc3-46f3-9236-8eca519d5c83-metrics-cert\") pod \"lws-controller-manager-bffb6dd48-x7kqr\" (UID: \"3e2b7381-2dc3-46f3-9236-8eca519d5c83\") " pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.698001 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.697965    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e2b7381-2dc3-46f3-9236-8eca519d5c83-cert\") pod \"lws-controller-manager-bffb6dd48-x7kqr\" (UID: \"3e2b7381-2dc3-46f3-9236-8eca519d5c83\") " pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.698072 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.698007    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-csr-ca-configmap\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:39:33.698072 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.698018    2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-kubeconfig\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:39:33.698072 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.698026    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-token\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:39:33.698072 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.698037    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx88p\" (UniqueName: \"kubernetes.io/projected/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-kube-api-access-jx88p\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:39:33.698072 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.698055    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-istio-csr-dns-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:39:33.698072 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.698062    2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-cacerts\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:39:33.698072 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.698070    2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c-local-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:39:33.798942 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.798873    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e2b7381-2dc3-46f3-9236-8eca519d5c83-cert\") pod \"lws-controller-manager-bffb6dd48-x7kqr\" (UID: \"3e2b7381-2dc3-46f3-9236-8eca519d5c83\") " pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.798942 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.798926    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3e2b7381-2dc3-46f3-9236-8eca519d5c83-manager-config\") pod \"lws-controller-manager-bffb6dd48-x7kqr\" (UID: \"3e2b7381-2dc3-46f3-9236-8eca519d5c83\") " pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.798942 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.798943    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gxmm\" (UniqueName: \"kubernetes.io/projected/3e2b7381-2dc3-46f3-9236-8eca519d5c83-kube-api-access-5gxmm\") pod \"lws-controller-manager-bffb6dd48-x7kqr\" (UID: \"3e2b7381-2dc3-46f3-9236-8eca519d5c83\") " pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.799176 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.798969    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e2b7381-2dc3-46f3-9236-8eca519d5c83-metrics-cert\") pod \"lws-controller-manager-bffb6dd48-x7kqr\" (UID: \"3e2b7381-2dc3-46f3-9236-8eca519d5c83\") " pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.799627 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.799604    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3e2b7381-2dc3-46f3-9236-8eca519d5c83-manager-config\") pod \"lws-controller-manager-bffb6dd48-x7kqr\" (UID: \"3e2b7381-2dc3-46f3-9236-8eca519d5c83\") " pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.801289 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.801268    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e2b7381-2dc3-46f3-9236-8eca519d5c83-metrics-cert\") pod \"lws-controller-manager-bffb6dd48-x7kqr\" (UID: \"3e2b7381-2dc3-46f3-9236-8eca519d5c83\") " pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.801370 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.801328    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e2b7381-2dc3-46f3-9236-8eca519d5c83-cert\") pod \"lws-controller-manager-bffb6dd48-x7kqr\" (UID: \"3e2b7381-2dc3-46f3-9236-8eca519d5c83\") " pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.807574 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.807557    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gxmm\" (UniqueName: \"kubernetes.io/projected/3e2b7381-2dc3-46f3-9236-8eca519d5c83-kube-api-access-5gxmm\") pod \"lws-controller-manager-bffb6dd48-x7kqr\" (UID: \"3e2b7381-2dc3-46f3-9236-8eca519d5c83\") " pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.872669 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.872643    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:33.986301 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.986270    2574 generic.go:356] "Generic (PLEG): container finished" podID="b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" containerID="a4c01e14678769022a9785b18fac1a9dfe8fa284261e07f3a4a3962a27348723" exitCode=0
Sep 10 23:39:33.986474 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.986322    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"
Sep 10 23:39:33.986474 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.986335    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2" event={"ID":"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c","Type":"ContainerDied","Data":"a4c01e14678769022a9785b18fac1a9dfe8fa284261e07f3a4a3962a27348723"}
Sep 10 23:39:33.986474 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.986373    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2" event={"ID":"b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c","Type":"ContainerDied","Data":"1942c6af18cf8129ae393ed9e4ffe601aded97f27130047a999fb89c9427671c"}
Sep 10 23:39:33.986474 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.986400    2574 scope.go:117] "RemoveContainer" containerID="a4c01e14678769022a9785b18fac1a9dfe8fa284261e07f3a4a3962a27348723"
Sep 10 23:39:33.996623 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.996599    2574 scope.go:117] "RemoveContainer" containerID="a4c01e14678769022a9785b18fac1a9dfe8fa284261e07f3a4a3962a27348723"
Sep 10 23:39:33.996883 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:39:33.996866    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4c01e14678769022a9785b18fac1a9dfe8fa284261e07f3a4a3962a27348723\": container with ID starting with a4c01e14678769022a9785b18fac1a9dfe8fa284261e07f3a4a3962a27348723 not found: ID does not exist" containerID="a4c01e14678769022a9785b18fac1a9dfe8fa284261e07f3a4a3962a27348723"
Sep 10 23:39:33.996951 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:33.996890    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4c01e14678769022a9785b18fac1a9dfe8fa284261e07f3a4a3962a27348723"} err="failed to get container status \"a4c01e14678769022a9785b18fac1a9dfe8fa284261e07f3a4a3962a27348723\": rpc error: code = NotFound desc = could not find container \"a4c01e14678769022a9785b18fac1a9dfe8fa284261e07f3a4a3962a27348723\": container with ID starting with a4c01e14678769022a9785b18fac1a9dfe8fa284261e07f3a4a3962a27348723 not found: ID does not exist"
Sep 10 23:39:34.008240 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:34.008216    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"]
Sep 10 23:39:34.008964 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:39:34.008946    2574 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1aeb7c8_d35c_4106_abd5_1c2cbc47ec2c.slice\": RecentStats: unable to find data in memory cache]"
Sep 10 23:39:34.016019 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:34.015998    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-plvn2"]
Sep 10 23:39:34.147615 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:34.147592    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"]
Sep 10 23:39:34.150232 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:39:34.150206    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e2b7381_2dc3_46f3_9236_8eca519d5c83.slice/crio-f5c5c64b850fac8d0478ff00487db25d30dcbb5200ce30c5e578630574b38f85 WatchSource:0}: Error finding container f5c5c64b850fac8d0478ff00487db25d30dcbb5200ce30c5e578630574b38f85: Status 404 returned error can't find the container with id f5c5c64b850fac8d0478ff00487db25d30dcbb5200ce30c5e578630574b38f85
Sep 10 23:39:34.995188 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:34.995147    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr" event={"ID":"3e2b7381-2dc3-46f3-9236-8eca519d5c83","Type":"ContainerStarted","Data":"f5c5c64b850fac8d0478ff00487db25d30dcbb5200ce30c5e578630574b38f85"}
Sep 10 23:39:35.256935 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:35.256847    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c" path="/var/lib/kubelet/pods/b1aeb7c8-d35c-4106-abd5-1c2cbc47ec2c/volumes"
Sep 10 23:39:36.002080 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:36.001989    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr" event={"ID":"3e2b7381-2dc3-46f3-9236-8eca519d5c83","Type":"ContainerStarted","Data":"cca20ee4e15129f15efb2f49e4e0cff90692b87b0f13de2172391b5df5926df1"}
Sep 10 23:39:36.002441 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:36.002086    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:39:36.022681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:36.022627    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr" podStartSLOduration=1.523914786 podStartE2EDuration="3.0226124s" totalImagesPullingTime="1.498697614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:39:36.021004475 +0000 UTC m=+373.203162603" watchObservedRunningTime="2026-09-10 23:39:36.0226124 +0000 UTC m=+373.204770528"
Sep 10 23:39:36.949233 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:36.949203    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-xc6ww"
Sep 10 23:39:36.963017 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:36.962992    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:37.063140 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:37.063104    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:38.923805 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:38.923757    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:38.985210 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:38.985171    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:40.212437 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:40.212398    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:40.212874 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:40.212470    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:40.217127 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:40.217104    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:40.974556 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:40.974513    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-j4xjx"
Sep 10 23:39:41.028821 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:41.028789    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67f45b7f9f-t5tjg"
Sep 10 23:39:41.078357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:41.078324    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69674fb8f8-fkc9h"]
Sep 10 23:39:41.182855 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:41.182821    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:41.247429 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:41.247345    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:41.307397 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:41.307367    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:47.008783 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:39:47.008752    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-bffb6dd48-x7kqr"
Sep 10 23:40:06.103516 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.103470    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69674fb8f8-fkc9h" podUID="ccafe3cd-0a09-45b2-87d4-6653a6294434" containerName="console" containerID="cri-o://80a5a1855c0a9d95732309e3531eaebf719c14c8da6efc9fc8644a75ec4a09bc" gracePeriod=15
Sep 10 23:40:06.343659 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.343635    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:40:06.450492 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.450463    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-serving-cert\") pod \"ccafe3cd-0a09-45b2-87d4-6653a6294434\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") "
Sep 10 23:40:06.450679 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.450500    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-trusted-ca-bundle\") pod \"ccafe3cd-0a09-45b2-87d4-6653a6294434\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") "
Sep 10 23:40:06.450679 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.450525    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-service-ca\") pod \"ccafe3cd-0a09-45b2-87d4-6653a6294434\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") "
Sep 10 23:40:06.450679 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.450564    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzw87\" (UniqueName: \"kubernetes.io/projected/ccafe3cd-0a09-45b2-87d4-6653a6294434-kube-api-access-zzw87\") pod \"ccafe3cd-0a09-45b2-87d4-6653a6294434\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") "
Sep 10 23:40:06.450679 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.450605    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-config\") pod \"ccafe3cd-0a09-45b2-87d4-6653a6294434\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") "
Sep 10 23:40:06.450679 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.450622    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-oauth-config\") pod \"ccafe3cd-0a09-45b2-87d4-6653a6294434\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") "
Sep 10 23:40:06.450679 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.450650    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-oauth-serving-cert\") pod \"ccafe3cd-0a09-45b2-87d4-6653a6294434\" (UID: \"ccafe3cd-0a09-45b2-87d4-6653a6294434\") "
Sep 10 23:40:06.451030 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.450982    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ccafe3cd-0a09-45b2-87d4-6653a6294434" (UID: "ccafe3cd-0a09-45b2-87d4-6653a6294434"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:40:06.451030 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.451010    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-service-ca" (OuterVolumeSpecName: "service-ca") pod "ccafe3cd-0a09-45b2-87d4-6653a6294434" (UID: "ccafe3cd-0a09-45b2-87d4-6653a6294434"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:40:06.451108 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.451024    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-config" (OuterVolumeSpecName: "console-config") pod "ccafe3cd-0a09-45b2-87d4-6653a6294434" (UID: "ccafe3cd-0a09-45b2-87d4-6653a6294434"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:40:06.451343 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.451319    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ccafe3cd-0a09-45b2-87d4-6653a6294434" (UID: "ccafe3cd-0a09-45b2-87d4-6653a6294434"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:40:06.452697 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.452671    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ccafe3cd-0a09-45b2-87d4-6653a6294434" (UID: "ccafe3cd-0a09-45b2-87d4-6653a6294434"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:40:06.452813 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.452762    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccafe3cd-0a09-45b2-87d4-6653a6294434-kube-api-access-zzw87" (OuterVolumeSpecName: "kube-api-access-zzw87") pod "ccafe3cd-0a09-45b2-87d4-6653a6294434" (UID: "ccafe3cd-0a09-45b2-87d4-6653a6294434"). InnerVolumeSpecName "kube-api-access-zzw87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:40:06.452892 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.452875    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ccafe3cd-0a09-45b2-87d4-6653a6294434" (UID: "ccafe3cd-0a09-45b2-87d4-6653a6294434"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:40:06.551419 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.551391    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-config\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:06.551419 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.551413    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-oauth-config\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:06.551551 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.551423    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-oauth-serving-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:06.551551 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.551433    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccafe3cd-0a09-45b2-87d4-6653a6294434-console-serving-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:06.551551 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.551442    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-trusted-ca-bundle\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:06.551551 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.551450    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccafe3cd-0a09-45b2-87d4-6653a6294434-service-ca\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:06.551551 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:06.551457    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzw87\" (UniqueName: \"kubernetes.io/projected/ccafe3cd-0a09-45b2-87d4-6653a6294434-kube-api-access-zzw87\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:07.145732 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:07.145677    2574 generic.go:356] "Generic (PLEG): container finished" podID="ccafe3cd-0a09-45b2-87d4-6653a6294434" containerID="80a5a1855c0a9d95732309e3531eaebf719c14c8da6efc9fc8644a75ec4a09bc" exitCode=0
Sep 10 23:40:07.146113 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:07.145741    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69674fb8f8-fkc9h"
Sep 10 23:40:07.146113 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:07.145771    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69674fb8f8-fkc9h" event={"ID":"ccafe3cd-0a09-45b2-87d4-6653a6294434","Type":"ContainerDied","Data":"80a5a1855c0a9d95732309e3531eaebf719c14c8da6efc9fc8644a75ec4a09bc"}
Sep 10 23:40:07.146113 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:07.145821    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69674fb8f8-fkc9h" event={"ID":"ccafe3cd-0a09-45b2-87d4-6653a6294434","Type":"ContainerDied","Data":"67c3d816ffad283313b99e8bb9aa91ec82202e1f7fd0cdfd4985c46a58ed4956"}
Sep 10 23:40:07.146113 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:07.145846    2574 scope.go:117] "RemoveContainer" containerID="80a5a1855c0a9d95732309e3531eaebf719c14c8da6efc9fc8644a75ec4a09bc"
Sep 10 23:40:07.155180 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:07.155161    2574 scope.go:117] "RemoveContainer" containerID="80a5a1855c0a9d95732309e3531eaebf719c14c8da6efc9fc8644a75ec4a09bc"
Sep 10 23:40:07.155446 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:40:07.155428    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80a5a1855c0a9d95732309e3531eaebf719c14c8da6efc9fc8644a75ec4a09bc\": container with ID starting with 80a5a1855c0a9d95732309e3531eaebf719c14c8da6efc9fc8644a75ec4a09bc not found: ID does not exist" containerID="80a5a1855c0a9d95732309e3531eaebf719c14c8da6efc9fc8644a75ec4a09bc"
Sep 10 23:40:07.155486 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:07.155456    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80a5a1855c0a9d95732309e3531eaebf719c14c8da6efc9fc8644a75ec4a09bc"} err="failed to get container status \"80a5a1855c0a9d95732309e3531eaebf719c14c8da6efc9fc8644a75ec4a09bc\": rpc error: code = NotFound desc = could not find container \"80a5a1855c0a9d95732309e3531eaebf719c14c8da6efc9fc8644a75ec4a09bc\": container with ID starting with 80a5a1855c0a9d95732309e3531eaebf719c14c8da6efc9fc8644a75ec4a09bc not found: ID does not exist"
Sep 10 23:40:07.167196 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:07.167170    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69674fb8f8-fkc9h"]
Sep 10 23:40:07.170962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:07.170941    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69674fb8f8-fkc9h"]
Sep 10 23:40:07.254971 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:07.254944    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccafe3cd-0a09-45b2-87d4-6653a6294434" path="/var/lib/kubelet/pods/ccafe3cd-0a09-45b2-87d4-6653a6294434/volumes"
Sep 10 23:40:22.599883 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:22.599844    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:22.700819 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:22.700778    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:26.262077 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.262042    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"]
Sep 10 23:40:26.262470 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.262354    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccafe3cd-0a09-45b2-87d4-6653a6294434" containerName="console"
Sep 10 23:40:26.262470 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.262365    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccafe3cd-0a09-45b2-87d4-6653a6294434" containerName="console"
Sep 10 23:40:26.262470 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.262423    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccafe3cd-0a09-45b2-87d4-6653a6294434" containerName="console"
Sep 10 23:40:26.266879 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.266862    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"
Sep 10 23:40:26.269228 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.269206    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:40:26.270060 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.270043    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:40:26.270109 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.270047    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vl76f\""
Sep 10 23:40:26.276306 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.276284    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"]
Sep 10 23:40:26.292959 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.292921    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75\" (UID: \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"
Sep 10 23:40:26.293068 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.292994    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75\" (UID: \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"
Sep 10 23:40:26.293142 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.293070    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw4bf\" (UniqueName: \"kubernetes.io/projected/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-kube-api-access-hw4bf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75\" (UID: \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"
Sep 10 23:40:26.365911 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.365880    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"]
Sep 10 23:40:26.369261 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.369246    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"
Sep 10 23:40:26.378844 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.378822    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"]
Sep 10 23:40:26.394020 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.393991    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw4bf\" (UniqueName: \"kubernetes.io/projected/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-kube-api-access-hw4bf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75\" (UID: \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"
Sep 10 23:40:26.394144 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.394033    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75\" (UID: \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"
Sep 10 23:40:26.394144 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.394064    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75\" (UID: \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"
Sep 10 23:40:26.394446 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.394426    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75\" (UID: \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"
Sep 10 23:40:26.394506 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.394444    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75\" (UID: \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"
Sep 10 23:40:26.401948 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.401924    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw4bf\" (UniqueName: \"kubernetes.io/projected/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-kube-api-access-hw4bf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75\" (UID: \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"
Sep 10 23:40:26.464035 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.464006    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"]
Sep 10 23:40:26.467533 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.467518    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"
Sep 10 23:40:26.476167 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.476145    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"]
Sep 10 23:40:26.494703 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.494676    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/568b5280-f801-4c4a-9342-3b2ea6061c2b-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd\" (UID: \"568b5280-f801-4c4a-9342-3b2ea6061c2b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"
Sep 10 23:40:26.494811 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.494744    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/568b5280-f801-4c4a-9342-3b2ea6061c2b-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd\" (UID: \"568b5280-f801-4c4a-9342-3b2ea6061c2b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"
Sep 10 23:40:26.494811 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.494767    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q4wt\" (UniqueName: \"kubernetes.io/projected/568b5280-f801-4c4a-9342-3b2ea6061c2b-kube-api-access-7q4wt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd\" (UID: \"568b5280-f801-4c4a-9342-3b2ea6061c2b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"
Sep 10 23:40:26.567801 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.567741    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"]
Sep 10 23:40:26.571273 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.571258    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"
Sep 10 23:40:26.576123 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.576103    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"
Sep 10 23:40:26.579620 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.579599    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"]
Sep 10 23:40:26.595733 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.595698    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz\" (UID: \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"
Sep 10 23:40:26.595854 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.595771    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78jz7\" (UniqueName: \"kubernetes.io/projected/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-kube-api-access-78jz7\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz\" (UID: \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"
Sep 10 23:40:26.595854 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.595843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/568b5280-f801-4c4a-9342-3b2ea6061c2b-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd\" (UID: \"568b5280-f801-4c4a-9342-3b2ea6061c2b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"
Sep 10 23:40:26.596005 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.595892    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/568b5280-f801-4c4a-9342-3b2ea6061c2b-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd\" (UID: \"568b5280-f801-4c4a-9342-3b2ea6061c2b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"
Sep 10 23:40:26.596005 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.595918    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q4wt\" (UniqueName: \"kubernetes.io/projected/568b5280-f801-4c4a-9342-3b2ea6061c2b-kube-api-access-7q4wt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd\" (UID: \"568b5280-f801-4c4a-9342-3b2ea6061c2b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"
Sep 10 23:40:26.596005 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.595973    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz\" (UID: \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"
Sep 10 23:40:26.596189 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.596171    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/568b5280-f801-4c4a-9342-3b2ea6061c2b-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd\" (UID: \"568b5280-f801-4c4a-9342-3b2ea6061c2b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"
Sep 10 23:40:26.596258 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.596245    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/568b5280-f801-4c4a-9342-3b2ea6061c2b-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd\" (UID: \"568b5280-f801-4c4a-9342-3b2ea6061c2b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"
Sep 10 23:40:26.604655 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.604623    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q4wt\" (UniqueName: \"kubernetes.io/projected/568b5280-f801-4c4a-9342-3b2ea6061c2b-kube-api-access-7q4wt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd\" (UID: \"568b5280-f801-4c4a-9342-3b2ea6061c2b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"
Sep 10 23:40:26.678083 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.678052    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"
Sep 10 23:40:26.696627 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.696592    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1ef955-d72c-424f-8012-e7f0d70431c5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz\" (UID: \"7b1ef955-d72c-424f-8012-e7f0d70431c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"
Sep 10 23:40:26.696752 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.696706    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz\" (UID: \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"
Sep 10 23:40:26.696798 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.696775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz\" (UID: \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"
Sep 10 23:40:26.696833 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.696809    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78jz7\" (UniqueName: \"kubernetes.io/projected/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-kube-api-access-78jz7\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz\" (UID: \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"
Sep 10 23:40:26.696871 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.696842    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1ef955-d72c-424f-8012-e7f0d70431c5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz\" (UID: \"7b1ef955-d72c-424f-8012-e7f0d70431c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"
Sep 10 23:40:26.696908 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.696869    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hfrh\" (UniqueName: \"kubernetes.io/projected/7b1ef955-d72c-424f-8012-e7f0d70431c5-kube-api-access-5hfrh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz\" (UID: \"7b1ef955-d72c-424f-8012-e7f0d70431c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"
Sep 10 23:40:26.697032 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.697011    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz\" (UID: \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"
Sep 10 23:40:26.697129 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.697109    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz\" (UID: \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"
Sep 10 23:40:26.704686 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.704664    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78jz7\" (UniqueName: \"kubernetes.io/projected/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-kube-api-access-78jz7\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz\" (UID: \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"
Sep 10 23:40:26.777037 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.777009    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"
Sep 10 23:40:26.798411 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.798384    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1ef955-d72c-424f-8012-e7f0d70431c5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz\" (UID: \"7b1ef955-d72c-424f-8012-e7f0d70431c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"
Sep 10 23:40:26.798527 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.798418    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hfrh\" (UniqueName: \"kubernetes.io/projected/7b1ef955-d72c-424f-8012-e7f0d70431c5-kube-api-access-5hfrh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz\" (UID: \"7b1ef955-d72c-424f-8012-e7f0d70431c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"
Sep 10 23:40:26.798527 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.798488    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1ef955-d72c-424f-8012-e7f0d70431c5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz\" (UID: \"7b1ef955-d72c-424f-8012-e7f0d70431c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"
Sep 10 23:40:26.798840 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.798818    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1ef955-d72c-424f-8012-e7f0d70431c5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz\" (UID: \"7b1ef955-d72c-424f-8012-e7f0d70431c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"
Sep 10 23:40:26.798913 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.798869    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1ef955-d72c-424f-8012-e7f0d70431c5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz\" (UID: \"7b1ef955-d72c-424f-8012-e7f0d70431c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"
Sep 10 23:40:26.807337 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.807315    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hfrh\" (UniqueName: \"kubernetes.io/projected/7b1ef955-d72c-424f-8012-e7f0d70431c5-kube-api-access-5hfrh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz\" (UID: \"7b1ef955-d72c-424f-8012-e7f0d70431c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"
Sep 10 23:40:26.851408 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.851382    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"]
Sep 10 23:40:26.853166 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:40:26.853138    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd7a0aa_3d5b_47bd_a938_dd3dd8e0c969.slice/crio-4102e9f5efeaa41d5035d9791631d38de5ef99ae194208a65d609f368c6cd353 WatchSource:0}: Error finding container 4102e9f5efeaa41d5035d9791631d38de5ef99ae194208a65d609f368c6cd353: Status 404 returned error can't find the container with id 4102e9f5efeaa41d5035d9791631d38de5ef99ae194208a65d609f368c6cd353
Sep 10 23:40:26.881846 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.881824    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"
Sep 10 23:40:26.952244 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:26.952219    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"]
Sep 10 23:40:26.954874 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:40:26.954830    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568b5280_f801_4c4a_9342_3b2ea6061c2b.slice/crio-3754fe53af7a954a2a24f8aa2ae4e4f2e552f160e5c48c2aa8fe0e78fc291861 WatchSource:0}: Error finding container 3754fe53af7a954a2a24f8aa2ae4e4f2e552f160e5c48c2aa8fe0e78fc291861: Status 404 returned error can't find the container with id 3754fe53af7a954a2a24f8aa2ae4e4f2e552f160e5c48c2aa8fe0e78fc291861
Sep 10 23:40:27.046400 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:27.046377    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"]
Sep 10 23:40:27.048608 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:40:27.048578    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f0f2e4_54b6_4df0_96bf_c5ad3bc9b2ae.slice/crio-4ae93f0a4fea072126c6b83797fd82fdaeebcde141d922ba4a60f7ed3dc8aff2 WatchSource:0}: Error finding container 4ae93f0a4fea072126c6b83797fd82fdaeebcde141d922ba4a60f7ed3dc8aff2: Status 404 returned error can't find the container with id 4ae93f0a4fea072126c6b83797fd82fdaeebcde141d922ba4a60f7ed3dc8aff2
Sep 10 23:40:27.155639 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:27.155617    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"]
Sep 10 23:40:27.180479 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:40:27.180446    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1ef955_d72c_424f_8012_e7f0d70431c5.slice/crio-5791fee79fdd6d2ef08450b40fc360718ea05c0a1400cef588daea2f637488df WatchSource:0}: Error finding container 5791fee79fdd6d2ef08450b40fc360718ea05c0a1400cef588daea2f637488df: Status 404 returned error can't find the container with id 5791fee79fdd6d2ef08450b40fc360718ea05c0a1400cef588daea2f637488df
Sep 10 23:40:27.239459 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:27.239433    2574 generic.go:356] "Generic (PLEG): container finished" podID="568b5280-f801-4c4a-9342-3b2ea6061c2b" containerID="98ed16dc237480b5085a540e17dcb799bf11af5d19fdc6f2f2cdba19d6c39bc8" exitCode=0
Sep 10 23:40:27.239570 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:27.239486    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd" event={"ID":"568b5280-f801-4c4a-9342-3b2ea6061c2b","Type":"ContainerDied","Data":"98ed16dc237480b5085a540e17dcb799bf11af5d19fdc6f2f2cdba19d6c39bc8"}
Sep 10 23:40:27.239570 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:27.239546    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd" event={"ID":"568b5280-f801-4c4a-9342-3b2ea6061c2b","Type":"ContainerStarted","Data":"3754fe53af7a954a2a24f8aa2ae4e4f2e552f160e5c48c2aa8fe0e78fc291861"}
Sep 10 23:40:27.241296 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:27.241268    2574 generic.go:356] "Generic (PLEG): container finished" podID="8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969" containerID="9acbd1e0f08aa73f07b3484486c06a3c8d45a54853120d25894dd20d0d3d4e11" exitCode=0
Sep 10 23:40:27.241512 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:27.241311    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75" event={"ID":"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969","Type":"ContainerDied","Data":"9acbd1e0f08aa73f07b3484486c06a3c8d45a54853120d25894dd20d0d3d4e11"}
Sep 10 23:40:27.241512 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:27.241375    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75" event={"ID":"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969","Type":"ContainerStarted","Data":"4102e9f5efeaa41d5035d9791631d38de5ef99ae194208a65d609f368c6cd353"}
Sep 10 23:40:27.243445 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:27.243424    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz" event={"ID":"7b1ef955-d72c-424f-8012-e7f0d70431c5","Type":"ContainerStarted","Data":"c5a320b1cafbf53c5973c12f8972977ac86f3883ed18ed2887d1c2725a964522"}
Sep 10 23:40:27.243547 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:27.243480    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz" event={"ID":"7b1ef955-d72c-424f-8012-e7f0d70431c5","Type":"ContainerStarted","Data":"5791fee79fdd6d2ef08450b40fc360718ea05c0a1400cef588daea2f637488df"}
Sep 10 23:40:27.245133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:27.245112    2574 generic.go:356] "Generic (PLEG): container finished" podID="d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae" containerID="4cd035b0b295f9b684c201d5d2d4739bc53e1fa87f13515d7bd8023f25d5c966" exitCode=0
Sep 10 23:40:27.245203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:27.245179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz" event={"ID":"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae","Type":"ContainerDied","Data":"4cd035b0b295f9b684c201d5d2d4739bc53e1fa87f13515d7bd8023f25d5c966"}
Sep 10 23:40:27.245249 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:27.245206    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz" event={"ID":"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae","Type":"ContainerStarted","Data":"4ae93f0a4fea072126c6b83797fd82fdaeebcde141d922ba4a60f7ed3dc8aff2"}
Sep 10 23:40:28.253965 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:28.253921    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75" event={"ID":"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969","Type":"ContainerStarted","Data":"ae43a43895956ca3c328c7c7ba7b5e97c4c7d3248919e0fc138ccf9876ef399f"}
Sep 10 23:40:28.256345 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:28.256280    2574 generic.go:356] "Generic (PLEG): container finished" podID="7b1ef955-d72c-424f-8012-e7f0d70431c5" containerID="c5a320b1cafbf53c5973c12f8972977ac86f3883ed18ed2887d1c2725a964522" exitCode=0
Sep 10 23:40:28.256529 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:28.256508    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz" event={"ID":"7b1ef955-d72c-424f-8012-e7f0d70431c5","Type":"ContainerDied","Data":"c5a320b1cafbf53c5973c12f8972977ac86f3883ed18ed2887d1c2725a964522"}
Sep 10 23:40:28.260583 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:28.260546    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz" event={"ID":"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae","Type":"ContainerStarted","Data":"80605012830b043221d9be06a9567fb3c53da124b31411988452f9060c6f93a4"}
Sep 10 23:40:28.263332 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:28.263296    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd" event={"ID":"568b5280-f801-4c4a-9342-3b2ea6061c2b","Type":"ContainerStarted","Data":"8fd1bf968bc8d24e415aac61f0e7cfb24aa804893e8b9b8bbf78b878a479f7cb"}
Sep 10 23:40:29.269086 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:29.269048    2574 generic.go:356] "Generic (PLEG): container finished" podID="8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969" containerID="ae43a43895956ca3c328c7c7ba7b5e97c4c7d3248919e0fc138ccf9876ef399f" exitCode=0
Sep 10 23:40:29.269508 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:29.269134    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75" event={"ID":"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969","Type":"ContainerDied","Data":"ae43a43895956ca3c328c7c7ba7b5e97c4c7d3248919e0fc138ccf9876ef399f"}
Sep 10 23:40:29.271048 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:29.271027    2574 generic.go:356] "Generic (PLEG): container finished" podID="7b1ef955-d72c-424f-8012-e7f0d70431c5" containerID="4d1589130c91d5585a3d791bccb25b16337406143fd06f13c4a229ec06d162b4" exitCode=0
Sep 10 23:40:29.271137 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:29.271110    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz" event={"ID":"7b1ef955-d72c-424f-8012-e7f0d70431c5","Type":"ContainerDied","Data":"4d1589130c91d5585a3d791bccb25b16337406143fd06f13c4a229ec06d162b4"}
Sep 10 23:40:29.273307 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:29.273285    2574 generic.go:356] "Generic (PLEG): container finished" podID="d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae" containerID="80605012830b043221d9be06a9567fb3c53da124b31411988452f9060c6f93a4" exitCode=0
Sep 10 23:40:29.273390 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:29.273362    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz" event={"ID":"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae","Type":"ContainerDied","Data":"80605012830b043221d9be06a9567fb3c53da124b31411988452f9060c6f93a4"}
Sep 10 23:40:29.275476 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:29.275455    2574 generic.go:356] "Generic (PLEG): container finished" podID="568b5280-f801-4c4a-9342-3b2ea6061c2b" containerID="8fd1bf968bc8d24e415aac61f0e7cfb24aa804893e8b9b8bbf78b878a479f7cb" exitCode=0
Sep 10 23:40:29.275575 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:29.275502    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd" event={"ID":"568b5280-f801-4c4a-9342-3b2ea6061c2b","Type":"ContainerDied","Data":"8fd1bf968bc8d24e415aac61f0e7cfb24aa804893e8b9b8bbf78b878a479f7cb"}
Sep 10 23:40:30.283979 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:30.283947    2574 generic.go:356] "Generic (PLEG): container finished" podID="568b5280-f801-4c4a-9342-3b2ea6061c2b" containerID="62b4b32eaf9db043b3171d45489b49472131c182fc3d88e6086964d002d6743b" exitCode=0
Sep 10 23:40:30.284444 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:30.284026    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd" event={"ID":"568b5280-f801-4c4a-9342-3b2ea6061c2b","Type":"ContainerDied","Data":"62b4b32eaf9db043b3171d45489b49472131c182fc3d88e6086964d002d6743b"}
Sep 10 23:40:30.286183 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:30.286160    2574 generic.go:356] "Generic (PLEG): container finished" podID="8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969" containerID="f95015d777ae3f842d618ecdd82d6ca10e5f5e75b2fe40523766e30187b1f020" exitCode=0
Sep 10 23:40:30.286297 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:30.286229    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75" event={"ID":"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969","Type":"ContainerDied","Data":"f95015d777ae3f842d618ecdd82d6ca10e5f5e75b2fe40523766e30187b1f020"}
Sep 10 23:40:30.288382 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:30.288360    2574 generic.go:356] "Generic (PLEG): container finished" podID="7b1ef955-d72c-424f-8012-e7f0d70431c5" containerID="72235274f64439beae508f2d2ecfa4e47bd26a456e6d76dd0924058e5a6d3b12" exitCode=0
Sep 10 23:40:30.288490 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:30.288437    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz" event={"ID":"7b1ef955-d72c-424f-8012-e7f0d70431c5","Type":"ContainerDied","Data":"72235274f64439beae508f2d2ecfa4e47bd26a456e6d76dd0924058e5a6d3b12"}
Sep 10 23:40:30.290463 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:30.290445    2574 generic.go:356] "Generic (PLEG): container finished" podID="d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae" containerID="546fa968018bc86232b23b6300712d12dcba621ec89460218e180e86efab71a4" exitCode=0
Sep 10 23:40:30.290548 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:30.290504    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz" event={"ID":"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae","Type":"ContainerDied","Data":"546fa968018bc86232b23b6300712d12dcba621ec89460218e180e86efab71a4"}
Sep 10 23:40:31.426060 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.426036    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"
Sep 10 23:40:31.436621 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.436595    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-util\") pod \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\" (UID: \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\") "
Sep 10 23:40:31.436770 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.436706    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78jz7\" (UniqueName: \"kubernetes.io/projected/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-kube-api-access-78jz7\") pod \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\" (UID: \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\") "
Sep 10 23:40:31.436770 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.436749    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-bundle\") pod \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\" (UID: \"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae\") "
Sep 10 23:40:31.437436 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.437408    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-bundle" (OuterVolumeSpecName: "bundle") pod "d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae" (UID: "d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:40:31.439103 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.439078    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-kube-api-access-78jz7" (OuterVolumeSpecName: "kube-api-access-78jz7") pod "d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae" (UID: "d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae"). InnerVolumeSpecName "kube-api-access-78jz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:40:31.446528 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.446335    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-util" (OuterVolumeSpecName: "util") pod "d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae" (UID: "d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:40:31.473654 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.466943    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"
Sep 10 23:40:31.496629 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.496606    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"
Sep 10 23:40:31.499843 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.499822    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"
Sep 10 23:40:31.537775 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.537750    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-bundle\") pod \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\" (UID: \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\") "
Sep 10 23:40:31.537900 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.537807    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q4wt\" (UniqueName: \"kubernetes.io/projected/568b5280-f801-4c4a-9342-3b2ea6061c2b-kube-api-access-7q4wt\") pod \"568b5280-f801-4c4a-9342-3b2ea6061c2b\" (UID: \"568b5280-f801-4c4a-9342-3b2ea6061c2b\") "
Sep 10 23:40:31.537900 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.537840    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/568b5280-f801-4c4a-9342-3b2ea6061c2b-bundle\") pod \"568b5280-f801-4c4a-9342-3b2ea6061c2b\" (UID: \"568b5280-f801-4c4a-9342-3b2ea6061c2b\") "
Sep 10 23:40:31.538014 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.537904    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-util\") pod \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\" (UID: \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\") "
Sep 10 23:40:31.538014 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.537935    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/568b5280-f801-4c4a-9342-3b2ea6061c2b-util\") pod \"568b5280-f801-4c4a-9342-3b2ea6061c2b\" (UID: \"568b5280-f801-4c4a-9342-3b2ea6061c2b\") "
Sep 10 23:40:31.538014 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.537982    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hw4bf\" (UniqueName: \"kubernetes.io/projected/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-kube-api-access-hw4bf\") pod \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\" (UID: \"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969\") "
Sep 10 23:40:31.538182 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.538011    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1ef955-d72c-424f-8012-e7f0d70431c5-util\") pod \"7b1ef955-d72c-424f-8012-e7f0d70431c5\" (UID: \"7b1ef955-d72c-424f-8012-e7f0d70431c5\") "
Sep 10 23:40:31.538182 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.538042    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hfrh\" (UniqueName: \"kubernetes.io/projected/7b1ef955-d72c-424f-8012-e7f0d70431c5-kube-api-access-5hfrh\") pod \"7b1ef955-d72c-424f-8012-e7f0d70431c5\" (UID: \"7b1ef955-d72c-424f-8012-e7f0d70431c5\") "
Sep 10 23:40:31.538182 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.538070    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1ef955-d72c-424f-8012-e7f0d70431c5-bundle\") pod \"7b1ef955-d72c-424f-8012-e7f0d70431c5\" (UID: \"7b1ef955-d72c-424f-8012-e7f0d70431c5\") "
Sep 10 23:40:31.538329 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.538313    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78jz7\" (UniqueName: \"kubernetes.io/projected/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-kube-api-access-78jz7\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:31.538388 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.538336    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-bundle\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:31.538388 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.538350    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae-util\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:31.538484 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.538396    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-bundle" (OuterVolumeSpecName: "bundle") pod "8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969" (UID: "8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:40:31.538912 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.538862    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1ef955-d72c-424f-8012-e7f0d70431c5-bundle" (OuterVolumeSpecName: "bundle") pod "7b1ef955-d72c-424f-8012-e7f0d70431c5" (UID: "7b1ef955-d72c-424f-8012-e7f0d70431c5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:40:31.538912 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.538886    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/568b5280-f801-4c4a-9342-3b2ea6061c2b-bundle" (OuterVolumeSpecName: "bundle") pod "568b5280-f801-4c4a-9342-3b2ea6061c2b" (UID: "568b5280-f801-4c4a-9342-3b2ea6061c2b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:40:31.540559 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.540521    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/568b5280-f801-4c4a-9342-3b2ea6061c2b-kube-api-access-7q4wt" (OuterVolumeSpecName: "kube-api-access-7q4wt") pod "568b5280-f801-4c4a-9342-3b2ea6061c2b" (UID: "568b5280-f801-4c4a-9342-3b2ea6061c2b"). InnerVolumeSpecName "kube-api-access-7q4wt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:40:31.540754 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.540730    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-kube-api-access-hw4bf" (OuterVolumeSpecName: "kube-api-access-hw4bf") pod "8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969" (UID: "8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969"). InnerVolumeSpecName "kube-api-access-hw4bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:40:31.540857 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.540840    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b1ef955-d72c-424f-8012-e7f0d70431c5-kube-api-access-5hfrh" (OuterVolumeSpecName: "kube-api-access-5hfrh") pod "7b1ef955-d72c-424f-8012-e7f0d70431c5" (UID: "7b1ef955-d72c-424f-8012-e7f0d70431c5"). InnerVolumeSpecName "kube-api-access-5hfrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:40:31.545549 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.545511    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/568b5280-f801-4c4a-9342-3b2ea6061c2b-util" (OuterVolumeSpecName: "util") pod "568b5280-f801-4c4a-9342-3b2ea6061c2b" (UID: "568b5280-f801-4c4a-9342-3b2ea6061c2b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:40:31.547295 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.547243    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-util" (OuterVolumeSpecName: "util") pod "8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969" (UID: "8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:40:31.547438 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.547418    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1ef955-d72c-424f-8012-e7f0d70431c5-util" (OuterVolumeSpecName: "util") pod "7b1ef955-d72c-424f-8012-e7f0d70431c5" (UID: "7b1ef955-d72c-424f-8012-e7f0d70431c5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:40:31.639634 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.639596    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw4bf\" (UniqueName: \"kubernetes.io/projected/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-kube-api-access-hw4bf\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:31.639634 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.639628    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1ef955-d72c-424f-8012-e7f0d70431c5-util\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:31.639634 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.639639    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hfrh\" (UniqueName: \"kubernetes.io/projected/7b1ef955-d72c-424f-8012-e7f0d70431c5-kube-api-access-5hfrh\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:31.639845 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.639649    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1ef955-d72c-424f-8012-e7f0d70431c5-bundle\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:31.639845 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.639657    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-bundle\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:31.639845 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.639664    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q4wt\" (UniqueName: \"kubernetes.io/projected/568b5280-f801-4c4a-9342-3b2ea6061c2b-kube-api-access-7q4wt\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:31.639845 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.639671    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/568b5280-f801-4c4a-9342-3b2ea6061c2b-bundle\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:31.639845 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.639679    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969-util\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:31.639845 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:31.639686    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/568b5280-f801-4c4a-9342-3b2ea6061c2b-util\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:40:32.301812 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:32.301781    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75"
Sep 10 23:40:32.301812 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:32.301786    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c669m75" event={"ID":"8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969","Type":"ContainerDied","Data":"4102e9f5efeaa41d5035d9791631d38de5ef99ae194208a65d609f368c6cd353"}
Sep 10 23:40:32.302004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:32.301827    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4102e9f5efeaa41d5035d9791631d38de5ef99ae194208a65d609f368c6cd353"
Sep 10 23:40:32.303809 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:32.303784    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz" event={"ID":"7b1ef955-d72c-424f-8012-e7f0d70431c5","Type":"ContainerDied","Data":"5791fee79fdd6d2ef08450b40fc360718ea05c0a1400cef588daea2f637488df"}
Sep 10 23:40:32.303809 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:32.303803    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75tmfz"
Sep 10 23:40:32.303982 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:32.303822    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5791fee79fdd6d2ef08450b40fc360718ea05c0a1400cef588daea2f637488df"
Sep 10 23:40:32.305774 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:32.305748    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz" event={"ID":"d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae","Type":"ContainerDied","Data":"4ae93f0a4fea072126c6b83797fd82fdaeebcde141d922ba4a60f7ed3dc8aff2"}
Sep 10 23:40:32.305774 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:32.305767    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czjwvz"
Sep 10 23:40:32.305914 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:32.305791    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ae93f0a4fea072126c6b83797fd82fdaeebcde141d922ba4a60f7ed3dc8aff2"
Sep 10 23:40:32.307860 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:32.307841    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd" event={"ID":"568b5280-f801-4c4a-9342-3b2ea6061c2b","Type":"ContainerDied","Data":"3754fe53af7a954a2a24f8aa2ae4e4f2e552f160e5c48c2aa8fe0e78fc291861"}
Sep 10 23:40:32.307931 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:32.307876    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7pwfd"
Sep 10 23:40:32.307984 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:32.307878    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3754fe53af7a954a2a24f8aa2ae4e4f2e552f160e5c48c2aa8fe0e78fc291861"
Sep 10 23:40:35.990807 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:35.990772    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:36.786010 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:36.785975    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:40.024421 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:40.024364    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:40.235768 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:40.235732    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:41.651463 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:41.651426    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:42.219064 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:42.219025    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:42.602763 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:42.602656    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:42.991363 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:42.991319    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:43.275975 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:43.275889    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:46.203133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:46.203039    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:48.083007 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:48.082968    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:49.086935 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:49.086898    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:49.175951 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:49.175915    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:49.415635 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:49.415603    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:49.515982 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:49.515948    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:52.595384 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.595351    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:52.602804 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.602773    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"]
Sep 10 23:40:52.603082 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603070    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1ef955-d72c-424f-8012-e7f0d70431c5" containerName="pull"
Sep 10 23:40:52.603136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603083    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1ef955-d72c-424f-8012-e7f0d70431c5" containerName="pull"
Sep 10 23:40:52.603136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603097    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1ef955-d72c-424f-8012-e7f0d70431c5" containerName="util"
Sep 10 23:40:52.603136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603102    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1ef955-d72c-424f-8012-e7f0d70431c5" containerName="util"
Sep 10 23:40:52.603136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603107    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="568b5280-f801-4c4a-9342-3b2ea6061c2b" containerName="pull"
Sep 10 23:40:52.603136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603113    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="568b5280-f801-4c4a-9342-3b2ea6061c2b" containerName="pull"
Sep 10 23:40:52.603136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603118    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1ef955-d72c-424f-8012-e7f0d70431c5" containerName="extract"
Sep 10 23:40:52.603136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603123    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1ef955-d72c-424f-8012-e7f0d70431c5" containerName="extract"
Sep 10 23:40:52.603136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603132    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae" containerName="util"
Sep 10 23:40:52.603136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603137    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae" containerName="util"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603145    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="568b5280-f801-4c4a-9342-3b2ea6061c2b" containerName="util"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603150    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="568b5280-f801-4c4a-9342-3b2ea6061c2b" containerName="util"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603157    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969" containerName="pull"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603161    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969" containerName="pull"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603168    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="568b5280-f801-4c4a-9342-3b2ea6061c2b" containerName="extract"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603174    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="568b5280-f801-4c4a-9342-3b2ea6061c2b" containerName="extract"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603181    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae" containerName="extract"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603187    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae" containerName="extract"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603193    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969" containerName="extract"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603199    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969" containerName="extract"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603206    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969" containerName="util"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603211    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969" containerName="util"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603220    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae" containerName="pull"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603225    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae" containerName="pull"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603274    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b1ef955-d72c-424f-8012-e7f0d70431c5" containerName="extract"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603282    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="568b5280-f801-4c4a-9342-3b2ea6061c2b" containerName="extract"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603288    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f0f2e4-54b6-4df0-96bf-c5ad3bc9b2ae" containerName="extract"
Sep 10 23:40:52.603431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.603295    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fd7a0aa-3d5b-47bd-a938-dd3dd8e0c969" containerName="extract"
Sep 10 23:40:52.606656 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.606631    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"
Sep 10 23:40:52.610194 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.610171    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 10 23:40:52.610311 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.610220    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rk876\""
Sep 10 23:40:52.610827 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.610802    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 10 23:40:52.610947 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.610836    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 23:40:52.610947 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.610900    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 23:40:52.615629 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.615609    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"]
Sep 10 23:40:52.703251 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.703217    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/551edb9a-9e7d-484b-8e5b-f92f784e4cd9-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vv7dl\" (UID: \"551edb9a-9e7d-484b-8e5b-f92f784e4cd9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"
Sep 10 23:40:52.703404 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.703252    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5tw7\" (UniqueName: \"kubernetes.io/projected/551edb9a-9e7d-484b-8e5b-f92f784e4cd9-kube-api-access-x5tw7\") pod \"kuadrant-console-plugin-fbdd4f445-vv7dl\" (UID: \"551edb9a-9e7d-484b-8e5b-f92f784e4cd9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"
Sep 10 23:40:52.703404 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.703296    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/551edb9a-9e7d-484b-8e5b-f92f784e4cd9-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vv7dl\" (UID: \"551edb9a-9e7d-484b-8e5b-f92f784e4cd9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"
Sep 10 23:40:52.804539 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.804508    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/551edb9a-9e7d-484b-8e5b-f92f784e4cd9-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vv7dl\" (UID: \"551edb9a-9e7d-484b-8e5b-f92f784e4cd9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"
Sep 10 23:40:52.804684 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.804582    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/551edb9a-9e7d-484b-8e5b-f92f784e4cd9-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vv7dl\" (UID: \"551edb9a-9e7d-484b-8e5b-f92f784e4cd9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"
Sep 10 23:40:52.804684 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.804601    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5tw7\" (UniqueName: \"kubernetes.io/projected/551edb9a-9e7d-484b-8e5b-f92f784e4cd9-kube-api-access-x5tw7\") pod \"kuadrant-console-plugin-fbdd4f445-vv7dl\" (UID: \"551edb9a-9e7d-484b-8e5b-f92f784e4cd9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"
Sep 10 23:40:52.805267 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.805246    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/551edb9a-9e7d-484b-8e5b-f92f784e4cd9-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vv7dl\" (UID: \"551edb9a-9e7d-484b-8e5b-f92f784e4cd9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"
Sep 10 23:40:52.806935 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.806914    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/551edb9a-9e7d-484b-8e5b-f92f784e4cd9-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vv7dl\" (UID: \"551edb9a-9e7d-484b-8e5b-f92f784e4cd9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"
Sep 10 23:40:52.813866 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.813845    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5tw7\" (UniqueName: \"kubernetes.io/projected/551edb9a-9e7d-484b-8e5b-f92f784e4cd9-kube-api-access-x5tw7\") pod \"kuadrant-console-plugin-fbdd4f445-vv7dl\" (UID: \"551edb9a-9e7d-484b-8e5b-f92f784e4cd9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"
Sep 10 23:40:52.831992 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.831964    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:52.898847 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.898820    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:52.919744 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:52.919725    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"
Sep 10 23:40:53.078369 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:53.078336    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:53.171650 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:53.171567    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:53.188939 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:53.188910    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl"]
Sep 10 23:40:53.191356 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:40:53.191331    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod551edb9a_9e7d_484b_8e5b_f92f784e4cd9.slice/crio-7b6705616b113dfa8ccfde96994d4f90947d41e7d55d71880a93ce0aea7e04c1 WatchSource:0}: Error finding container 7b6705616b113dfa8ccfde96994d4f90947d41e7d55d71880a93ce0aea7e04c1: Status 404 returned error can't find the container with id 7b6705616b113dfa8ccfde96994d4f90947d41e7d55d71880a93ce0aea7e04c1
Sep 10 23:40:53.407879 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:53.407845    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl" event={"ID":"551edb9a-9e7d-484b-8e5b-f92f784e4cd9","Type":"ContainerStarted","Data":"7b6705616b113dfa8ccfde96994d4f90947d41e7d55d71880a93ce0aea7e04c1"}
Sep 10 23:40:57.798232 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:57.798195    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:57.878892 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:57.878865    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:57.978896 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:57.978862    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:58.441333 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:58.441295    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl" event={"ID":"551edb9a-9e7d-484b-8e5b-f92f784e4cd9","Type":"ContainerStarted","Data":"387044fa7f040cc466c4ca9a982b883627784ea1ecce5cdd136829292e7f2694"}
Sep 10 23:40:58.471554 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:40:58.471501    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vv7dl" podStartSLOduration=2.092705948 podStartE2EDuration="6.47148594s" totalImagesPullingTime="4.378779992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:40:58.466104986 +0000 UTC m=+455.648263115" watchObservedRunningTime="2026-09-10 23:40:58.47148594 +0000 UTC m=+455.653644096"
Sep 10 23:41:00.111528 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:00.111482    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:00.224975 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:00.224938    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:04.793673 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:04.793632    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:04.895622 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:04.895573    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:08.584787 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:08.584750    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:08.684559 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:08.684523    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:08.788771 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:08.788732    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:08.883196 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:08.883159    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:10.376565 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:10.376532    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:10.476945 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:10.476907    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:16.782034 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:16.781987    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:16.868436 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:16.868400    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:16.966453 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:16.966422    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:23.683370 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:23.683329    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:23.785225 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:23.785190    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:27.490444 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:27.490397    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:27.555227 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:27.555194    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:28.087182 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:28.087141    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:28.187669 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:28.187637    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:30.502687 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:30.502647    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:30.561561 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:30.561523    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:35.658394 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:35.658359    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:35.757432 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:35.757391    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:36.898249 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:36.898210    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:36.955816 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:36.955784    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:37.492927 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:37.492891    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:37.548575 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:37.548538    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:38.089177 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:38.089144    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:38.157032 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:38.157000    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:45.094663 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:45.094625    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:45.195356 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:45.195318    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:48.626836 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:48.626799    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:48.726894 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:48.726855    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:48.826931 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:48.826901    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:49.023397 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.023323    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:41:49.026446 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.026431    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"
Sep 10 23:41:49.028722 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.028683    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 23:41:49.033706 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.033687    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:41:49.067074 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.067048    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:41:49.067903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.067880    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-895b2\" (UniqueName: \"kubernetes.io/projected/c284c4b1-4c47-485f-b62c-005a68d9d4ba-kube-api-access-895b2\") pod \"limitador-limitador-84994f7ffc-qv8kn\" (UID: \"c284c4b1-4c47-485f-b62c-005a68d9d4ba\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"
Sep 10 23:41:49.068073 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.068055    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c284c4b1-4c47-485f-b62c-005a68d9d4ba-config-file\") pod \"limitador-limitador-84994f7ffc-qv8kn\" (UID: \"c284c4b1-4c47-485f-b62c-005a68d9d4ba\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"
Sep 10 23:41:49.169442 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.169414    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-895b2\" (UniqueName: \"kubernetes.io/projected/c284c4b1-4c47-485f-b62c-005a68d9d4ba-kube-api-access-895b2\") pod \"limitador-limitador-84994f7ffc-qv8kn\" (UID: \"c284c4b1-4c47-485f-b62c-005a68d9d4ba\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"
Sep 10 23:41:49.169568 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.169444    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c284c4b1-4c47-485f-b62c-005a68d9d4ba-config-file\") pod \"limitador-limitador-84994f7ffc-qv8kn\" (UID: \"c284c4b1-4c47-485f-b62c-005a68d9d4ba\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"
Sep 10 23:41:49.170030 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.170014    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c284c4b1-4c47-485f-b62c-005a68d9d4ba-config-file\") pod \"limitador-limitador-84994f7ffc-qv8kn\" (UID: \"c284c4b1-4c47-485f-b62c-005a68d9d4ba\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"
Sep 10 23:41:49.177098 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.177071    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-895b2\" (UniqueName: \"kubernetes.io/projected/c284c4b1-4c47-485f-b62c-005a68d9d4ba-kube-api-access-895b2\") pod \"limitador-limitador-84994f7ffc-qv8kn\" (UID: \"c284c4b1-4c47-485f-b62c-005a68d9d4ba\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"
Sep 10 23:41:49.336629 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.336564    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"
Sep 10 23:41:49.419280 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.419249    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-httgn"]
Sep 10 23:41:49.422700 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.422682    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-httgn"
Sep 10 23:41:49.425384 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.425364    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bn728\""
Sep 10 23:41:49.434670 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.434649    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-httgn"]
Sep 10 23:41:49.472994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.472973    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7m8h\" (UniqueName: \"kubernetes.io/projected/17e3d8a5-8158-491d-971c-c8c54ab2bdef-kube-api-access-n7m8h\") pod \"authorino-7bcfd8f9cd-httgn\" (UID: \"17e3d8a5-8158-491d-971c-c8c54ab2bdef\") " pod="kuadrant-system/authorino-7bcfd8f9cd-httgn"
Sep 10 23:41:49.499055 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.499030    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:49.573978 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.573956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7m8h\" (UniqueName: \"kubernetes.io/projected/17e3d8a5-8158-491d-971c-c8c54ab2bdef-kube-api-access-n7m8h\") pod \"authorino-7bcfd8f9cd-httgn\" (UID: \"17e3d8a5-8158-491d-971c-c8c54ab2bdef\") " pod="kuadrant-system/authorino-7bcfd8f9cd-httgn"
Sep 10 23:41:49.584057 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.584033    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7m8h\" (UniqueName: \"kubernetes.io/projected/17e3d8a5-8158-491d-971c-c8c54ab2bdef-kube-api-access-n7m8h\") pod \"authorino-7bcfd8f9cd-httgn\" (UID: \"17e3d8a5-8158-491d-971c-c8c54ab2bdef\") " pod="kuadrant-system/authorino-7bcfd8f9cd-httgn"
Sep 10 23:41:49.606720 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.606688    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:41:49.609288 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:41:49.609265    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc284c4b1_4c47_485f_b62c_005a68d9d4ba.slice/crio-579496c8e907f40259dc729151c12574c5f98564f86134e654691385c3508ae7 WatchSource:0}: Error finding container 579496c8e907f40259dc729151c12574c5f98564f86134e654691385c3508ae7: Status 404 returned error can't find the container with id 579496c8e907f40259dc729151c12574c5f98564f86134e654691385c3508ae7
Sep 10 23:41:49.618808 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.618783    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:49.690077 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.690049    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-qv8kn" event={"ID":"c284c4b1-4c47-485f-b62c-005a68d9d4ba","Type":"ContainerStarted","Data":"579496c8e907f40259dc729151c12574c5f98564f86134e654691385c3508ae7"}
Sep 10 23:41:49.732280 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.732245    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-httgn"
Sep 10 23:41:49.999004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:49.998980    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-httgn"]
Sep 10 23:41:50.000840 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:41:50.000814    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17e3d8a5_8158_491d_971c_c8c54ab2bdef.slice/crio-a6a709eb4cc66f0ac3a9de6f0d5b6b193d7fc5457255f90443165150b64a14f5 WatchSource:0}: Error finding container a6a709eb4cc66f0ac3a9de6f0d5b6b193d7fc5457255f90443165150b64a14f5: Status 404 returned error can't find the container with id a6a709eb4cc66f0ac3a9de6f0d5b6b193d7fc5457255f90443165150b64a14f5
Sep 10 23:41:50.699043 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:50.699003    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-httgn" event={"ID":"17e3d8a5-8158-491d-971c-c8c54ab2bdef","Type":"ContainerStarted","Data":"a6a709eb4cc66f0ac3a9de6f0d5b6b193d7fc5457255f90443165150b64a14f5"}
Sep 10 23:41:52.537913 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:52.537881    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-httgn"]
Sep 10 23:41:52.712096 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:52.712062    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-qv8kn" event={"ID":"c284c4b1-4c47-485f-b62c-005a68d9d4ba","Type":"ContainerStarted","Data":"89c13af9b9a425693e30c226c8390f808b9eba9d4f34f607d5d212cd549e629d"}
Sep 10 23:41:52.712268 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:52.712234    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"
Sep 10 23:41:52.713761 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:52.713740    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-httgn" event={"ID":"17e3d8a5-8158-491d-971c-c8c54ab2bdef","Type":"ContainerStarted","Data":"f8086831bdb103dc35cd6d703765bd8e3515dec503ab8c749f5848041bd39604"}
Sep 10 23:41:52.726864 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:52.726825    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-qv8kn" podStartSLOduration=1.029849229 podStartE2EDuration="3.726810009s" totalImagesPullingTime="2.69696078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:41:52.725773299 +0000 UTC m=+509.907931424" watchObservedRunningTime="2026-09-10 23:41:52.726810009 +0000 UTC m=+509.908968137"
Sep 10 23:41:52.740140 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:52.740101    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-httgn" podStartSLOduration=1.427697468 podStartE2EDuration="3.740091388s" totalImagesPullingTime="2.31239392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:41:52.738053176 +0000 UTC m=+509.920211317" watchObservedRunningTime="2026-09-10 23:41:52.740091388 +0000 UTC m=+509.922249515"
Sep 10 23:41:53.718653 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:53.718609    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-httgn" podUID="17e3d8a5-8158-491d-971c-c8c54ab2bdef" containerName="authorino" containerID="cri-o://f8086831bdb103dc35cd6d703765bd8e3515dec503ab8c749f5848041bd39604" gracePeriod=30
Sep 10 23:41:53.962824 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:53.962798    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-httgn"
Sep 10 23:41:54.014445 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:54.014379    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7m8h\" (UniqueName: \"kubernetes.io/projected/17e3d8a5-8158-491d-971c-c8c54ab2bdef-kube-api-access-n7m8h\") pod \"17e3d8a5-8158-491d-971c-c8c54ab2bdef\" (UID: \"17e3d8a5-8158-491d-971c-c8c54ab2bdef\") "
Sep 10 23:41:54.016419 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:54.016395    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17e3d8a5-8158-491d-971c-c8c54ab2bdef-kube-api-access-n7m8h" (OuterVolumeSpecName: "kube-api-access-n7m8h") pod "17e3d8a5-8158-491d-971c-c8c54ab2bdef" (UID: "17e3d8a5-8158-491d-971c-c8c54ab2bdef"). InnerVolumeSpecName "kube-api-access-n7m8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:41:54.114913 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:54.114886    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7m8h\" (UniqueName: \"kubernetes.io/projected/17e3d8a5-8158-491d-971c-c8c54ab2bdef-kube-api-access-n7m8h\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:41:54.724273 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:54.724234    2574 generic.go:356] "Generic (PLEG): container finished" podID="17e3d8a5-8158-491d-971c-c8c54ab2bdef" containerID="f8086831bdb103dc35cd6d703765bd8e3515dec503ab8c749f5848041bd39604" exitCode=0
Sep 10 23:41:54.724273 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:54.724268    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-httgn"
Sep 10 23:41:54.724774 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:54.724318    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-httgn" event={"ID":"17e3d8a5-8158-491d-971c-c8c54ab2bdef","Type":"ContainerDied","Data":"f8086831bdb103dc35cd6d703765bd8e3515dec503ab8c749f5848041bd39604"}
Sep 10 23:41:54.724774 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:54.724353    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-httgn" event={"ID":"17e3d8a5-8158-491d-971c-c8c54ab2bdef","Type":"ContainerDied","Data":"a6a709eb4cc66f0ac3a9de6f0d5b6b193d7fc5457255f90443165150b64a14f5"}
Sep 10 23:41:54.724774 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:54.724378    2574 scope.go:117] "RemoveContainer" containerID="f8086831bdb103dc35cd6d703765bd8e3515dec503ab8c749f5848041bd39604"
Sep 10 23:41:54.733002 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:54.732984    2574 scope.go:117] "RemoveContainer" containerID="f8086831bdb103dc35cd6d703765bd8e3515dec503ab8c749f5848041bd39604"
Sep 10 23:41:54.733271 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:41:54.733253    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8086831bdb103dc35cd6d703765bd8e3515dec503ab8c749f5848041bd39604\": container with ID starting with f8086831bdb103dc35cd6d703765bd8e3515dec503ab8c749f5848041bd39604 not found: ID does not exist" containerID="f8086831bdb103dc35cd6d703765bd8e3515dec503ab8c749f5848041bd39604"
Sep 10 23:41:54.733322 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:54.733279    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8086831bdb103dc35cd6d703765bd8e3515dec503ab8c749f5848041bd39604"} err="failed to get container status \"f8086831bdb103dc35cd6d703765bd8e3515dec503ab8c749f5848041bd39604\": rpc error: code = NotFound desc = could not find container \"f8086831bdb103dc35cd6d703765bd8e3515dec503ab8c749f5848041bd39604\": container with ID starting with f8086831bdb103dc35cd6d703765bd8e3515dec503ab8c749f5848041bd39604 not found: ID does not exist"
Sep 10 23:41:54.744013 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:54.743987    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-httgn"]
Sep 10 23:41:54.745988 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:54.745968    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-httgn"]
Sep 10 23:41:55.255542 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:41:55.255513    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17e3d8a5-8158-491d-971c-c8c54ab2bdef" path="/var/lib/kubelet/pods/17e3d8a5-8158-491d-971c-c8c54ab2bdef/volumes"
Sep 10 23:42:03.719535 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:03.719500    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"
Sep 10 23:42:08.809145 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:08.809112    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:08.909030 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:08.908999    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:09.291387 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:09.291351    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:11.990006 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:11.989969    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:21.183650 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:21.183553    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:21.420759 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:21.420707    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:26.211146 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:26.211107    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:26.311627 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:26.311590    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:28.267847 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:28.267810    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:28.366739 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:28.366672    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:28.420412 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:28.420382    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:28.521175 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:28.521092    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:28.622943 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:28.622891    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:31.257640 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:31.257606    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:31.823408 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:31.823334    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:31.922898 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:42:31.922861    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:01.039261 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:01.039220    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:01.139106 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:01.139067    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:02.567689 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:02.567653    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:02.661263 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:02.661227    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:02.736769 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:02.736734    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:02.997603 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:02.997569    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:03.104760 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:03.104707    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:03.143441 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:03.143407    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:43:03.189247 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:03.189216    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:13.111456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:13.111034    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:14.180275 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:14.180234    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:24.424003 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:24.423971    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:25.093760 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:25.093725    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:43:26.899517 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:26.899474    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:26.948444 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:26.948411    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:31.659942 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:31.659911    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:31.760874 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:31.760843    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:42.721769 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:42.721727    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:43.311379 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:43.311345    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:43:53.298002 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.297928    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"]
Sep 10 23:43:53.298338 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.298219    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e3d8a5-8158-491d-971c-c8c54ab2bdef" containerName="authorino"
Sep 10 23:43:53.298338 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.298229    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e3d8a5-8158-491d-971c-c8c54ab2bdef" containerName="authorino"
Sep 10 23:43:53.298338 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.298292    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="17e3d8a5-8158-491d-971c-c8c54ab2bdef" containerName="authorino"
Sep 10 23:43:53.301038 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.301021    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.304343 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.304316    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 23:43:53.304525 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.304316    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2vpzq\""
Sep 10 23:43:53.304525 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.304359    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 23:43:53.304525 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.304389    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 23:43:53.310955 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.310935    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"]
Sep 10 23:43:53.405679 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.405646    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:53.412851 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.412826    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.412988 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.412871    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twc94\" (UniqueName: \"kubernetes.io/projected/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-kube-api-access-twc94\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.412988 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.412906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.412988 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.412971    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.413126 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.413004    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.413126 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.413027    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.514056 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.514027    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twc94\" (UniqueName: \"kubernetes.io/projected/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-kube-api-access-twc94\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.514175 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.514065    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.514175 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.514101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.514175 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.514125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.514175 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.514139    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.514175 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.514166    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.514555 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.514529    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.514696 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.514601    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.514696 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.514623    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.516420 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.516383    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.516496 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.516484    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.521305 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.521279    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twc94\" (UniqueName: \"kubernetes.io/projected/ae77297f-d4ae-4b90-8fe6-637efbe36ed0-kube-api-access-twc94\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw\" (UID: \"ae77297f-d4ae-4b90-8fe6-637efbe36ed0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.612052 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.612031    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:43:53.880863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.880836    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"]
Sep 10 23:43:53.882172 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:43:53.882144    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae77297f_d4ae_4b90_8fe6_637efbe36ed0.slice/crio-7a275ac46340f0960ccd11af0bbd3b1544530e973f9070ec8e235131210182f3 WatchSource:0}: Error finding container 7a275ac46340f0960ccd11af0bbd3b1544530e973f9070ec8e235131210182f3: Status 404 returned error can't find the container with id 7a275ac46340f0960ccd11af0bbd3b1544530e973f9070ec8e235131210182f3
Sep 10 23:43:53.883564 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:53.883544    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:43:54.199996 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:54.199911    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:43:54.318317 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:54.318279    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw" event={"ID":"ae77297f-d4ae-4b90-8fe6-637efbe36ed0","Type":"ContainerStarted","Data":"7a275ac46340f0960ccd11af0bbd3b1544530e973f9070ec8e235131210182f3"}
Sep 10 23:43:55.325078 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:55.325041    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw" event={"ID":"ae77297f-d4ae-4b90-8fe6-637efbe36ed0","Type":"ContainerStarted","Data":"172546ca562f0d5369ea94d2e5c493d1320efd677a32a9ba97a5cb872a7da5f8"}
Sep 10 23:43:55.342183 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:43:55.342128    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw" podStartSLOduration=1.372285644 podStartE2EDuration="2.342111646s" totalImagesPullingTime="969.826002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:55.340134692 +0000 UTC m=+632.522292829" watchObservedRunningTime="2026-09-10 23:43:55.342111646 +0000 UTC m=+632.524269764"
Sep 10 23:44:03.612675 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:03.612642    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:44:03.613152 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:03.612696    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:44:03.625072 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:03.625049    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:44:04.376704 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:04.376674    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw"
Sep 10 23:44:09.191204 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.191171    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"]
Sep 10 23:44:09.194538 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.194515    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.196798 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.196775    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 10 23:44:09.204771 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.204745    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"]
Sep 10 23:44:09.216141 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.216118    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:09.343384 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.343354    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9de3ef46-ed9e-4596-8e2a-e96df9e06146-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.343510 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.343390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9de3ef46-ed9e-4596-8e2a-e96df9e06146-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.343510 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.343408    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9de3ef46-ed9e-4596-8e2a-e96df9e06146-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.343510 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.343499    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8jbc\" (UniqueName: \"kubernetes.io/projected/9de3ef46-ed9e-4596-8e2a-e96df9e06146-kube-api-access-h8jbc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.343630 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.343527    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9de3ef46-ed9e-4596-8e2a-e96df9e06146-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.343630 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.343565    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9de3ef46-ed9e-4596-8e2a-e96df9e06146-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.444961 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.444892    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9de3ef46-ed9e-4596-8e2a-e96df9e06146-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.444961 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.444920    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9de3ef46-ed9e-4596-8e2a-e96df9e06146-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.445171 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.444966    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8jbc\" (UniqueName: \"kubernetes.io/projected/9de3ef46-ed9e-4596-8e2a-e96df9e06146-kube-api-access-h8jbc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.445171 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.444986    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9de3ef46-ed9e-4596-8e2a-e96df9e06146-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.445171 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.445017    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9de3ef46-ed9e-4596-8e2a-e96df9e06146-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.445171 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.445040    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9de3ef46-ed9e-4596-8e2a-e96df9e06146-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.445360 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.445277    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9de3ef46-ed9e-4596-8e2a-e96df9e06146-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.445396 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.445355    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9de3ef46-ed9e-4596-8e2a-e96df9e06146-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.445465 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.445443    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9de3ef46-ed9e-4596-8e2a-e96df9e06146-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.447207 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.447184    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9de3ef46-ed9e-4596-8e2a-e96df9e06146-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.447485 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.447467    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9de3ef46-ed9e-4596-8e2a-e96df9e06146-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.451826 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.451802    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8jbc\" (UniqueName: \"kubernetes.io/projected/9de3ef46-ed9e-4596-8e2a-e96df9e06146-kube-api-access-h8jbc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtnsf\" (UID: \"9de3ef46-ed9e-4596-8e2a-e96df9e06146\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.506454 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.506427    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:09.776494 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:09.776466    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"]
Sep 10 23:44:09.778576 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:44:09.778544    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de3ef46_ed9e_4596_8e2a_e96df9e06146.slice/crio-98357788addabbf9b5b4d8abcb2931bbe95c87ba07bc8cb522174a8b360af6ff WatchSource:0}: Error finding container 98357788addabbf9b5b4d8abcb2931bbe95c87ba07bc8cb522174a8b360af6ff: Status 404 returned error can't find the container with id 98357788addabbf9b5b4d8abcb2931bbe95c87ba07bc8cb522174a8b360af6ff
Sep 10 23:44:10.398052 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:10.398008    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:44:10.399425 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:10.399389    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf" event={"ID":"9de3ef46-ed9e-4596-8e2a-e96df9e06146","Type":"ContainerStarted","Data":"8f87ca1ca2c8ed1c88e6cde5a3c6d06bc84aee27fca2d692429e8dd698de252b"}
Sep 10 23:44:10.399551 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:10.399438    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf" event={"ID":"9de3ef46-ed9e-4596-8e2a-e96df9e06146","Type":"ContainerStarted","Data":"98357788addabbf9b5b4d8abcb2931bbe95c87ba07bc8cb522174a8b360af6ff"}
Sep 10 23:44:10.416213 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:10.416171    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf" podStartSLOduration=1.226668276 podStartE2EDuration="1.416156972s" totalImagesPullingTime="189.488696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:10.415451652 +0000 UTC m=+647.597609778" watchObservedRunningTime="2026-09-10 23:44:10.416156972 +0000 UTC m=+647.598315099"
Sep 10 23:44:16.797352 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.797317    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"]
Sep 10 23:44:16.800850 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.800824    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.803334 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.803309    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 23:44:16.805179 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.805148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/940de213-71a2-4165-85f4-bcde30429eaf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.805289 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.805194    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/940de213-71a2-4165-85f4-bcde30429eaf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.805289 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.805220    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/940de213-71a2-4165-85f4-bcde30429eaf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.805289 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.805280    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/940de213-71a2-4165-85f4-bcde30429eaf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.805468 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.805326    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/940de213-71a2-4165-85f4-bcde30429eaf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.805468 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.805356    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z455\" (UniqueName: \"kubernetes.io/projected/940de213-71a2-4165-85f4-bcde30429eaf-kube-api-access-2z455\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.810804 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.810780    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"]
Sep 10 23:44:16.820278 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.820251    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:16.905747 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.905677    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z455\" (UniqueName: \"kubernetes.io/projected/940de213-71a2-4165-85f4-bcde30429eaf-kube-api-access-2z455\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.905926 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.905770    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/940de213-71a2-4165-85f4-bcde30429eaf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.905926 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.905808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/940de213-71a2-4165-85f4-bcde30429eaf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.905926 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.905848    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/940de213-71a2-4165-85f4-bcde30429eaf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.905926 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.905920    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/940de213-71a2-4165-85f4-bcde30429eaf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.906141 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.905968    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/940de213-71a2-4165-85f4-bcde30429eaf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.906266 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.906239    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/940de213-71a2-4165-85f4-bcde30429eaf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.906266 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.906254    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/940de213-71a2-4165-85f4-bcde30429eaf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.906412 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.906360    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/940de213-71a2-4165-85f4-bcde30429eaf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.908144 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.908111    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/940de213-71a2-4165-85f4-bcde30429eaf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.908236 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.908190    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/940de213-71a2-4165-85f4-bcde30429eaf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:16.913706 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:16.913673    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z455\" (UniqueName: \"kubernetes.io/projected/940de213-71a2-4165-85f4-bcde30429eaf-kube-api-access-2z455\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8\" (UID: \"940de213-71a2-4165-85f4-bcde30429eaf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:17.111961 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:17.111928    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:17.384051 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:17.384028    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"]
Sep 10 23:44:17.385929 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:44:17.385904    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940de213_71a2_4165_85f4_bcde30429eaf.slice/crio-952011fa42d4c5746690779116ad6260a1205ea802d92d2c5112103dfec949e5 WatchSource:0}: Error finding container 952011fa42d4c5746690779116ad6260a1205ea802d92d2c5112103dfec949e5: Status 404 returned error can't find the container with id 952011fa42d4c5746690779116ad6260a1205ea802d92d2c5112103dfec949e5
Sep 10 23:44:17.436643 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:17.436600    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8" event={"ID":"940de213-71a2-4165-85f4-bcde30429eaf","Type":"ContainerStarted","Data":"952011fa42d4c5746690779116ad6260a1205ea802d92d2c5112103dfec949e5"}
Sep 10 23:44:18.444053 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:18.444015    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8" event={"ID":"940de213-71a2-4165-85f4-bcde30429eaf","Type":"ContainerStarted","Data":"191cb529c8b6732948b060ba3f63d04e68c454bc92ee684c11e27cf4455fcdbd"}
Sep 10 23:44:18.461739 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:18.461675    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8" podStartSLOduration=2.281436115 podStartE2EDuration="2.461660914s" totalImagesPullingTime="180.224799ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:18.460443471 +0000 UTC m=+655.642601600" watchObservedRunningTime="2026-09-10 23:44:18.461660914 +0000 UTC m=+655.643819041"
Sep 10 23:44:18.498982 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:18.498949    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:44:19.506670 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:19.506641    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:19.507040 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:19.506689    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:19.518653 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:19.518631    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:20.465675 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:20.465648    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtnsf"
Sep 10 23:44:23.700962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.700926    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"]
Sep 10 23:44:23.704352 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.704327    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.706641 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.706617    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 10 23:44:23.714167 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.714145    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"]
Sep 10 23:44:23.723074 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.723049    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:23.761998 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.761973    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4twrt\" (UniqueName: \"kubernetes.io/projected/f731466e-1433-4cc1-be40-1ecfad97efab-kube-api-access-4twrt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.762108 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.762012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f731466e-1433-4cc1-be40-1ecfad97efab-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.762108 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.762050    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f731466e-1433-4cc1-be40-1ecfad97efab-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.762108 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.762082    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f731466e-1433-4cc1-be40-1ecfad97efab-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.762108 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.762104    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f731466e-1433-4cc1-be40-1ecfad97efab-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.762251 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.762186    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f731466e-1433-4cc1-be40-1ecfad97efab-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.863013 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.862974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f731466e-1433-4cc1-be40-1ecfad97efab-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.863171 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.863033    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f731466e-1433-4cc1-be40-1ecfad97efab-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.863171 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.863071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f731466e-1433-4cc1-be40-1ecfad97efab-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.863171 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.863094    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f731466e-1433-4cc1-be40-1ecfad97efab-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.863317 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.863243    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f731466e-1433-4cc1-be40-1ecfad97efab-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.863368 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.863336    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4twrt\" (UniqueName: \"kubernetes.io/projected/f731466e-1433-4cc1-be40-1ecfad97efab-kube-api-access-4twrt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.863514 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.863490    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f731466e-1433-4cc1-be40-1ecfad97efab-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.863626 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.863563    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f731466e-1433-4cc1-be40-1ecfad97efab-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.863739 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.863697    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f731466e-1433-4cc1-be40-1ecfad97efab-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.865422 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.865395    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f731466e-1433-4cc1-be40-1ecfad97efab-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.865675 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.865655    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f731466e-1433-4cc1-be40-1ecfad97efab-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:23.870723 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:23.870699    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4twrt\" (UniqueName: \"kubernetes.io/projected/f731466e-1433-4cc1-be40-1ecfad97efab-kube-api-access-4twrt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2jf4m\" (UID: \"f731466e-1433-4cc1-be40-1ecfad97efab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:24.016548 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:24.016489    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:24.285115 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:24.285086    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"]
Sep 10 23:44:24.286843 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:44:24.286819    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf731466e_1433_4cc1_be40_1ecfad97efab.slice/crio-f7fc6bfb49c514faa7c7a73928ce66fa27d00fb597cd17d0d987ccc4219984b0 WatchSource:0}: Error finding container f7fc6bfb49c514faa7c7a73928ce66fa27d00fb597cd17d0d987ccc4219984b0: Status 404 returned error can't find the container with id f7fc6bfb49c514faa7c7a73928ce66fa27d00fb597cd17d0d987ccc4219984b0
Sep 10 23:44:24.476654 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:24.476628    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m" event={"ID":"f731466e-1433-4cc1-be40-1ecfad97efab","Type":"ContainerStarted","Data":"f7fc6bfb49c514faa7c7a73928ce66fa27d00fb597cd17d0d987ccc4219984b0"}
Sep 10 23:44:25.400268 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:25.400235    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:44:25.483261 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:25.483230    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m" event={"ID":"f731466e-1433-4cc1-be40-1ecfad97efab","Type":"ContainerStarted","Data":"223d51c64845f802608c532809a1c1d598f54568b200f54e5ad89c94b165f2b2"}
Sep 10 23:44:25.499315 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:25.499272    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m" podStartSLOduration=2.324120687 podStartE2EDuration="2.499257791s" totalImagesPullingTime="175.137104ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:25.498367041 +0000 UTC m=+662.680525168" watchObservedRunningTime="2026-09-10 23:44:25.499257791 +0000 UTC m=+662.681415917"
Sep 10 23:44:27.112401 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:27.112359    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:27.112843 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:27.112457    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:27.124195 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:27.124170    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:27.505539 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:27.505442    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8"
Sep 10 23:44:34.017098 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:34.017057    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:34.017764 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:34.017123    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:34.029143 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:34.029120    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:34.540441 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:34.540395    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2jf4m"
Sep 10 23:44:45.780497 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.780459    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"]
Sep 10 23:44:45.784988 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.784966    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.787345 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.787328    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 10 23:44:45.791948 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.791925    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"]
Sep 10 23:44:45.808994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.808964    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:45.836763 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.836740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a4051b4-d43e-4f56-bacd-e3fd476d2451-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.836869 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.836771    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk2kf\" (UniqueName: \"kubernetes.io/projected/5a4051b4-d43e-4f56-bacd-e3fd476d2451-kube-api-access-sk2kf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.836869 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.836807    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a4051b4-d43e-4f56-bacd-e3fd476d2451-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.836942 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.836870    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a4051b4-d43e-4f56-bacd-e3fd476d2451-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.836942 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.836887    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a4051b4-d43e-4f56-bacd-e3fd476d2451-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.836942 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.836909    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a4051b4-d43e-4f56-bacd-e3fd476d2451-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.938151 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.938125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a4051b4-d43e-4f56-bacd-e3fd476d2451-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.938263 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.938159    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk2kf\" (UniqueName: \"kubernetes.io/projected/5a4051b4-d43e-4f56-bacd-e3fd476d2451-kube-api-access-sk2kf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.938263 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.938188    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a4051b4-d43e-4f56-bacd-e3fd476d2451-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.938263 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.938220    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a4051b4-d43e-4f56-bacd-e3fd476d2451-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.938263 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.938236    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a4051b4-d43e-4f56-bacd-e3fd476d2451-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.938263 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.938257    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a4051b4-d43e-4f56-bacd-e3fd476d2451-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.938632 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.938612    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a4051b4-d43e-4f56-bacd-e3fd476d2451-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.938707 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.938659    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a4051b4-d43e-4f56-bacd-e3fd476d2451-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.938707 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.938691    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a4051b4-d43e-4f56-bacd-e3fd476d2451-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.940276 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.940255    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a4051b4-d43e-4f56-bacd-e3fd476d2451-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.940574 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.940555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a4051b4-d43e-4f56-bacd-e3fd476d2451-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:45.945253 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:45.945236    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk2kf\" (UniqueName: \"kubernetes.io/projected/5a4051b4-d43e-4f56-bacd-e3fd476d2451-kube-api-access-sk2kf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n4frd\" (UID: \"5a4051b4-d43e-4f56-bacd-e3fd476d2451\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:46.096598 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:46.096531    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:46.368032 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:46.367997    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"]
Sep 10 23:44:46.370876 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:44:46.370845    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a4051b4_d43e_4f56_bacd_e3fd476d2451.slice/crio-252c8884fddf26f4d43da297d7db3172971c6007c5244347c5c00b4331d15e9b WatchSource:0}: Error finding container 252c8884fddf26f4d43da297d7db3172971c6007c5244347c5c00b4331d15e9b: Status 404 returned error can't find the container with id 252c8884fddf26f4d43da297d7db3172971c6007c5244347c5c00b4331d15e9b
Sep 10 23:44:46.607030 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:46.607001    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd" event={"ID":"5a4051b4-d43e-4f56-bacd-e3fd476d2451","Type":"ContainerStarted","Data":"252c8884fddf26f4d43da297d7db3172971c6007c5244347c5c00b4331d15e9b"}
Sep 10 23:44:47.613456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:47.613417    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd" event={"ID":"5a4051b4-d43e-4f56-bacd-e3fd476d2451","Type":"ContainerStarted","Data":"52e115983d3a12071f2f1075375f9248d09393858d2a2cf7130388badf9f9a0f"}
Sep 10 23:44:47.629789 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:47.629745    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd" podStartSLOduration=2.435645844 podStartE2EDuration="2.62972817s" totalImagesPullingTime="194.082326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:47.628308139 +0000 UTC m=+684.810466278" watchObservedRunningTime="2026-09-10 23:44:47.62972817 +0000 UTC m=+684.811886296"
Sep 10 23:44:47.893089 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:47.893000    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:44:56.097613 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:56.097569    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:56.097613 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:56.097626    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:56.109915 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:56.109892    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:44:56.676892 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:44:56.676864    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n4frd"
Sep 10 23:45:29.666671 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:29.666588    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:40.207902 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:40.207866    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:40.306662 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:40.306627    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:41.385327 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:41.385279    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:41.477471 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:41.477437    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:56.599183 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:56.599145    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:56.715944 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:56.715909    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:57.011584 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:57.011543    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:57.208819 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:57.208779    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:57.938858 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:57.938818    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:58.043863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:58.043829    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:58.410098 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:58.410061    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:59.622681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:59.622637    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:59.718617 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:45:59.718584    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:00.246344 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:00.246312    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:46:00.770242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:00.770208    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:00.866222 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:00.866187    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:01.335745 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:01.335698    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:01.439321 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:01.439285    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:01.521179 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:01.521144    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:02.428933 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:02.428899    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7821-aa2eb6"]
Sep 10 23:46:02.432398 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:02.432380    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-aa2eb6"
Sep 10 23:46:02.434597 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:02.434578    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9kl27\""
Sep 10 23:46:02.441170 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:02.441148    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7821-aa2eb6"]
Sep 10 23:46:02.572560 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:02.572523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2mzd\" (UniqueName: \"kubernetes.io/projected/461138e7-0a92-4afc-98e6-2b7ba589c72c-kube-api-access-v2mzd\") pod \"test-curl-7821-aa2eb6\" (UID: \"461138e7-0a92-4afc-98e6-2b7ba589c72c\") " pod="opendatahub/test-curl-7821-aa2eb6"
Sep 10 23:46:02.673053 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:02.673006    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2mzd\" (UniqueName: \"kubernetes.io/projected/461138e7-0a92-4afc-98e6-2b7ba589c72c-kube-api-access-v2mzd\") pod \"test-curl-7821-aa2eb6\" (UID: \"461138e7-0a92-4afc-98e6-2b7ba589c72c\") " pod="opendatahub/test-curl-7821-aa2eb6"
Sep 10 23:46:02.683507 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:02.683436    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2mzd\" (UniqueName: \"kubernetes.io/projected/461138e7-0a92-4afc-98e6-2b7ba589c72c-kube-api-access-v2mzd\") pod \"test-curl-7821-aa2eb6\" (UID: \"461138e7-0a92-4afc-98e6-2b7ba589c72c\") " pod="opendatahub/test-curl-7821-aa2eb6"
Sep 10 23:46:02.742184 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:02.742156    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-aa2eb6"
Sep 10 23:46:03.009837 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:03.009811    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7821-aa2eb6"]
Sep 10 23:46:03.012186 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:46:03.012131    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod461138e7_0a92_4afc_98e6_2b7ba589c72c.slice/crio-29771cd7c4a69ec223405bebaca6ce577149c084991f036764afbf1ddb15503b WatchSource:0}: Error finding container 29771cd7c4a69ec223405bebaca6ce577149c084991f036764afbf1ddb15503b: Status 404 returned error can't find the container with id 29771cd7c4a69ec223405bebaca6ce577149c084991f036764afbf1ddb15503b
Sep 10 23:46:04.011119 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:04.011082    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7821-aa2eb6" event={"ID":"461138e7-0a92-4afc-98e6-2b7ba589c72c","Type":"ContainerStarted","Data":"8533c03b9b8d815537493c8f3b7f89b9d7c266d237f253a95da3f289d3bce791"}
Sep 10 23:46:04.011512 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:04.011128    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7821-aa2eb6" event={"ID":"461138e7-0a92-4afc-98e6-2b7ba589c72c","Type":"ContainerStarted","Data":"29771cd7c4a69ec223405bebaca6ce577149c084991f036764afbf1ddb15503b"}
Sep 10 23:46:04.026141 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:04.026096    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7821-aa2eb6" podStartSLOduration=1.505074378 podStartE2EDuration="2.026080222s" totalImagesPullingTime="521.005844ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:04.025599794 +0000 UTC m=+761.207757923" watchObservedRunningTime="2026-09-10 23:46:04.026080222 +0000 UTC m=+761.208238351"
Sep 10 23:46:04.284281 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:04.284191    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:04.384224 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:04.384168    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:04.518867 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:04.518822    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:04.597568 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:04.597480    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7821-aa2eb6"]
Sep 10 23:46:04.601493 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:04.601460    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7821-aa2eb6"]
Sep 10 23:46:04.806147 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:04.806102    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:05.016936 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:46:05.016898    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7821-aa2eb6" container="test-curl-7821-aa2eb6"
Sep 10 23:46:05.115889 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:05.115853    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:05.330093 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:05.329993    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:05.441577 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:05.441531    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:06.022166 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:06.022123    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7821-aa2eb6" podUID="461138e7-0a92-4afc-98e6-2b7ba589c72c" containerName="test-curl-7821-aa2eb6" containerID="cri-o://8533c03b9b8d815537493c8f3b7f89b9d7c266d237f253a95da3f289d3bce791" gracePeriod=2
Sep 10 23:46:06.391427 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:06.391394    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:07.197896 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:07.197853    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:07.292301 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:07.292252    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:08.203582 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:08.203549    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-aa2eb6"
Sep 10 23:46:08.220212 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:08.220186    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2mzd\" (UniqueName: \"kubernetes.io/projected/461138e7-0a92-4afc-98e6-2b7ba589c72c-kube-api-access-v2mzd\") pod \"461138e7-0a92-4afc-98e6-2b7ba589c72c\" (UID: \"461138e7-0a92-4afc-98e6-2b7ba589c72c\") "
Sep 10 23:46:08.222222 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:08.222197    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/461138e7-0a92-4afc-98e6-2b7ba589c72c-kube-api-access-v2mzd" (OuterVolumeSpecName: "kube-api-access-v2mzd") pod "461138e7-0a92-4afc-98e6-2b7ba589c72c" (UID: "461138e7-0a92-4afc-98e6-2b7ba589c72c"). InnerVolumeSpecName "kube-api-access-v2mzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:46:08.320982 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:08.320900    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2mzd\" (UniqueName: \"kubernetes.io/projected/461138e7-0a92-4afc-98e6-2b7ba589c72c-kube-api-access-v2mzd\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:46:08.538515 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:08.538478    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:08.628072 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:08.628032    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:08.734945 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:08.734905    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:08.835173 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:08.835135    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:08.937504 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:08.937406    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:09.040384 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:09.040334    2574 generic.go:356] "Generic (PLEG): container finished" podID="461138e7-0a92-4afc-98e6-2b7ba589c72c" containerID="8533c03b9b8d815537493c8f3b7f89b9d7c266d237f253a95da3f289d3bce791" exitCode=137
Sep 10 23:46:09.040563 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:09.040412    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-aa2eb6"
Sep 10 23:46:09.040563 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:09.040444    2574 scope.go:117] "RemoveContainer" containerID="8533c03b9b8d815537493c8f3b7f89b9d7c266d237f253a95da3f289d3bce791"
Sep 10 23:46:09.051269 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:09.051250    2574 scope.go:117] "RemoveContainer" containerID="8533c03b9b8d815537493c8f3b7f89b9d7c266d237f253a95da3f289d3bce791"
Sep 10 23:46:09.051536 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:46:09.051520    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8533c03b9b8d815537493c8f3b7f89b9d7c266d237f253a95da3f289d3bce791\": container with ID starting with 8533c03b9b8d815537493c8f3b7f89b9d7c266d237f253a95da3f289d3bce791 not found: ID does not exist" containerID="8533c03b9b8d815537493c8f3b7f89b9d7c266d237f253a95da3f289d3bce791"
Sep 10 23:46:09.051589 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:09.051543    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8533c03b9b8d815537493c8f3b7f89b9d7c266d237f253a95da3f289d3bce791"} err="failed to get container status \"8533c03b9b8d815537493c8f3b7f89b9d7c266d237f253a95da3f289d3bce791\": rpc error: code = NotFound desc = could not find container \"8533c03b9b8d815537493c8f3b7f89b9d7c266d237f253a95da3f289d3bce791\": container with ID starting with 8533c03b9b8d815537493c8f3b7f89b9d7c266d237f253a95da3f289d3bce791 not found: ID does not exist"
Sep 10 23:46:09.051941 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:46:09.051915    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7821-aa2eb6\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="461138e7-0a92-4afc-98e6-2b7ba589c72c" pod="opendatahub/test-curl-7821-aa2eb6"
Sep 10 23:46:09.102035 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:09.101995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:09.201179 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:09.201088    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:09.256982 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:09.256954    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="461138e7-0a92-4afc-98e6-2b7ba589c72c" path="/var/lib/kubelet/pods/461138e7-0a92-4afc-98e6-2b7ba589c72c/volumes"
Sep 10 23:46:10.159965 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:10.159934    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:10.260855 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:10.260823    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:10.617264 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:10.617229    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:10.715313 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:10.715273    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:10.988179 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:10.988079    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:11.119099 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:11.119056    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:11.801772 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:11.801739    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:13.104636 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.104607    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"]
Sep 10 23:46:13.105158 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.105138    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="461138e7-0a92-4afc-98e6-2b7ba589c72c" containerName="test-curl-7821-aa2eb6"
Sep 10 23:46:13.105240 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.105161    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="461138e7-0a92-4afc-98e6-2b7ba589c72c" containerName="test-curl-7821-aa2eb6"
Sep 10 23:46:13.105295 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.105283    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="461138e7-0a92-4afc-98e6-2b7ba589c72c" containerName="test-curl-7821-aa2eb6"
Sep 10 23:46:13.109335 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.109316    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.111623 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.111606    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-c8619b9a-kserve-self-signed-certs\""
Sep 10 23:46:13.117079 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.117007    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"]
Sep 10 23:46:13.164022 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.163982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r89n4\" (UniqueName: \"kubernetes.io/projected/813829ec-41a8-4ce9-846e-57a3d9e368ee-kube-api-access-r89n4\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.164180 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.164038    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-tmp-dir\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.164180 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.164059    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-dshm\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.164180 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.164094    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/813829ec-41a8-4ce9-846e-57a3d9e368ee-tls-certs\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.164284 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.164184    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-model-cache\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.164284 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.164218    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-home\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.264977 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.264889    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-tmp-dir\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.264977 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.264950    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-dshm\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.265218 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.265020    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/813829ec-41a8-4ce9-846e-57a3d9e368ee-tls-certs\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.265218 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.265127    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-model-cache\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.265218 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.265156    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-home\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.265406 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.265280    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r89n4\" (UniqueName: \"kubernetes.io/projected/813829ec-41a8-4ce9-846e-57a3d9e368ee-kube-api-access-r89n4\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.265472 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.265405    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-tmp-dir\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.266143 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.266117    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-model-cache\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.266264 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.266229    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-home\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.267943 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.267919    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/813829ec-41a8-4ce9-846e-57a3d9e368ee-tls-certs\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.268198 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.268176    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-dshm\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.272765 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.272737    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r89n4\" (UniqueName: \"kubernetes.io/projected/813829ec-41a8-4ce9-846e-57a3d9e368ee-kube-api-access-r89n4\") pod \"e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") " pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.281822 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.281758    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:13.420184 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.420154    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:13.692061 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:13.692036    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"]
Sep 10 23:46:13.693864 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:46:13.693838    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod813829ec_41a8_4ce9_846e_57a3d9e368ee.slice/crio-adb64d32f823ee35ea46403202d9a930de53ee7123fea878f178cd7a2058cdd6 WatchSource:0}: Error finding container adb64d32f823ee35ea46403202d9a930de53ee7123fea878f178cd7a2058cdd6: Status 404 returned error can't find the container with id adb64d32f823ee35ea46403202d9a930de53ee7123fea878f178cd7a2058cdd6
Sep 10 23:46:14.068218 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:14.068135    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh" event={"ID":"813829ec-41a8-4ce9-846e-57a3d9e368ee","Type":"ContainerStarted","Data":"d9b2a4503950f7d532fed8835c63f2477e61e5da5cc8e500ff1f429f24a86d70"}
Sep 10 23:46:14.068218 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:14.068179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh" event={"ID":"813829ec-41a8-4ce9-846e-57a3d9e368ee","Type":"ContainerStarted","Data":"adb64d32f823ee35ea46403202d9a930de53ee7123fea878f178cd7a2058cdd6"}
Sep 10 23:46:14.086490 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:14.086441    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh" podStartSLOduration=1.086419646 podStartE2EDuration="1.086419646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:14.083548749 +0000 UTC m=+771.265706877" watchObservedRunningTime="2026-09-10 23:46:14.086419646 +0000 UTC m=+771.268577770"
Sep 10 23:46:15.300501 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:15.300471    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:46:15.432482 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:15.432451    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:15.600525 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:15.600417    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:15.691148 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:15.691121    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:15.791998 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:15.791964    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:18.512289 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:18.512252    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:20.084591 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:20.084535    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:20.186884 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:20.186848    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:20.284480 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:20.284436    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:20.384312 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:20.384273    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:21.821216 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:21.821178    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:23.420978 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:23.420942    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:23.421319 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:23.420998    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:23.433109 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:23.433088    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:24.133793 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:24.133760    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:46:24.580931 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:24.580828    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:24.886755 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:24.886700    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:25.239126 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:25.239041    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:25.808874 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:25.808836    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:26.297662 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:26.297616    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:26.406261 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:26.406216    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:26.497443 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:26.497407    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:26.663536 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:26.663499    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:27.933192 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:27.933154    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:28.021425 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:28.021383    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:29.052510 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:29.052467    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:29.153027 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:29.152991    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:29.369394 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:29.369365    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:29.631538 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:29.631441    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:29.731535 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:29.731498    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:30.040793 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:30.040679    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:30.605533 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:30.605498    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:46:30.739462 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:30.739428    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:31.622459 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:31.622413    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:32.219708 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:32.219673    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:32.603731 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:32.603633    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr"]
Sep 10 23:46:32.608132 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:32.608112    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr"
Sep 10 23:46:32.611687 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:32.611663    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:46:32.612017 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:32.611682    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-55278\""
Sep 10 23:46:32.614359 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:32.614335    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr"]
Sep 10 23:46:32.745704 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:32.745663    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d451e3a-dcf3-4652-ba04-65d14252baa1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr\" (UID: \"1d451e3a-dcf3-4652-ba04-65d14252baa1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr"
Sep 10 23:46:32.846570 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:32.846531    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d451e3a-dcf3-4652-ba04-65d14252baa1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr\" (UID: \"1d451e3a-dcf3-4652-ba04-65d14252baa1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr"
Sep 10 23:46:32.847189 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:32.847170    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d451e3a-dcf3-4652-ba04-65d14252baa1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr\" (UID: \"1d451e3a-dcf3-4652-ba04-65d14252baa1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr"
Sep 10 23:46:32.920610 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:32.920581    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr"
Sep 10 23:46:33.027891 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:33.027859    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:33.124065 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:33.124028    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:33.192635 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:33.192612    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr"]
Sep 10 23:46:33.194442 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:46:33.194416    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d451e3a_dcf3_4652_ba04_65d14252baa1.slice/crio-70ed358fb6d17ebf19b11b28c3451a7200e1f63a962b692ebcc39be0a83fa1fe WatchSource:0}: Error finding container 70ed358fb6d17ebf19b11b28c3451a7200e1f63a962b692ebcc39be0a83fa1fe: Status 404 returned error can't find the container with id 70ed358fb6d17ebf19b11b28c3451a7200e1f63a962b692ebcc39be0a83fa1fe
Sep 10 23:46:33.675094 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:33.675047    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:33.769559 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:33.769528    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:34.179631 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:34.179590    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr" event={"ID":"1d451e3a-dcf3-4652-ba04-65d14252baa1","Type":"ContainerStarted","Data":"70ed358fb6d17ebf19b11b28c3451a7200e1f63a962b692ebcc39be0a83fa1fe"}
Sep 10 23:46:36.192520 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:36.192488    2574 generic.go:356] "Generic (PLEG): container finished" podID="1d451e3a-dcf3-4652-ba04-65d14252baa1" containerID="ea931b6fa1e0ba61c454277c4ccd8a2aabfd2225c36f73e38e40b6f3a82d5204" exitCode=0
Sep 10 23:46:36.192854 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:36.192569    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr" event={"ID":"1d451e3a-dcf3-4652-ba04-65d14252baa1","Type":"ContainerDied","Data":"ea931b6fa1e0ba61c454277c4ccd8a2aabfd2225c36f73e38e40b6f3a82d5204"}
Sep 10 23:46:37.330348 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:37.330323    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr"
Sep 10 23:46:37.488880 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:37.488808    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d451e3a-dcf3-4652-ba04-65d14252baa1-maas-api-service-ca\") pod \"1d451e3a-dcf3-4652-ba04-65d14252baa1\" (UID: \"1d451e3a-dcf3-4652-ba04-65d14252baa1\") "
Sep 10 23:46:37.489161 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:37.489135    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d451e3a-dcf3-4652-ba04-65d14252baa1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1d451e3a-dcf3-4652-ba04-65d14252baa1" (UID: "1d451e3a-dcf3-4652-ba04-65d14252baa1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:46:37.590324 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:37.590293    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d451e3a-dcf3-4652-ba04-65d14252baa1-maas-api-service-ca\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:46:38.203590 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:38.203562    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr"
Sep 10 23:46:38.203784 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:38.203582    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr" event={"ID":"1d451e3a-dcf3-4652-ba04-65d14252baa1","Type":"ContainerDied","Data":"70ed358fb6d17ebf19b11b28c3451a7200e1f63a962b692ebcc39be0a83fa1fe"}
Sep 10 23:46:38.203784 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:38.203638    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70ed358fb6d17ebf19b11b28c3451a7200e1f63a962b692ebcc39be0a83fa1fe"
Sep 10 23:46:38.749498 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:38.749461    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:39.314177 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:39.314144    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:39.382080 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:39.382039    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:39.442491 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:39.442461    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:39.494377 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:39.494349    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr"]
Sep 10 23:46:39.497004 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:39.496983    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dfc47f0-5vsmr"]
Sep 10 23:46:39.500313 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:39.500288    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:39.555025 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:39.554996    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:39.649848 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:39.649815    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:40.201358 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.201326    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:40.284224 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.284195    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:40.351796 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.351761    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:40.628748 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.628703    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"]
Sep 10 23:46:40.629074 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.629062    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d451e3a-dcf3-4652-ba04-65d14252baa1" containerName="revoke-keys"
Sep 10 23:46:40.629123 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.629076    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d451e3a-dcf3-4652-ba04-65d14252baa1" containerName="revoke-keys"
Sep 10 23:46:40.629167 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.629148    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d451e3a-dcf3-4652-ba04-65d14252baa1" containerName="revoke-keys"
Sep 10 23:46:40.632261 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.632244    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.635172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.635146    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 23:46:40.635299 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.635175    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-cd653317-gw-openshift-default-dockercfg-t9hr4\""
Sep 10 23:46:40.645078 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.645052    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"]
Sep 10 23:46:40.657594 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.657568    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:40.717290 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.717265    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-data\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.717442 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.717301    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-workload-certs\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.717442 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.717322    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-podinfo\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.717442 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.717341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ththk\" (UniqueName: \"kubernetes.io/projected/bdc80e00-efb2-487b-84b4-045d2f9b750d-kube-api-access-ththk\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.717442 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.717421    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-token\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.717617 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.717453    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-envoy\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.717617 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.717484    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-workload-socket\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.717617 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.717502    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-credential-socket\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.717617 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.717522    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc80e00-efb2-487b-84b4-045d2f9b750d-istiod-ca-cert\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.818325 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.818295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-workload-socket\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.818461 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.818334    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-credential-socket\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.818461 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.818356    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc80e00-efb2-487b-84b4-045d2f9b750d-istiod-ca-cert\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.818461 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.818445    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-data\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.818624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.818483    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-workload-certs\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.818624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.818513    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-podinfo\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.818624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.818541    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ththk\" (UniqueName: \"kubernetes.io/projected/bdc80e00-efb2-487b-84b4-045d2f9b750d-kube-api-access-ththk\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.818807 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.818696    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-workload-socket\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.818807 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.818771    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-credential-socket\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.818912 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.818845    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-data\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.818912 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.818883    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-workload-certs\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.818912 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.818899    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-token\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.819073 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.818939    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-envoy\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.819135 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.819112    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc80e00-efb2-487b-84b4-045d2f9b750d-istiod-ca-cert\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.820964 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.820941    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-podinfo\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.821060 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.820970    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-envoy\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.826187 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.826162    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-token\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.826382 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.826363    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ththk\" (UniqueName: \"kubernetes.io/projected/bdc80e00-efb2-487b-84b4-045d2f9b750d-kube-api-access-ththk\") pod \"e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") " pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:40.943415 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:40.943321    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:41.237102 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:41.237076    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"]
Sep 10 23:46:41.238993 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:46:41.238964    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc80e00_efb2_487b_84b4_045d2f9b750d.slice/crio-008f4bbdf2dc23fc51d8d9fd66f877abe5800bf9bad4247f96aadd78ea237fdb WatchSource:0}: Error finding container 008f4bbdf2dc23fc51d8d9fd66f877abe5800bf9bad4247f96aadd78ea237fdb: Status 404 returned error can't find the container with id 008f4bbdf2dc23fc51d8d9fd66f877abe5800bf9bad4247f96aadd78ea237fdb
Sep 10 23:46:41.256522 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:41.256492    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d451e3a-dcf3-4652-ba04-65d14252baa1" path="/var/lib/kubelet/pods/1d451e3a-dcf3-4652-ba04-65d14252baa1/volumes"
Sep 10 23:46:41.266788 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:41.266765    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:42.226557 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:42.226521    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" event={"ID":"bdc80e00-efb2-487b-84b4-045d2f9b750d","Type":"ContainerStarted","Data":"008f4bbdf2dc23fc51d8d9fd66f877abe5800bf9bad4247f96aadd78ea237fdb"}
Sep 10 23:46:42.499884 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:42.499803    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:46:44.330977 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:44.330937    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:46:44.331277 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:44.331009    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:46:44.331277 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:44.331040    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:46:45.247644 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:45.247606    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" event={"ID":"bdc80e00-efb2-487b-84b4-045d2f9b750d","Type":"ContainerStarted","Data":"44db7de5e8ffc3a8413cc2c33fa9e7e43d607dab0f0ee54c7a6bbe4782bef0a4"}
Sep 10 23:46:45.280377 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:45.280316    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" podStartSLOduration=2.190881047 podStartE2EDuration="5.280299577s" totalImagesPullingTime="3.08941853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:45.279049841 +0000 UTC m=+802.461207968" watchObservedRunningTime="2026-09-10 23:46:45.280299577 +0000 UTC m=+802.462457701"
Sep 10 23:46:45.944053 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:45.943968    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:45.948992 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:45.948966    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:46.253268 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:46.253186    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:46.254114 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:46.254084    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:46:46.736963 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:46.736914    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:46.835980 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:46.835942    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:46.934460 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:46.934430    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:47.274736 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:47.274688    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:47.375275 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:47.375239    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:47.484983 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:47.484948    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:50.128244 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:50.128212    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:52.822294 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:46:52.822251    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:00.792978 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:00.792943    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:47:02.294889 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:02.294832    2574 patch_prober.go:28] interesting pod/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 23:47:02.295388 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:02.294909    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:47:04.346113 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:04.346078    2574 generic.go:356] "Generic (PLEG): container finished" podID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerID="44db7de5e8ffc3a8413cc2c33fa9e7e43d607dab0f0ee54c7a6bbe4782bef0a4" exitCode=0
Sep 10 23:47:04.346667 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:04.346156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" event={"ID":"bdc80e00-efb2-487b-84b4-045d2f9b750d","Type":"ContainerDied","Data":"44db7de5e8ffc3a8413cc2c33fa9e7e43d607dab0f0ee54c7a6bbe4782bef0a4"}
Sep 10 23:47:04.346667 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:04.346647    2574 scope.go:117] "RemoveContainer" containerID="44db7de5e8ffc3a8413cc2c33fa9e7e43d607dab0f0ee54c7a6bbe4782bef0a4"
Sep 10 23:47:04.347769 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:04.347740    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:47:04.347833 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:04.347806    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:47:04.347874 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:04.347837    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:47:05.353251 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:05.353212    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" event={"ID":"bdc80e00-efb2-487b-84b4-045d2f9b750d","Type":"ContainerStarted","Data":"86c8fceba2638ec00af998fb9b4c760889e400dbd28a5ab3aaf344d6ac83633e"}
Sep 10 23:47:05.944514 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:05.944474    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:47:05.944698 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:05.944661    2574 patch_prober.go:28] interesting pod/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 23:47:05.944770 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:05.944720    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 23:47:06.944551 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:06.944509    2574 patch_prober.go:28] interesting pod/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 23:47:06.945185 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:06.945151    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 23:47:07.858506 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:07.858467    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:07.944775 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:07.944736    2574 patch_prober.go:28] interesting pod/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 23:47:07.945376 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:07.945346    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 23:47:08.944877 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:08.944841    2574 patch_prober.go:28] interesting pod/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 23:47:08.945573 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:08.945540    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 23:47:09.944340 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:09.944300    2574 patch_prober.go:28] interesting pod/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 23:47:09.944563 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:09.944378    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 23:47:10.943835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:10.943789    2574 patch_prober.go:28] interesting pod/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 23:47:10.944352 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:10.943861    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 23:47:11.687444 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:11.687399    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h"]
Sep 10 23:47:11.693923 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:11.693894    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h"
Sep 10 23:47:11.696401 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:11.696357    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:47:11.696556 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:11.696528    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-55278\""
Sep 10 23:47:11.697906 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:11.697879    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h"]
Sep 10 23:47:11.803408 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:11.803365    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39af7bce-85bf-4fad-88f1-f955cd28ed79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h\" (UID: \"39af7bce-85bf-4fad-88f1-f955cd28ed79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h"
Sep 10 23:47:11.904758 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:11.904723    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39af7bce-85bf-4fad-88f1-f955cd28ed79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h\" (UID: \"39af7bce-85bf-4fad-88f1-f955cd28ed79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h"
Sep 10 23:47:11.905414 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:11.905390    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39af7bce-85bf-4fad-88f1-f955cd28ed79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h\" (UID: \"39af7bce-85bf-4fad-88f1-f955cd28ed79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h"
Sep 10 23:47:11.947206 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:11.947143    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:47:11.947569 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:11.947424    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:47:11.948037 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:11.948022    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:47:12.008176 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:12.008151    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h"
Sep 10 23:47:12.276511 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:12.276411    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h"]
Sep 10 23:47:12.278823 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:47:12.278790    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39af7bce_85bf_4fad_88f1_f955cd28ed79.slice/crio-0b7f7c42a38fb9ad61a3774145017ceb051b82083bf76aa7380a5fab6f3655ed WatchSource:0}: Error finding container 0b7f7c42a38fb9ad61a3774145017ceb051b82083bf76aa7380a5fab6f3655ed: Status 404 returned error can't find the container with id 0b7f7c42a38fb9ad61a3774145017ceb051b82083bf76aa7380a5fab6f3655ed
Sep 10 23:47:12.395960 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:12.395921    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h" event={"ID":"39af7bce-85bf-4fad-88f1-f955cd28ed79","Type":"ContainerStarted","Data":"0b7f7c42a38fb9ad61a3774145017ceb051b82083bf76aa7380a5fab6f3655ed"}
Sep 10 23:47:12.935839 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:12.935803    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:13.403435 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:13.403396    2574 generic.go:356] "Generic (PLEG): container finished" podID="39af7bce-85bf-4fad-88f1-f955cd28ed79" containerID="68edd301d69907c32b21d483e1dc977141c9fc38a2f061b045f5997a02c0fbf7" exitCode=0
Sep 10 23:47:13.403860 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:13.403467    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h" event={"ID":"39af7bce-85bf-4fad-88f1-f955cd28ed79","Type":"ContainerDied","Data":"68edd301d69907c32b21d483e1dc977141c9fc38a2f061b045f5997a02c0fbf7"}
Sep 10 23:47:14.537903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:14.537873    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h"
Sep 10 23:47:14.626964 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:14.626930    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39af7bce-85bf-4fad-88f1-f955cd28ed79-maas-api-service-ca\") pod \"39af7bce-85bf-4fad-88f1-f955cd28ed79\" (UID: \"39af7bce-85bf-4fad-88f1-f955cd28ed79\") "
Sep 10 23:47:14.627349 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:14.627327    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39af7bce-85bf-4fad-88f1-f955cd28ed79-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "39af7bce-85bf-4fad-88f1-f955cd28ed79" (UID: "39af7bce-85bf-4fad-88f1-f955cd28ed79"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:47:14.727871 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:14.727774    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39af7bce-85bf-4fad-88f1-f955cd28ed79-maas-api-service-ca\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:47:15.415952 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:15.415915    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h"
Sep 10 23:47:15.416128 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:15.415944    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h" event={"ID":"39af7bce-85bf-4fad-88f1-f955cd28ed79","Type":"ContainerDied","Data":"0b7f7c42a38fb9ad61a3774145017ceb051b82083bf76aa7380a5fab6f3655ed"}
Sep 10 23:47:15.416128 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:15.416002    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b7f7c42a38fb9ad61a3774145017ceb051b82083bf76aa7380a5fab6f3655ed"
Sep 10 23:47:18.339297 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:18.339253    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:18.439527 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:18.439488    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:18.513686 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:18.513620    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h"]
Sep 10 23:47:18.516161 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:18.516125    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:18.516706 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:18.516682    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cd653317-2pp4h"]
Sep 10 23:47:18.568069 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:18.568036    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:18.712123 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:18.712093    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"]
Sep 10 23:47:18.712315 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:18.712293    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy" containerID="cri-o://86c8fceba2638ec00af998fb9b4c760889e400dbd28a5ab3aaf344d6ac83633e" gracePeriod=30
Sep 10 23:47:18.785695 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:18.785630    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:19.136638 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:19.136594    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:19.256574 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:19.256540    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39af7bce-85bf-4fad-88f1-f955cd28ed79" path="/var/lib/kubelet/pods/39af7bce-85bf-4fad-88f1-f955cd28ed79/volumes"
Sep 10 23:47:19.445905 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:19.445812    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:19.514785 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:19.514742    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:21.643536 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:21.643472    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:21.744274 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:21.744243    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:21.810163 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:21.810129    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:47:22.832205 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:22.832162    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:22.903214 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:22.903178    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:23.004917 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:23.004882    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:23.282699 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:23.282664    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:23.381276 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:23.381232    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:23.962958 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:23.962924    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:47:24.111838 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.111806    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-workload-socket\") pod \"bdc80e00-efb2-487b-84b4-045d2f9b750d\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") "
Sep 10 23:47:24.112021 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.111844    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc80e00-efb2-487b-84b4-045d2f9b750d-istiod-ca-cert\") pod \"bdc80e00-efb2-487b-84b4-045d2f9b750d\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") "
Sep 10 23:47:24.112021 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.111866    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-credential-socket\") pod \"bdc80e00-efb2-487b-84b4-045d2f9b750d\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") "
Sep 10 23:47:24.112021 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.111906    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-data\") pod \"bdc80e00-efb2-487b-84b4-045d2f9b750d\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") "
Sep 10 23:47:24.112021 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.111945    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ththk\" (UniqueName: \"kubernetes.io/projected/bdc80e00-efb2-487b-84b4-045d2f9b750d-kube-api-access-ththk\") pod \"bdc80e00-efb2-487b-84b4-045d2f9b750d\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") "
Sep 10 23:47:24.112021 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112009    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-workload-certs\") pod \"bdc80e00-efb2-487b-84b4-045d2f9b750d\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") "
Sep 10 23:47:24.112281 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112030    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-envoy\") pod \"bdc80e00-efb2-487b-84b4-045d2f9b750d\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") "
Sep 10 23:47:24.112281 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112046    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-podinfo\") pod \"bdc80e00-efb2-487b-84b4-045d2f9b750d\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") "
Sep 10 23:47:24.112281 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112062    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-token\") pod \"bdc80e00-efb2-487b-84b4-045d2f9b750d\" (UID: \"bdc80e00-efb2-487b-84b4-045d2f9b750d\") "
Sep 10 23:47:24.112281 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112176    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bdc80e00-efb2-487b-84b4-045d2f9b750d" (UID: "bdc80e00-efb2-487b-84b4-045d2f9b750d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:47:24.112499 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112234    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bdc80e00-efb2-487b-84b4-045d2f9b750d" (UID: "bdc80e00-efb2-487b-84b4-045d2f9b750d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:47:24.112499 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112307    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-data" (OuterVolumeSpecName: "istio-data") pod "bdc80e00-efb2-487b-84b4-045d2f9b750d" (UID: "bdc80e00-efb2-487b-84b4-045d2f9b750d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:47:24.112499 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112321    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bdc80e00-efb2-487b-84b4-045d2f9b750d" (UID: "bdc80e00-efb2-487b-84b4-045d2f9b750d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:47:24.112499 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112315    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdc80e00-efb2-487b-84b4-045d2f9b750d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bdc80e00-efb2-487b-84b4-045d2f9b750d" (UID: "bdc80e00-efb2-487b-84b4-045d2f9b750d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:47:24.112499 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112440    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-workload-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:47:24.112499 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112453    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc80e00-efb2-487b-84b4-045d2f9b750d-istiod-ca-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:47:24.112499 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112461    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-credential-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:47:24.112499 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112471    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-data\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:47:24.112499 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.112481    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-workload-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:47:24.114393 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.114368    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc80e00-efb2-487b-84b4-045d2f9b750d-kube-api-access-ththk" (OuterVolumeSpecName: "kube-api-access-ththk") pod "bdc80e00-efb2-487b-84b4-045d2f9b750d" (UID: "bdc80e00-efb2-487b-84b4-045d2f9b750d"). InnerVolumeSpecName "kube-api-access-ththk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:47:24.114499 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.114421    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bdc80e00-efb2-487b-84b4-045d2f9b750d" (UID: "bdc80e00-efb2-487b-84b4-045d2f9b750d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:47:24.114683 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.114659    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bdc80e00-efb2-487b-84b4-045d2f9b750d" (UID: "bdc80e00-efb2-487b-84b4-045d2f9b750d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:47:24.114748 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.114669    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-token" (OuterVolumeSpecName: "istio-token") pod "bdc80e00-efb2-487b-84b4-045d2f9b750d" (UID: "bdc80e00-efb2-487b-84b4-045d2f9b750d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:47:24.213029 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.212989    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ththk\" (UniqueName: \"kubernetes.io/projected/bdc80e00-efb2-487b-84b4-045d2f9b750d-kube-api-access-ththk\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:47:24.213029 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.213020    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-envoy\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:47:24.213029 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.213030    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-podinfo\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:47:24.213029 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.213040    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc80e00-efb2-487b-84b4-045d2f9b750d-istio-token\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:47:24.468646 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.468553    2574 generic.go:356] "Generic (PLEG): container finished" podID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerID="86c8fceba2638ec00af998fb9b4c760889e400dbd28a5ab3aaf344d6ac83633e" exitCode=0
Sep 10 23:47:24.468646 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.468602    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"
Sep 10 23:47:24.468646 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.468638    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" event={"ID":"bdc80e00-efb2-487b-84b4-045d2f9b750d","Type":"ContainerDied","Data":"86c8fceba2638ec00af998fb9b4c760889e400dbd28a5ab3aaf344d6ac83633e"}
Sep 10 23:47:24.468947 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.468698    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49" event={"ID":"bdc80e00-efb2-487b-84b4-045d2f9b750d","Type":"ContainerDied","Data":"008f4bbdf2dc23fc51d8d9fd66f877abe5800bf9bad4247f96aadd78ea237fdb"}
Sep 10 23:47:24.468947 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.468741    2574 scope.go:117] "RemoveContainer" containerID="86c8fceba2638ec00af998fb9b4c760889e400dbd28a5ab3aaf344d6ac83633e"
Sep 10 23:47:24.478993 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.478966    2574 scope.go:117] "RemoveContainer" containerID="44db7de5e8ffc3a8413cc2c33fa9e7e43d607dab0f0ee54c7a6bbe4782bef0a4"
Sep 10 23:47:24.487741 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.487706    2574 scope.go:117] "RemoveContainer" containerID="86c8fceba2638ec00af998fb9b4c760889e400dbd28a5ab3aaf344d6ac83633e"
Sep 10 23:47:24.488053 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:47:24.488029    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86c8fceba2638ec00af998fb9b4c760889e400dbd28a5ab3aaf344d6ac83633e\": container with ID starting with 86c8fceba2638ec00af998fb9b4c760889e400dbd28a5ab3aaf344d6ac83633e not found: ID does not exist" containerID="86c8fceba2638ec00af998fb9b4c760889e400dbd28a5ab3aaf344d6ac83633e"
Sep 10 23:47:24.488128 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.488062    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c8fceba2638ec00af998fb9b4c760889e400dbd28a5ab3aaf344d6ac83633e"} err="failed to get container status \"86c8fceba2638ec00af998fb9b4c760889e400dbd28a5ab3aaf344d6ac83633e\": rpc error: code = NotFound desc = could not find container \"86c8fceba2638ec00af998fb9b4c760889e400dbd28a5ab3aaf344d6ac83633e\": container with ID starting with 86c8fceba2638ec00af998fb9b4c760889e400dbd28a5ab3aaf344d6ac83633e not found: ID does not exist"
Sep 10 23:47:24.488128 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.488088    2574 scope.go:117] "RemoveContainer" containerID="44db7de5e8ffc3a8413cc2c33fa9e7e43d607dab0f0ee54c7a6bbe4782bef0a4"
Sep 10 23:47:24.488444 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:47:24.488417    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44db7de5e8ffc3a8413cc2c33fa9e7e43d607dab0f0ee54c7a6bbe4782bef0a4\": container with ID starting with 44db7de5e8ffc3a8413cc2c33fa9e7e43d607dab0f0ee54c7a6bbe4782bef0a4 not found: ID does not exist" containerID="44db7de5e8ffc3a8413cc2c33fa9e7e43d607dab0f0ee54c7a6bbe4782bef0a4"
Sep 10 23:47:24.488546 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.488453    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44db7de5e8ffc3a8413cc2c33fa9e7e43d607dab0f0ee54c7a6bbe4782bef0a4"} err="failed to get container status \"44db7de5e8ffc3a8413cc2c33fa9e7e43d607dab0f0ee54c7a6bbe4782bef0a4\": rpc error: code = NotFound desc = could not find container \"44db7de5e8ffc3a8413cc2c33fa9e7e43d607dab0f0ee54c7a6bbe4782bef0a4\": container with ID starting with 44db7de5e8ffc3a8413cc2c33fa9e7e43d607dab0f0ee54c7a6bbe4782bef0a4 not found: ID does not exist"
Sep 10 23:47:24.491552 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.491527    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"]
Sep 10 23:47:24.495963 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:24.495936    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-cd653317-gw-openshift-default-848b888f84-6qp49"]
Sep 10 23:47:25.256391 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:25.256352    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" path="/var/lib/kubelet/pods/bdc80e00-efb2-487b-84b4-045d2f9b750d/volumes"
Sep 10 23:47:27.277245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.277209    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"]
Sep 10 23:47:27.277649 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.277555    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy"
Sep 10 23:47:27.277649 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.277566    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy"
Sep 10 23:47:27.277649 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.277583    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39af7bce-85bf-4fad-88f1-f955cd28ed79" containerName="revoke-keys"
Sep 10 23:47:27.277649 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.277588    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="39af7bce-85bf-4fad-88f1-f955cd28ed79" containerName="revoke-keys"
Sep 10 23:47:27.277649 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.277643    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="39af7bce-85bf-4fad-88f1-f955cd28ed79" containerName="revoke-keys"
Sep 10 23:47:27.277825 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.277656    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy"
Sep 10 23:47:27.277825 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.277662    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy"
Sep 10 23:47:27.282063 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.282044    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.284428 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.284406    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-c8619b9a-kserve-self-signed-certs\""
Sep 10 23:47:27.288514 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.288489    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"]
Sep 10 23:47:27.443777 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.443704    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-dshm\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.443971 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.443792    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-model-cache\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.443971 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.443816    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvw6s\" (UniqueName: \"kubernetes.io/projected/6b7af831-e65e-4033-803a-c6201023a8b0-kube-api-access-rvw6s\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.443971 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.443863    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-home\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.443971 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.443879    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-tmp-dir\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.443971 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.443960    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b7af831-e65e-4033-803a-c6201023a8b0-tls-certs\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.545298 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.545197    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-home\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.545298 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.545237    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-tmp-dir\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.545298 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.545283    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b7af831-e65e-4033-803a-c6201023a8b0-tls-certs\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.545606 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.545342    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-dshm\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.545606 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.545372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-model-cache\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.545606 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.545400    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvw6s\" (UniqueName: \"kubernetes.io/projected/6b7af831-e65e-4033-803a-c6201023a8b0-kube-api-access-rvw6s\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.546257 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.546224    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-model-cache\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.546380 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.546242    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-home\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.546447 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.546420    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-tmp-dir\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.548120 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.548089    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b7af831-e65e-4033-803a-c6201023a8b0-tls-certs\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.548227 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.548127    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-dshm\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.556831 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.556799    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvw6s\" (UniqueName: \"kubernetes.io/projected/6b7af831-e65e-4033-803a-c6201023a8b0-kube-api-access-rvw6s\") pod \"e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") " pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.582414 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.582363    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:27.592213 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.592185    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:27.867816 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:27.867726    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"]
Sep 10 23:47:27.870460 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:47:27.870430    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b7af831_e65e_4033_803a_c6201023a8b0.slice/crio-0f5e3a01cdf3605f672eb96b2210883f970113e50d485c914e920db792f39bf3 WatchSource:0}: Error finding container 0f5e3a01cdf3605f672eb96b2210883f970113e50d485c914e920db792f39bf3: Status 404 returned error can't find the container with id 0f5e3a01cdf3605f672eb96b2210883f970113e50d485c914e920db792f39bf3
Sep 10 23:47:28.498095 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:28.498058    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f" event={"ID":"6b7af831-e65e-4033-803a-c6201023a8b0","Type":"ContainerStarted","Data":"d0d85f449cf158fdc672c3dfef9b2c979dac0c67b85f009547aed2e3224e3aac"}
Sep 10 23:47:28.498491 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:28.498106    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f" event={"ID":"6b7af831-e65e-4033-803a-c6201023a8b0","Type":"ContainerStarted","Data":"0f5e3a01cdf3605f672eb96b2210883f970113e50d485c914e920db792f39bf3"}
Sep 10 23:47:28.513146 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:28.513089    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f" podStartSLOduration=1.5130691779999998 podStartE2EDuration="1.513069178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:47:28.513047911 +0000 UTC m=+845.695206040" watchObservedRunningTime="2026-09-10 23:47:28.513069178 +0000 UTC m=+845.695227327"
Sep 10 23:47:37.592973 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:37.592929    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:37.593553 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:37.592990    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:37.605691 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:37.605644    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:38.478775 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.478739    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"]
Sep 10 23:47:38.479124 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.479112    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy"
Sep 10 23:47:38.479180 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.479127    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc80e00-efb2-487b-84b4-045d2f9b750d" containerName="istio-proxy"
Sep 10 23:47:38.482361 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.482345    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.484680 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.484652    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-abe3de\"/\"openshift-service-ca.crt\""
Sep 10 23:47:38.484834 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.484654    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-abe3de\"/\"default-dockercfg-w2fvj\""
Sep 10 23:47:38.485778 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.485757    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-abe3de\"/\"kube-root-ca.crt\""
Sep 10 23:47:38.485882 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.485808    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-abe3de\"/\"autores-model-abe3de-kserve-self-signed-certs\""
Sep 10 23:47:38.490941 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.490428    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"]
Sep 10 23:47:38.576200 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.576169    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:47:38.642215 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.642179    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-home\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.642635 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.642245    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-tmp-dir\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.642635 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.642270    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns29p\" (UniqueName: \"kubernetes.io/projected/dab90a25-6ec1-4b13-8784-d63425341fd2-kube-api-access-ns29p\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.642635 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.642390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-dshm\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.642635 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.642437    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-model-cache\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.642635 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.642468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dab90a25-6ec1-4b13-8784-d63425341fd2-tls-certs\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.743984 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.743887    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-tmp-dir\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.743984 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.743929    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns29p\" (UniqueName: \"kubernetes.io/projected/dab90a25-6ec1-4b13-8784-d63425341fd2-kube-api-access-ns29p\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.743984 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.743968    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-dshm\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.744255 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.743999    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-model-cache\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.744255 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.744028    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dab90a25-6ec1-4b13-8784-d63425341fd2-tls-certs\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.744255 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.744103    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-home\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.744429 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.744292    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-tmp-dir\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.744527 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.744506    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-model-cache\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.744580 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.744526    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-home\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.746262 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.746241    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-dshm\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.746533 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.746512    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dab90a25-6ec1-4b13-8784-d63425341fd2-tls-certs\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.751403 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.751378    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns29p\" (UniqueName: \"kubernetes.io/projected/dab90a25-6ec1-4b13-8784-d63425341fd2-kube-api-access-ns29p\") pod \"autores-model-abe3de-kserve-758745499f-j5q56\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") " pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.793365 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.793331    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:38.891030 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:38.890991    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:39.066828 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:39.066802    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"]
Sep 10 23:47:39.069169 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:47:39.069135    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddab90a25_6ec1_4b13_8784_d63425341fd2.slice/crio-5b8c2aa711c595a21d454df00ee1774c480f1ee1a8da8c22b6defe9df8401ffa WatchSource:0}: Error finding container 5b8c2aa711c595a21d454df00ee1774c480f1ee1a8da8c22b6defe9df8401ffa: Status 404 returned error can't find the container with id 5b8c2aa711c595a21d454df00ee1774c480f1ee1a8da8c22b6defe9df8401ffa
Sep 10 23:47:39.572079 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:39.572038    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56" event={"ID":"dab90a25-6ec1-4b13-8784-d63425341fd2","Type":"ContainerStarted","Data":"07f82d4ad0090c6927d25f38856fea06c288871b4fc73f623ae813a0d09012ed"}
Sep 10 23:47:39.572268 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:39.572092    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56" event={"ID":"dab90a25-6ec1-4b13-8784-d63425341fd2","Type":"ContainerStarted","Data":"5b8c2aa711c595a21d454df00ee1774c480f1ee1a8da8c22b6defe9df8401ffa"}
Sep 10 23:47:39.588480 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:39.588425    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56" podStartSLOduration=1.588409461 podStartE2EDuration="1.588409461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:47:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:47:39.586400538 +0000 UTC m=+856.768558669" watchObservedRunningTime="2026-09-10 23:47:39.588409461 +0000 UTC m=+856.770567589"
Sep 10 23:47:41.097174 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:41.097135    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:47:47.342117 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:47.342079    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw"]
Sep 10 23:47:47.345656 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:47.345637    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw"
Sep 10 23:47:47.348083 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:47.348059    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-55278\""
Sep 10 23:47:47.348197 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:47.348158    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:47:47.355278 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:47.355249    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw"]
Sep 10 23:47:47.440380 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:47.440324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1094fd3f-bd15-4614-93aa-f1d07b573daf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw\" (UID: \"1094fd3f-bd15-4614-93aa-f1d07b573daf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw"
Sep 10 23:47:47.541870 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:47.541827    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1094fd3f-bd15-4614-93aa-f1d07b573daf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw\" (UID: \"1094fd3f-bd15-4614-93aa-f1d07b573daf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw"
Sep 10 23:47:47.542471 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:47.542447    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1094fd3f-bd15-4614-93aa-f1d07b573daf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw\" (UID: \"1094fd3f-bd15-4614-93aa-f1d07b573daf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw"
Sep 10 23:47:47.657729 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:47.657674    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw"
Sep 10 23:47:47.929088 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:47.929061    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw"]
Sep 10 23:47:47.931395 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:47:47.931367    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1094fd3f_bd15_4614_93aa_f1d07b573daf.slice/crio-d22128a260a3e8fae198f01723d4f5fbf5f59391b52d219f055113776cc906b3 WatchSource:0}: Error finding container d22128a260a3e8fae198f01723d4f5fbf5f59391b52d219f055113776cc906b3: Status 404 returned error can't find the container with id d22128a260a3e8fae198f01723d4f5fbf5f59391b52d219f055113776cc906b3
Sep 10 23:47:48.623351 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:48.623315    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw" event={"ID":"1094fd3f-bd15-4614-93aa-f1d07b573daf","Type":"ContainerStarted","Data":"452c9291fb13980b99ba3de9a52cf4c919368f4acdc9673f9b349bbbf615a762"}
Sep 10 23:47:48.623868 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:48.623371    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw" event={"ID":"1094fd3f-bd15-4614-93aa-f1d07b573daf","Type":"ContainerStarted","Data":"d22128a260a3e8fae198f01723d4f5fbf5f59391b52d219f055113776cc906b3"}
Sep 10 23:47:48.637133 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:48.637070    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw" podStartSLOduration=1.6370532340000001 podStartE2EDuration="1.637053234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:47:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:47:48.635893472 +0000 UTC m=+865.818051601" watchObservedRunningTime="2026-09-10 23:47:48.637053234 +0000 UTC m=+865.819211421"
Sep 10 23:47:48.794340 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:48.794305    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:48.794527 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:48.794387    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:48.806674 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:48.806650    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:49.630373 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:49.630335    2574 generic.go:356] "Generic (PLEG): container finished" podID="1094fd3f-bd15-4614-93aa-f1d07b573daf" containerID="452c9291fb13980b99ba3de9a52cf4c919368f4acdc9673f9b349bbbf615a762" exitCode=0
Sep 10 23:47:49.630826 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:49.630421    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw" event={"ID":"1094fd3f-bd15-4614-93aa-f1d07b573daf","Type":"ContainerDied","Data":"452c9291fb13980b99ba3de9a52cf4c919368f4acdc9673f9b349bbbf615a762"}
Sep 10 23:47:49.642065 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:49.642037    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:47:50.767540 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:50.767511    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw"
Sep 10 23:47:50.873089 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:50.873048    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1094fd3f-bd15-4614-93aa-f1d07b573daf-maas-api-service-ca\") pod \"1094fd3f-bd15-4614-93aa-f1d07b573daf\" (UID: \"1094fd3f-bd15-4614-93aa-f1d07b573daf\") "
Sep 10 23:47:50.873492 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:50.873468    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1094fd3f-bd15-4614-93aa-f1d07b573daf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1094fd3f-bd15-4614-93aa-f1d07b573daf" (UID: "1094fd3f-bd15-4614-93aa-f1d07b573daf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:47:50.974410 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:50.974321    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1094fd3f-bd15-4614-93aa-f1d07b573daf-maas-api-service-ca\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:47:51.643539 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:51.643506    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw"
Sep 10 23:47:51.643539 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:51.643521    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw" event={"ID":"1094fd3f-bd15-4614-93aa-f1d07b573daf","Type":"ContainerDied","Data":"d22128a260a3e8fae198f01723d4f5fbf5f59391b52d219f055113776cc906b3"}
Sep 10 23:47:51.643780 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:51.643570    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d22128a260a3e8fae198f01723d4f5fbf5f59391b52d219f055113776cc906b3"
Sep 10 23:47:52.695449 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.695411    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"]
Sep 10 23:47:52.695946 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.695926    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1094fd3f-bd15-4614-93aa-f1d07b573daf" containerName="revoke-keys"
Sep 10 23:47:52.696010 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.695950    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1094fd3f-bd15-4614-93aa-f1d07b573daf" containerName="revoke-keys"
Sep 10 23:47:52.696051 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.696043    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1094fd3f-bd15-4614-93aa-f1d07b573daf" containerName="revoke-keys"
Sep 10 23:47:52.699365 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.699340    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.701879 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.701845    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-487960\"/\"openshift-service-ca.crt\""
Sep 10 23:47:52.702020 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.701958    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-487960\"/\"kube-root-ca.crt\""
Sep 10 23:47:52.702203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.702187    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-487960\"/\"default-dockercfg-p9cf7\""
Sep 10 23:47:52.703300 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.703277    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-487960\"/\"test-model-487960-kserve-self-signed-certs\""
Sep 10 23:47:52.706442 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.706417    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"]
Sep 10 23:47:52.717422 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.717392    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:52.790972 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.790937    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-home\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.790972 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.790976    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfjsf\" (UniqueName: \"kubernetes.io/projected/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-kube-api-access-nfjsf\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.791192 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.791085    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-model-cache\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.791192 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.791121    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-dshm\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.791192 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.791153    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-tls-certs\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.791296 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.791195    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-tmp-dir\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.891671 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.891631    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-home\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.891671 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.891674    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfjsf\" (UniqueName: \"kubernetes.io/projected/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-kube-api-access-nfjsf\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.891954 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.891754    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-model-cache\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.891954 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.891774    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-dshm\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.891954 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.891800    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-tls-certs\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.891954 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.891834    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-tmp-dir\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.892193 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.892171    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-home\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.892247 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.892217    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-model-cache\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.892305 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.892289    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-tmp-dir\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.894134 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.894111    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-dshm\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.894300 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.894281    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-tls-certs\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:52.899189 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:52.899163    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfjsf\" (UniqueName: \"kubernetes.io/projected/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-kube-api-access-nfjsf\") pod \"test-model-487960-kserve-5d48ffdccc-prgmm\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") " pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:53.010457 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:53.010352    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:47:53.286612 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:53.286581    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"]
Sep 10 23:47:53.288648 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:47:53.288623    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4a2a420_d599_4bd8_9023_dd8cd1b65ae9.slice/crio-eb86981218a2f871e13b46195fe0a0b8c974ca2c49bab0abb1e23fe225a51eef WatchSource:0}: Error finding container eb86981218a2f871e13b46195fe0a0b8c974ca2c49bab0abb1e23fe225a51eef: Status 404 returned error can't find the container with id eb86981218a2f871e13b46195fe0a0b8c974ca2c49bab0abb1e23fe225a51eef
Sep 10 23:47:53.345365 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:53.345329    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:53.406967 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:53.406931    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:53.465349 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:53.465313    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:53.521831 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:53.521785    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw"]
Sep 10 23:47:53.524330 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:53.524298    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:53.525177 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:53.525142    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d949bf5d-d65hw"]
Sep 10 23:47:53.657041 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:53.657009    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm" event={"ID":"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9","Type":"ContainerStarted","Data":"bf856e83b127e49f20232dbcc4e73c5b10f95ed5aadfe5456fd48dbb567db985"}
Sep 10 23:47:53.657261 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:53.657054    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm" event={"ID":"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9","Type":"ContainerStarted","Data":"eb86981218a2f871e13b46195fe0a0b8c974ca2c49bab0abb1e23fe225a51eef"}
Sep 10 23:47:53.673420 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:53.673364    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm" podStartSLOduration=1.673324059 podStartE2EDuration="1.673324059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:47:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:47:53.672458864 +0000 UTC m=+870.854616984" watchObservedRunningTime="2026-09-10 23:47:53.673324059 +0000 UTC m=+870.855482209"
Sep 10 23:47:54.595136 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:54.595097    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:55.000522 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.000491    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:55.256012 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.255930    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1094fd3f-bd15-4614-93aa-f1d07b573daf" path="/var/lib/kubelet/pods/1094fd3f-bd15-4614-93aa-f1d07b573daf/volumes"
Sep 10 23:47:55.349901 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.349866    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"]
Sep 10 23:47:55.353388 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.353372    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.356654 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.356634    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-51b15052-openshift-default-dockercfg-5278n\""
Sep 10 23:47:55.356836 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.356824    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 23:47:55.373888 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.373859    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"]
Sep 10 23:47:55.383257 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.383227    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:55.415728 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.415670    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-data\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.415914 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.415737    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-workload-socket\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.415914 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.415772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-token\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.415914 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.415789    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-workload-certs\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.415914 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.415823    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-credential-socket\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.416053 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.415928    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-podinfo\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.416053 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.415960    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-envoy\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.416053 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.416007    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sdm4\" (UniqueName: \"kubernetes.io/projected/26c6bab9-65cc-45eb-8ce2-3c067466c12f-kube-api-access-9sdm4\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.416053 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.416043    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istiod-ca-cert\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.517309 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.517218    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-podinfo\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.517309 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.517258    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-envoy\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.517309 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.517286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sdm4\" (UniqueName: \"kubernetes.io/projected/26c6bab9-65cc-45eb-8ce2-3c067466c12f-kube-api-access-9sdm4\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.517629 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.517325    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istiod-ca-cert\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.517629 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.517356    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-data\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.517629 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.517385    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-workload-socket\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.517629 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.517414    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-token\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.517629 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.517440    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-workload-certs\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.517629 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.517470    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-credential-socket\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.517960 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.517848    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-workload-socket\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.517960 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.517884    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-data\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.518046 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.517996    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-workload-certs\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.518046 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.518018    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-credential-socket\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.518204 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.518185    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istiod-ca-cert\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.520178 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.520151    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-envoy\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.520271 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.520250    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-podinfo\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.527357 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.527331    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-token\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.527797 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.527772    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sdm4\" (UniqueName: \"kubernetes.io/projected/26c6bab9-65cc-45eb-8ce2-3c067466c12f-kube-api-access-9sdm4\") pod \"e2e-derive-51b15052-openshift-default-5d445df968-bsq7w\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") " pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.571362 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.571322    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:55.664187 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.664158    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:55.940625 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.940597    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"]
Sep 10 23:47:55.942949 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:47:55.942921    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c6bab9_65cc_45eb_8ce2_3c067466c12f.slice/crio-0a97086f614294b2cc9a353678eefa7c6ca5346e611ccbe30ffa8f0ffa91a581 WatchSource:0}: Error finding container 0a97086f614294b2cc9a353678eefa7c6ca5346e611ccbe30ffa8f0ffa91a581: Status 404 returned error can't find the container with id 0a97086f614294b2cc9a353678eefa7c6ca5346e611ccbe30ffa8f0ffa91a581
Sep 10 23:47:55.945367 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.945329    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:47:55.945450 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.945410    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:47:55.945450 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:55.945446    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:47:56.677066 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:56.677019    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w" event={"ID":"26c6bab9-65cc-45eb-8ce2-3c067466c12f","Type":"ContainerStarted","Data":"9a230fba6d10b7aa3fc83f2db4a7532f8d916cca1dc3e03015da49689042f498"}
Sep 10 23:47:56.677479 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:56.677096    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w" event={"ID":"26c6bab9-65cc-45eb-8ce2-3c067466c12f","Type":"ContainerStarted","Data":"0a97086f614294b2cc9a353678eefa7c6ca5346e611ccbe30ffa8f0ffa91a581"}
Sep 10 23:47:56.699480 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:56.699420    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w" podStartSLOduration=1.699403099 podStartE2EDuration="1.699403099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:47:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:47:56.696317931 +0000 UTC m=+873.878476059" watchObservedRunningTime="2026-09-10 23:47:56.699403099 +0000 UTC m=+873.881561228"
Sep 10 23:47:57.474060 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:57.474027    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"]
Sep 10 23:47:57.493110 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:57.493075    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:57.664831 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:57.664794    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:57.670073 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:57.670043    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:57.683237 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:57.683203    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:57.684671 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:57.684652    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:47:58.017191 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:58.017159    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:58.117160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:58.117123    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:58.678280 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:58.678240    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"]
Sep 10 23:47:58.695115 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:58.695077    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:58.921179 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:58.921140    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:59.656337 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:59.656297    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:59.713324 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:47:59.713282    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:00.052103 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:00.052000    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:00.145787 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:00.145749    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:00.217530 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:00.217493    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:00.612016 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:00.611979    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:48:00.730991 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:00.730945    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:01.631474 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:01.631439    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:03.010827 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:03.010787    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:48:03.011223 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:03.010855    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:48:03.023624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:03.023593    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:48:03.740171 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:03.740141    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:48:09.025100 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:09.025064    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:09.548455 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:09.548417    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:09.648690 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:09.648656    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:09.729665 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:09.729633    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:09.782493 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:09.782453    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:10.071163 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:10.071122    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:12.494468 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.494404    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f" podUID="6b7af831-e65e-4033-803a-c6201023a8b0" containerName="main" containerID="cri-o://d0d85f449cf158fdc672c3dfef9b2c979dac0c67b85f009547aed2e3224e3aac" gracePeriod=45
Sep 10 23:48:12.743725 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.743677    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:48:12.785731 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.785615    2574 generic.go:356] "Generic (PLEG): container finished" podID="6b7af831-e65e-4033-803a-c6201023a8b0" containerID="d0d85f449cf158fdc672c3dfef9b2c979dac0c67b85f009547aed2e3224e3aac" exitCode=0
Sep 10 23:48:12.785731 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.785671    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"
Sep 10 23:48:12.785731 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.785688    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f" event={"ID":"6b7af831-e65e-4033-803a-c6201023a8b0","Type":"ContainerDied","Data":"d0d85f449cf158fdc672c3dfef9b2c979dac0c67b85f009547aed2e3224e3aac"}
Sep 10 23:48:12.786013 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.785750    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f" event={"ID":"6b7af831-e65e-4033-803a-c6201023a8b0","Type":"ContainerDied","Data":"0f5e3a01cdf3605f672eb96b2210883f970113e50d485c914e920db792f39bf3"}
Sep 10 23:48:12.786013 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.785770    2574 scope.go:117] "RemoveContainer" containerID="d0d85f449cf158fdc672c3dfef9b2c979dac0c67b85f009547aed2e3224e3aac"
Sep 10 23:48:12.794627 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.794603    2574 scope.go:117] "RemoveContainer" containerID="d0d85f449cf158fdc672c3dfef9b2c979dac0c67b85f009547aed2e3224e3aac"
Sep 10 23:48:12.794907 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:48:12.794891    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0d85f449cf158fdc672c3dfef9b2c979dac0c67b85f009547aed2e3224e3aac\": container with ID starting with d0d85f449cf158fdc672c3dfef9b2c979dac0c67b85f009547aed2e3224e3aac not found: ID does not exist" containerID="d0d85f449cf158fdc672c3dfef9b2c979dac0c67b85f009547aed2e3224e3aac"
Sep 10 23:48:12.794969 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.794916    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0d85f449cf158fdc672c3dfef9b2c979dac0c67b85f009547aed2e3224e3aac"} err="failed to get container status \"d0d85f449cf158fdc672c3dfef9b2c979dac0c67b85f009547aed2e3224e3aac\": rpc error: code = NotFound desc = could not find container \"d0d85f449cf158fdc672c3dfef9b2c979dac0c67b85f009547aed2e3224e3aac\": container with ID starting with d0d85f449cf158fdc672c3dfef9b2c979dac0c67b85f009547aed2e3224e3aac not found: ID does not exist"
Sep 10 23:48:12.895636 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.895596    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-model-cache\") pod \"6b7af831-e65e-4033-803a-c6201023a8b0\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") "
Sep 10 23:48:12.895835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.895648    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-dshm\") pod \"6b7af831-e65e-4033-803a-c6201023a8b0\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") "
Sep 10 23:48:12.895835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.895682    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-tmp-dir\") pod \"6b7af831-e65e-4033-803a-c6201023a8b0\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") "
Sep 10 23:48:12.895835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.895739    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b7af831-e65e-4033-803a-c6201023a8b0-tls-certs\") pod \"6b7af831-e65e-4033-803a-c6201023a8b0\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") "
Sep 10 23:48:12.895835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.895776    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvw6s\" (UniqueName: \"kubernetes.io/projected/6b7af831-e65e-4033-803a-c6201023a8b0-kube-api-access-rvw6s\") pod \"6b7af831-e65e-4033-803a-c6201023a8b0\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") "
Sep 10 23:48:12.895835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.895828    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-home\") pod \"6b7af831-e65e-4033-803a-c6201023a8b0\" (UID: \"6b7af831-e65e-4033-803a-c6201023a8b0\") "
Sep 10 23:48:12.896103 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.895933    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-model-cache" (OuterVolumeSpecName: "model-cache") pod "6b7af831-e65e-4033-803a-c6201023a8b0" (UID: "6b7af831-e65e-4033-803a-c6201023a8b0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:12.896103 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.896002    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6b7af831-e65e-4033-803a-c6201023a8b0" (UID: "6b7af831-e65e-4033-803a-c6201023a8b0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:12.896213 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.896116    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-home" (OuterVolumeSpecName: "home") pod "6b7af831-e65e-4033-803a-c6201023a8b0" (UID: "6b7af831-e65e-4033-803a-c6201023a8b0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:12.896257 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.896235    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:12.896257 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.896252    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:12.896324 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.896260    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:12.898200 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.898169    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b7af831-e65e-4033-803a-c6201023a8b0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6b7af831-e65e-4033-803a-c6201023a8b0" (UID: "6b7af831-e65e-4033-803a-c6201023a8b0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:48:12.898319 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.898224    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-dshm" (OuterVolumeSpecName: "dshm") pod "6b7af831-e65e-4033-803a-c6201023a8b0" (UID: "6b7af831-e65e-4033-803a-c6201023a8b0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:12.898319 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.898237    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b7af831-e65e-4033-803a-c6201023a8b0-kube-api-access-rvw6s" (OuterVolumeSpecName: "kube-api-access-rvw6s") pod "6b7af831-e65e-4033-803a-c6201023a8b0" (UID: "6b7af831-e65e-4033-803a-c6201023a8b0"). InnerVolumeSpecName "kube-api-access-rvw6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:48:12.997012 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.996958    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b7af831-e65e-4033-803a-c6201023a8b0-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:12.997012 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.997006    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvw6s\" (UniqueName: \"kubernetes.io/projected/6b7af831-e65e-4033-803a-c6201023a8b0-kube-api-access-rvw6s\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:12.997012 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:12.997019    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b7af831-e65e-4033-803a-c6201023a8b0-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:13.108661 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:13.108627    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"]
Sep 10 23:48:13.111923 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:13.111892    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-c8619b9a-kserve-5fcc7d7894-wk47f"]
Sep 10 23:48:13.257034 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:13.256997    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b7af831-e65e-4033-803a-c6201023a8b0" path="/var/lib/kubelet/pods/6b7af831-e65e-4033-803a-c6201023a8b0/volumes"
Sep 10 23:48:13.701704 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:13.701640    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56" podUID="dab90a25-6ec1-4b13-8784-d63425341fd2" containerName="main" containerID="cri-o://07f82d4ad0090c6927d25f38856fea06c288871b4fc73f623ae813a0d09012ed" gracePeriod=45
Sep 10 23:48:13.957369 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:13.957303    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:48:14.104766 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.104731    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-dshm\") pod \"dab90a25-6ec1-4b13-8784-d63425341fd2\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") "
Sep 10 23:48:14.104949 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.104815    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-model-cache\") pod \"dab90a25-6ec1-4b13-8784-d63425341fd2\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") "
Sep 10 23:48:14.104949 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.104866    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-tmp-dir\") pod \"dab90a25-6ec1-4b13-8784-d63425341fd2\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") "
Sep 10 23:48:14.104949 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.104921    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dab90a25-6ec1-4b13-8784-d63425341fd2-tls-certs\") pod \"dab90a25-6ec1-4b13-8784-d63425341fd2\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") "
Sep 10 23:48:14.105119 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.104958    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns29p\" (UniqueName: \"kubernetes.io/projected/dab90a25-6ec1-4b13-8784-d63425341fd2-kube-api-access-ns29p\") pod \"dab90a25-6ec1-4b13-8784-d63425341fd2\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") "
Sep 10 23:48:14.105119 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.105006    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-home\") pod \"dab90a25-6ec1-4b13-8784-d63425341fd2\" (UID: \"dab90a25-6ec1-4b13-8784-d63425341fd2\") "
Sep 10 23:48:14.105266 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.105138    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-model-cache" (OuterVolumeSpecName: "model-cache") pod "dab90a25-6ec1-4b13-8784-d63425341fd2" (UID: "dab90a25-6ec1-4b13-8784-d63425341fd2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:14.105266 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.105160    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dab90a25-6ec1-4b13-8784-d63425341fd2" (UID: "dab90a25-6ec1-4b13-8784-d63425341fd2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:14.105373 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.105331    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-home" (OuterVolumeSpecName: "home") pod "dab90a25-6ec1-4b13-8784-d63425341fd2" (UID: "dab90a25-6ec1-4b13-8784-d63425341fd2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:14.105373 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.105359    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:14.105445 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.105378    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:14.107017 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.106988    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-dshm" (OuterVolumeSpecName: "dshm") pod "dab90a25-6ec1-4b13-8784-d63425341fd2" (UID: "dab90a25-6ec1-4b13-8784-d63425341fd2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:14.107522 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.107501    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab90a25-6ec1-4b13-8784-d63425341fd2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dab90a25-6ec1-4b13-8784-d63425341fd2" (UID: "dab90a25-6ec1-4b13-8784-d63425341fd2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:48:14.107608 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.107517    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab90a25-6ec1-4b13-8784-d63425341fd2-kube-api-access-ns29p" (OuterVolumeSpecName: "kube-api-access-ns29p") pod "dab90a25-6ec1-4b13-8784-d63425341fd2" (UID: "dab90a25-6ec1-4b13-8784-d63425341fd2"). InnerVolumeSpecName "kube-api-access-ns29p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:48:14.206927 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.206893    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:14.206927 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.206920    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dab90a25-6ec1-4b13-8784-d63425341fd2-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:14.206927 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.206929    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dab90a25-6ec1-4b13-8784-d63425341fd2-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:14.207159 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.206938    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns29p\" (UniqueName: \"kubernetes.io/projected/dab90a25-6ec1-4b13-8784-d63425341fd2-kube-api-access-ns29p\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:14.291856 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.291767    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"]
Sep 10 23:48:14.312673 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.312640    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:14.799229 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.799195    2574 generic.go:356] "Generic (PLEG): container finished" podID="dab90a25-6ec1-4b13-8784-d63425341fd2" containerID="07f82d4ad0090c6927d25f38856fea06c288871b4fc73f623ae813a0d09012ed" exitCode=0
Sep 10 23:48:14.799682 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.799238    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"
Sep 10 23:48:14.799682 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.799273    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56" event={"ID":"dab90a25-6ec1-4b13-8784-d63425341fd2","Type":"ContainerDied","Data":"07f82d4ad0090c6927d25f38856fea06c288871b4fc73f623ae813a0d09012ed"}
Sep 10 23:48:14.799682 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.799314    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56" event={"ID":"dab90a25-6ec1-4b13-8784-d63425341fd2","Type":"ContainerDied","Data":"5b8c2aa711c595a21d454df00ee1774c480f1ee1a8da8c22b6defe9df8401ffa"}
Sep 10 23:48:14.799682 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.799334    2574 scope.go:117] "RemoveContainer" containerID="07f82d4ad0090c6927d25f38856fea06c288871b4fc73f623ae813a0d09012ed"
Sep 10 23:48:14.809184 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.809166    2574 scope.go:117] "RemoveContainer" containerID="07f82d4ad0090c6927d25f38856fea06c288871b4fc73f623ae813a0d09012ed"
Sep 10 23:48:14.809475 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:48:14.809455    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07f82d4ad0090c6927d25f38856fea06c288871b4fc73f623ae813a0d09012ed\": container with ID starting with 07f82d4ad0090c6927d25f38856fea06c288871b4fc73f623ae813a0d09012ed not found: ID does not exist" containerID="07f82d4ad0090c6927d25f38856fea06c288871b4fc73f623ae813a0d09012ed"
Sep 10 23:48:14.809516 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.809485    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f82d4ad0090c6927d25f38856fea06c288871b4fc73f623ae813a0d09012ed"} err="failed to get container status \"07f82d4ad0090c6927d25f38856fea06c288871b4fc73f623ae813a0d09012ed\": rpc error: code = NotFound desc = could not find container \"07f82d4ad0090c6927d25f38856fea06c288871b4fc73f623ae813a0d09012ed\": container with ID starting with 07f82d4ad0090c6927d25f38856fea06c288871b4fc73f623ae813a0d09012ed not found: ID does not exist"
Sep 10 23:48:14.821000 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.820973    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"]
Sep 10 23:48:14.823221 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:14.823201    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-abe3de/autores-model-abe3de-kserve-758745499f-j5q56"]
Sep 10 23:48:15.261734 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:15.261671    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dab90a25-6ec1-4b13-8784-d63425341fd2" path="/var/lib/kubelet/pods/dab90a25-6ec1-4b13-8784-d63425341fd2/volumes"
Sep 10 23:48:15.903445 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:15.903357    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:16.005091 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:16.005060    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:16.170528 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:16.170434    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:16.619656 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:16.619613    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:16.913704 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:16.913600    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:17.228427 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:17.228319    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:19.563839 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:19.563806    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:19.659274 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:19.659232    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:20.535513 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:20.535485    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:21.454443 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:21.454390    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:21.557451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:21.557409    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:22.004918 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:22.004873    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:22.092454 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:22.092411    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:22.411195 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:22.411147    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:23.123088 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:23.123046    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:23.834283 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:23.834243    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:23.861670 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:23.861633    2574 generic.go:356] "Generic (PLEG): container finished" podID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerID="9a230fba6d10b7aa3fc83f2db4a7532f8d916cca1dc3e03015da49689042f498" exitCode=0
Sep 10 23:48:23.861861 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:23.861686    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w" event={"ID":"26c6bab9-65cc-45eb-8ce2-3c067466c12f","Type":"ContainerDied","Data":"9a230fba6d10b7aa3fc83f2db4a7532f8d916cca1dc3e03015da49689042f498"}
Sep 10 23:48:23.862143 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:23.862123    2574 scope.go:117] "RemoveContainer" containerID="9a230fba6d10b7aa3fc83f2db4a7532f8d916cca1dc3e03015da49689042f498"
Sep 10 23:48:23.863244 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:23.863211    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:48:23.863321 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:23.863287    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:48:23.863363 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:23.863322    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:48:23.999098 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:23.999061    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:48:24.464311 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:24.464275    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:24.870179 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:24.870148    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w" event={"ID":"26c6bab9-65cc-45eb-8ce2-3c067466c12f","Type":"ContainerStarted","Data":"8dc4966303393e5acf654d2f81509506bd21dfdad89e4c65ce8e0a0e23b2144b"}
Sep 10 23:48:25.664360 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:25.664315    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:48:25.665696 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:25.665661    2574 patch_prober.go:28] interesting pod/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 10 23:48:25.665843 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:25.665754    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w" podUID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 10 23:48:26.665135 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:26.665098    2574 patch_prober.go:28] interesting pod/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 10 23:48:26.665554 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:26.665156    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w" podUID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 10 23:48:27.665022 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:27.664981    2574 patch_prober.go:28] interesting pod/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 10 23:48:27.665214 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:27.665051    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w" podUID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 10 23:48:27.683601 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:27.683563    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:48:28.665243 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:28.665201    2574 patch_prober.go:28] interesting pod/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 10 23:48:28.665664 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:28.665261    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w" podUID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 10 23:48:29.311528 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.311475    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh" podUID="813829ec-41a8-4ce9-846e-57a3d9e368ee" containerName="main" containerID="cri-o://d9b2a4503950f7d532fed8835c63f2477e61e5da5cc8e500ff1f429f24a86d70" gracePeriod=45
Sep 10 23:48:29.326863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.326825    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:29.613327 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.613294    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:48:29.664743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.664057    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-model-cache\") pod \"813829ec-41a8-4ce9-846e-57a3d9e368ee\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") "
Sep 10 23:48:29.664743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.664125    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/813829ec-41a8-4ce9-846e-57a3d9e368ee-tls-certs\") pod \"813829ec-41a8-4ce9-846e-57a3d9e368ee\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") "
Sep 10 23:48:29.664743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.664205    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-home\") pod \"813829ec-41a8-4ce9-846e-57a3d9e368ee\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") "
Sep 10 23:48:29.664743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.664259    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-dshm\") pod \"813829ec-41a8-4ce9-846e-57a3d9e368ee\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") "
Sep 10 23:48:29.664743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.664309    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r89n4\" (UniqueName: \"kubernetes.io/projected/813829ec-41a8-4ce9-846e-57a3d9e368ee-kube-api-access-r89n4\") pod \"813829ec-41a8-4ce9-846e-57a3d9e368ee\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") "
Sep 10 23:48:29.664743 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.664368    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-tmp-dir\") pod \"813829ec-41a8-4ce9-846e-57a3d9e368ee\" (UID: \"813829ec-41a8-4ce9-846e-57a3d9e368ee\") "
Sep 10 23:48:29.665257 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.664929    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-home" (OuterVolumeSpecName: "home") pod "813829ec-41a8-4ce9-846e-57a3d9e368ee" (UID: "813829ec-41a8-4ce9-846e-57a3d9e368ee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:29.665257 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.664936    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "813829ec-41a8-4ce9-846e-57a3d9e368ee" (UID: "813829ec-41a8-4ce9-846e-57a3d9e368ee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:29.665739 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.665305    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-model-cache" (OuterVolumeSpecName: "model-cache") pod "813829ec-41a8-4ce9-846e-57a3d9e368ee" (UID: "813829ec-41a8-4ce9-846e-57a3d9e368ee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:29.665967 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.665933    2574 patch_prober.go:28] interesting pod/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 10 23:48:29.666118 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.666002    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w" podUID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 10 23:48:29.668291 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.668246    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/813829ec-41a8-4ce9-846e-57a3d9e368ee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "813829ec-41a8-4ce9-846e-57a3d9e368ee" (UID: "813829ec-41a8-4ce9-846e-57a3d9e368ee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:48:29.668630 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.668591    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/813829ec-41a8-4ce9-846e-57a3d9e368ee-kube-api-access-r89n4" (OuterVolumeSpecName: "kube-api-access-r89n4") pod "813829ec-41a8-4ce9-846e-57a3d9e368ee" (UID: "813829ec-41a8-4ce9-846e-57a3d9e368ee"). InnerVolumeSpecName "kube-api-access-r89n4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:48:29.668630 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.668601    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-dshm" (OuterVolumeSpecName: "dshm") pod "813829ec-41a8-4ce9-846e-57a3d9e368ee" (UID: "813829ec-41a8-4ce9-846e-57a3d9e368ee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:29.765682 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.765641    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:29.765682 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.765677    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:29.765682 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.765687    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r89n4\" (UniqueName: \"kubernetes.io/projected/813829ec-41a8-4ce9-846e-57a3d9e368ee-kube-api-access-r89n4\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:29.765946 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.765697    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:29.765946 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.765724    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/813829ec-41a8-4ce9-846e-57a3d9e368ee-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:29.765946 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.765733    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/813829ec-41a8-4ce9-846e-57a3d9e368ee-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:29.875516 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.875465    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:29.903856 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.903763    2574 generic.go:356] "Generic (PLEG): container finished" podID="813829ec-41a8-4ce9-846e-57a3d9e368ee" containerID="d9b2a4503950f7d532fed8835c63f2477e61e5da5cc8e500ff1f429f24a86d70" exitCode=0
Sep 10 23:48:29.903856 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.903857    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"
Sep 10 23:48:29.904117 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.903889    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh" event={"ID":"813829ec-41a8-4ce9-846e-57a3d9e368ee","Type":"ContainerDied","Data":"d9b2a4503950f7d532fed8835c63f2477e61e5da5cc8e500ff1f429f24a86d70"}
Sep 10 23:48:29.904117 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.903931    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh" event={"ID":"813829ec-41a8-4ce9-846e-57a3d9e368ee","Type":"ContainerDied","Data":"adb64d32f823ee35ea46403202d9a930de53ee7123fea878f178cd7a2058cdd6"}
Sep 10 23:48:29.904117 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.903952    2574 scope.go:117] "RemoveContainer" containerID="d9b2a4503950f7d532fed8835c63f2477e61e5da5cc8e500ff1f429f24a86d70"
Sep 10 23:48:29.918636 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.918605    2574 scope.go:117] "RemoveContainer" containerID="d9b2a4503950f7d532fed8835c63f2477e61e5da5cc8e500ff1f429f24a86d70"
Sep 10 23:48:29.919040 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:48:29.919017    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9b2a4503950f7d532fed8835c63f2477e61e5da5cc8e500ff1f429f24a86d70\": container with ID starting with d9b2a4503950f7d532fed8835c63f2477e61e5da5cc8e500ff1f429f24a86d70 not found: ID does not exist" containerID="d9b2a4503950f7d532fed8835c63f2477e61e5da5cc8e500ff1f429f24a86d70"
Sep 10 23:48:29.919152 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.919053    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9b2a4503950f7d532fed8835c63f2477e61e5da5cc8e500ff1f429f24a86d70"} err="failed to get container status \"d9b2a4503950f7d532fed8835c63f2477e61e5da5cc8e500ff1f429f24a86d70\": rpc error: code = NotFound desc = could not find container \"d9b2a4503950f7d532fed8835c63f2477e61e5da5cc8e500ff1f429f24a86d70\": container with ID starting with d9b2a4503950f7d532fed8835c63f2477e61e5da5cc8e500ff1f429f24a86d70 not found: ID does not exist"
Sep 10 23:48:29.934652 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.934608    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"]
Sep 10 23:48:29.937604 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.937575    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-c8619b9a-kserve-5f6877c968-9fwnh"]
Sep 10 23:48:29.940825 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.940746    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:29.998165 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:29.998109    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:30.059366 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:30.059326    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:30.183576 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:30.183482    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"]
Sep 10 23:48:30.183768 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:30.183694    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w" podUID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerName="istio-proxy" containerID="cri-o://8dc4966303393e5acf654d2f81509506bd21dfdad89e4c65ce8e0a0e23b2144b" gracePeriod=30
Sep 10 23:48:30.216095 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:30.216061    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:30.889565 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:30.889532    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:30.989124 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:30.989078    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:31.090972 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:31.090927    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:31.256994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:31.256907    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="813829ec-41a8-4ce9-846e-57a3d9e368ee" path="/var/lib/kubelet/pods/813829ec-41a8-4ce9-846e-57a3d9e368ee/volumes"
Sep 10 23:48:32.436979 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:32.436933    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:35.542330 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.542303    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:48:35.623040 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623004    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-token\") pod \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") "
Sep 10 23:48:35.623236 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623065    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istiod-ca-cert\") pod \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") "
Sep 10 23:48:35.623236 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623099    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-podinfo\") pod \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") "
Sep 10 23:48:35.623236 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623145    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-data\") pod \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") "
Sep 10 23:48:35.623236 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623175    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-workload-socket\") pod \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") "
Sep 10 23:48:35.623236 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623230    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-envoy\") pod \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") "
Sep 10 23:48:35.623519 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623472    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sdm4\" (UniqueName: \"kubernetes.io/projected/26c6bab9-65cc-45eb-8ce2-3c067466c12f-kube-api-access-9sdm4\") pod \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") "
Sep 10 23:48:35.623519 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623494    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-data" (OuterVolumeSpecName: "istio-data") pod "26c6bab9-65cc-45eb-8ce2-3c067466c12f" (UID: "26c6bab9-65cc-45eb-8ce2-3c067466c12f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:35.623634 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623532    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-workload-certs\") pod \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") "
Sep 10 23:48:35.623634 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623532    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26c6bab9-65cc-45eb-8ce2-3c067466c12f" (UID: "26c6bab9-65cc-45eb-8ce2-3c067466c12f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:35.623634 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623548    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26c6bab9-65cc-45eb-8ce2-3c067466c12f" (UID: "26c6bab9-65cc-45eb-8ce2-3c067466c12f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:48:35.623634 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623582    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-credential-socket\") pod \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\" (UID: \"26c6bab9-65cc-45eb-8ce2-3c067466c12f\") "
Sep 10 23:48:35.623898 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623848    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26c6bab9-65cc-45eb-8ce2-3c067466c12f" (UID: "26c6bab9-65cc-45eb-8ce2-3c067466c12f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:35.623970 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623904    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26c6bab9-65cc-45eb-8ce2-3c067466c12f" (UID: "26c6bab9-65cc-45eb-8ce2-3c067466c12f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:35.623970 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623947    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istiod-ca-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:35.624047 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623969    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-data\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:35.624047 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.623984    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-workload-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:35.625822 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.625802    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-token" (OuterVolumeSpecName: "istio-token") pod "26c6bab9-65cc-45eb-8ce2-3c067466c12f" (UID: "26c6bab9-65cc-45eb-8ce2-3c067466c12f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:48:35.625922 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.625803    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26c6bab9-65cc-45eb-8ce2-3c067466c12f" (UID: "26c6bab9-65cc-45eb-8ce2-3c067466c12f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:48:35.625977 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.625927    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26c6bab9-65cc-45eb-8ce2-3c067466c12f" (UID: "26c6bab9-65cc-45eb-8ce2-3c067466c12f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:48:35.625977 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.625928    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c6bab9-65cc-45eb-8ce2-3c067466c12f-kube-api-access-9sdm4" (OuterVolumeSpecName: "kube-api-access-9sdm4") pod "26c6bab9-65cc-45eb-8ce2-3c067466c12f" (UID: "26c6bab9-65cc-45eb-8ce2-3c067466c12f"). InnerVolumeSpecName "kube-api-access-9sdm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:48:35.724896 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.724855    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-token\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:35.724896 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.724886    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-podinfo\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:35.724896 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.724897    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-istio-envoy\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:35.724896 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.724905    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sdm4\" (UniqueName: \"kubernetes.io/projected/26c6bab9-65cc-45eb-8ce2-3c067466c12f-kube-api-access-9sdm4\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:35.725183 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.724917    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-workload-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:35.725183 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.724927    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c6bab9-65cc-45eb-8ce2-3c067466c12f-credential-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:48:35.941323 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.941227    2574 generic.go:356] "Generic (PLEG): container finished" podID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerID="8dc4966303393e5acf654d2f81509506bd21dfdad89e4c65ce8e0a0e23b2144b" exitCode=0
Sep 10 23:48:35.941323 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.941271    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"
Sep 10 23:48:35.941323 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.941312    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w" event={"ID":"26c6bab9-65cc-45eb-8ce2-3c067466c12f","Type":"ContainerDied","Data":"8dc4966303393e5acf654d2f81509506bd21dfdad89e4c65ce8e0a0e23b2144b"}
Sep 10 23:48:35.941554 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.941362    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w" event={"ID":"26c6bab9-65cc-45eb-8ce2-3c067466c12f","Type":"ContainerDied","Data":"0a97086f614294b2cc9a353678eefa7c6ca5346e611ccbe30ffa8f0ffa91a581"}
Sep 10 23:48:35.941554 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.941385    2574 scope.go:117] "RemoveContainer" containerID="8dc4966303393e5acf654d2f81509506bd21dfdad89e4c65ce8e0a0e23b2144b"
Sep 10 23:48:35.953573 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.953553    2574 scope.go:117] "RemoveContainer" containerID="9a230fba6d10b7aa3fc83f2db4a7532f8d916cca1dc3e03015da49689042f498"
Sep 10 23:48:35.962062 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.962020    2574 scope.go:117] "RemoveContainer" containerID="8dc4966303393e5acf654d2f81509506bd21dfdad89e4c65ce8e0a0e23b2144b"
Sep 10 23:48:35.962548 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:48:35.962525    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dc4966303393e5acf654d2f81509506bd21dfdad89e4c65ce8e0a0e23b2144b\": container with ID starting with 8dc4966303393e5acf654d2f81509506bd21dfdad89e4c65ce8e0a0e23b2144b not found: ID does not exist" containerID="8dc4966303393e5acf654d2f81509506bd21dfdad89e4c65ce8e0a0e23b2144b"
Sep 10 23:48:35.962650 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.962562    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dc4966303393e5acf654d2f81509506bd21dfdad89e4c65ce8e0a0e23b2144b"} err="failed to get container status \"8dc4966303393e5acf654d2f81509506bd21dfdad89e4c65ce8e0a0e23b2144b\": rpc error: code = NotFound desc = could not find container \"8dc4966303393e5acf654d2f81509506bd21dfdad89e4c65ce8e0a0e23b2144b\": container with ID starting with 8dc4966303393e5acf654d2f81509506bd21dfdad89e4c65ce8e0a0e23b2144b not found: ID does not exist"
Sep 10 23:48:35.962650 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.962588    2574 scope.go:117] "RemoveContainer" containerID="9a230fba6d10b7aa3fc83f2db4a7532f8d916cca1dc3e03015da49689042f498"
Sep 10 23:48:35.962875 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:48:35.962855    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a230fba6d10b7aa3fc83f2db4a7532f8d916cca1dc3e03015da49689042f498\": container with ID starting with 9a230fba6d10b7aa3fc83f2db4a7532f8d916cca1dc3e03015da49689042f498 not found: ID does not exist" containerID="9a230fba6d10b7aa3fc83f2db4a7532f8d916cca1dc3e03015da49689042f498"
Sep 10 23:48:35.962933 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.962886    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a230fba6d10b7aa3fc83f2db4a7532f8d916cca1dc3e03015da49689042f498"} err="failed to get container status \"9a230fba6d10b7aa3fc83f2db4a7532f8d916cca1dc3e03015da49689042f498\": rpc error: code = NotFound desc = could not find container \"9a230fba6d10b7aa3fc83f2db4a7532f8d916cca1dc3e03015da49689042f498\": container with ID starting with 9a230fba6d10b7aa3fc83f2db4a7532f8d916cca1dc3e03015da49689042f498 not found: ID does not exist"
Sep 10 23:48:35.965238 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.965179    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"]
Sep 10 23:48:35.967577 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:35.967555    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-51b15052-openshift-default-5d445df968-bsq7w"]
Sep 10 23:48:37.256858 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:37.256820    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" path="/var/lib/kubelet/pods/26c6bab9-65cc-45eb-8ce2-3c067466c12f/volumes"
Sep 10 23:48:38.795893 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:38.795855    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:38.897099 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:38.897054    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:38.997060 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:38.997023    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:39.125062 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:39.125029    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:39.478556 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:39.478463    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:41.807987 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:41.807945    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:48:42.421764 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:42.421732    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:44.187070 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187033    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"]
Sep 10 23:48:44.187459 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187407    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab90a25-6ec1-4b13-8784-d63425341fd2" containerName="main"
Sep 10 23:48:44.187459 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187418    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab90a25-6ec1-4b13-8784-d63425341fd2" containerName="main"
Sep 10 23:48:44.187459 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187433    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b7af831-e65e-4033-803a-c6201023a8b0" containerName="main"
Sep 10 23:48:44.187459 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187439    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b7af831-e65e-4033-803a-c6201023a8b0" containerName="main"
Sep 10 23:48:44.187459 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187446    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerName="istio-proxy"
Sep 10 23:48:44.187459 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187451    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerName="istio-proxy"
Sep 10 23:48:44.187459 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187461    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="813829ec-41a8-4ce9-846e-57a3d9e368ee" containerName="main"
Sep 10 23:48:44.187681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187467    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="813829ec-41a8-4ce9-846e-57a3d9e368ee" containerName="main"
Sep 10 23:48:44.187681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187477    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerName="istio-proxy"
Sep 10 23:48:44.187681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187482    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerName="istio-proxy"
Sep 10 23:48:44.187681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187538    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="813829ec-41a8-4ce9-846e-57a3d9e368ee" containerName="main"
Sep 10 23:48:44.187681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187547    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b7af831-e65e-4033-803a-c6201023a8b0" containerName="main"
Sep 10 23:48:44.187681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187553    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerName="istio-proxy"
Sep 10 23:48:44.187681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187559    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab90a25-6ec1-4b13-8784-d63425341fd2" containerName="main"
Sep 10 23:48:44.187681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.187564    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="26c6bab9-65cc-45eb-8ce2-3c067466c12f" containerName="istio-proxy"
Sep 10 23:48:44.192017 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.191998    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.195349 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.195318    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ea66ce\"/\"kube-root-ca.crt\""
Sep 10 23:48:44.195514 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.195326    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ea66ce\"/\"openshift-service-ca.crt\""
Sep 10 23:48:44.195514 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.195390    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ea66ce\"/\"test-model-ea66ce-kserve-self-signed-certs\""
Sep 10 23:48:44.195692 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.195664    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ea66ce\"/\"default-dockercfg-xsktg\""
Sep 10 23:48:44.198298 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.198273    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"]
Sep 10 23:48:44.292561 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.292524    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:44.302609 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.302580    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-tmp-dir\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.302695 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.302615    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wxjq\" (UniqueName: \"kubernetes.io/projected/6dedc6d2-920b-49e6-9535-f72d3b235233-kube-api-access-2wxjq\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.302695 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.302635    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-dshm\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.302787 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.302692    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-model-cache\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.302787 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.302750    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dedc6d2-920b-49e6-9535-f72d3b235233-tls-certs\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.302857 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.302810    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-home\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.404403 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.404368    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-tmp-dir\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.404579 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.404411    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wxjq\" (UniqueName: \"kubernetes.io/projected/6dedc6d2-920b-49e6-9535-f72d3b235233-kube-api-access-2wxjq\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.404579 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.404431    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-dshm\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.404579 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.404452    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-model-cache\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.404817 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.404579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dedc6d2-920b-49e6-9535-f72d3b235233-tls-certs\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.404817 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.404644    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-home\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.404910 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.404883    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-model-cache\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.404976 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.404914    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-tmp-dir\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.404976 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.404960    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-home\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.406846 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.406823    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-dshm\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.407027 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.407007    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dedc6d2-920b-49e6-9535-f72d3b235233-tls-certs\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.411963 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.411939    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wxjq\" (UniqueName: \"kubernetes.io/projected/6dedc6d2-920b-49e6-9535-f72d3b235233-kube-api-access-2wxjq\") pod \"test-model-ea66ce-kserve-6c464b77c-lf8n4\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") " pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.502817 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.502723    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:44.513444 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.513405    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:44.776748 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.776705    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"]
Sep 10 23:48:44.778496 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:48:44.778466    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dedc6d2_920b_49e6_9535_f72d3b235233.slice/crio-bcc56be52a5f09f3f91cf93ce909126752c6772470ba169d3a66d07cb19930d4 WatchSource:0}: Error finding container bcc56be52a5f09f3f91cf93ce909126752c6772470ba169d3a66d07cb19930d4: Status 404 returned error can't find the container with id bcc56be52a5f09f3f91cf93ce909126752c6772470ba169d3a66d07cb19930d4
Sep 10 23:48:44.995119 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.995085    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4" event={"ID":"6dedc6d2-920b-49e6-9535-f72d3b235233","Type":"ContainerStarted","Data":"e54e1c9ffce6bc6da7e53ef6b3dff15b16580bb416c991ac0a6e90b66becb2a9"}
Sep 10 23:48:44.995119 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:44.995130    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4" event={"ID":"6dedc6d2-920b-49e6-9535-f72d3b235233","Type":"ContainerStarted","Data":"bcc56be52a5f09f3f91cf93ce909126752c6772470ba169d3a66d07cb19930d4"}
Sep 10 23:48:45.013263 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:45.013204    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4" podStartSLOduration=1.013187675 podStartE2EDuration="1.013187675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:48:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:48:45.011815222 +0000 UTC m=+922.193973351" watchObservedRunningTime="2026-09-10 23:48:45.013187675 +0000 UTC m=+922.195345851"
Sep 10 23:48:54.503631 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:54.503594    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:54.504237 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:54.503654    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:54.516526 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:54.516495    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:55.066982 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:55.066942    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:48:56.398090 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.398052    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"]
Sep 10 23:48:56.401679 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.401652    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.405195 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.405171    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-a66ef6\"/\"kube-root-ca.crt\""
Sep 10 23:48:56.405338 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.405269    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-a66ef6\"/\"default-dockercfg-qlz9l\""
Sep 10 23:48:56.405338 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.405211    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-a66ef6\"/\"openshift-service-ca.crt\""
Sep 10 23:48:56.405338 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.405207    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-a66ef6\"/\"explicit-model-a66ef6-kserve-self-signed-certs\""
Sep 10 23:48:56.411154 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.411126    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"]
Sep 10 23:48:56.431485 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.431455    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:56.516707 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.516668    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-tmp-dir\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.516903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.516739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzpss\" (UniqueName: \"kubernetes.io/projected/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-kube-api-access-kzpss\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.516903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.516836    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-model-cache\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.516903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.516880    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-home\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.517013 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.516946    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-dshm\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.517013 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.516975    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-tls-certs\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.617908 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.617868    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-model-cache\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.618059 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.617944    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-home\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.618059 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.618005    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-dshm\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.618059 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.618053    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-tls-certs\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.618164 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.618127    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-tmp-dir\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.618220 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.618203    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-model-cache\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.618268 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.618253    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzpss\" (UniqueName: \"kubernetes.io/projected/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-kube-api-access-kzpss\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.618305 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.618280    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-home\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.618447 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.618423    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-tmp-dir\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.620269 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.620242    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-dshm\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.620573 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.620555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-tls-certs\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.625772 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.625751    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzpss\" (UniqueName: \"kubernetes.io/projected/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-kube-api-access-kzpss\") pod \"explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") " pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.713043 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.712955    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:48:56.985775 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:56.985743    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"]
Sep 10 23:48:56.986784 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:48:56.986754    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee804aff_eee8_4ac7_a0d1_2e78cb63119b.slice/crio-6d08dbe041c3d631da53a477fea691fb8d3fd78142a9cf9d1986060d97990429 WatchSource:0}: Error finding container 6d08dbe041c3d631da53a477fea691fb8d3fd78142a9cf9d1986060d97990429: Status 404 returned error can't find the container with id 6d08dbe041c3d631da53a477fea691fb8d3fd78142a9cf9d1986060d97990429
Sep 10 23:48:57.068233 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:57.068191    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn" event={"ID":"ee804aff-eee8-4ac7-a0d1-2e78cb63119b","Type":"ContainerStarted","Data":"075339c79030519b71b77841d9dfa5680bc91ebfd53f4e195acbc728fae79904"}
Sep 10 23:48:57.068420 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:57.068251    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn" event={"ID":"ee804aff-eee8-4ac7-a0d1-2e78cb63119b","Type":"ContainerStarted","Data":"6d08dbe041c3d631da53a477fea691fb8d3fd78142a9cf9d1986060d97990429"}
Sep 10 23:48:57.086041 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:57.085991    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn" podStartSLOduration=1.085974235 podStartE2EDuration="1.085974235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:48:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:48:57.083833084 +0000 UTC m=+934.265991226" watchObservedRunningTime="2026-09-10 23:48:57.085974235 +0000 UTC m=+934.268132363"
Sep 10 23:48:58.058520 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:58.058483    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:48:59.501767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:48:59.501729    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:49:05.364323 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:05.364283    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:06.713582 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:06.713546    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:49:06.714047 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:06.713596    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:49:06.725802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:06.725774    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:49:07.143842 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:07.143805    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:49:11.203966 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:11.203925    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:11.303480 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:11.303441    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"]
Sep 10 23:49:11.306166 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:11.306131    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:11.404168 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:11.404127    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:16.596640 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:16.596605    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:49:22.079806 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:22.079765    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:22.150112 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:22.150071    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:22.249584 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:22.249543    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:22.312562 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:22.312524    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:22.640344 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:22.640306    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:26.324400 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.324343    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn" podUID="ee804aff-eee8-4ac7-a0d1-2e78cb63119b" containerName="main" containerID="cri-o://075339c79030519b71b77841d9dfa5680bc91ebfd53f4e195acbc728fae79904" gracePeriod=45
Sep 10 23:49:26.566295 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.566271    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:49:26.708060 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.708024    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-tls-certs\") pod \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") "
Sep 10 23:49:26.708260 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.708132    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-home\") pod \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") "
Sep 10 23:49:26.708260 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.708177    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-model-cache\") pod \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") "
Sep 10 23:49:26.708260 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.708205    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-dshm\") pod \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") "
Sep 10 23:49:26.708448 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.708262    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzpss\" (UniqueName: \"kubernetes.io/projected/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-kube-api-access-kzpss\") pod \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") "
Sep 10 23:49:26.708448 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.708294    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-tmp-dir\") pod \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\" (UID: \"ee804aff-eee8-4ac7-a0d1-2e78cb63119b\") "
Sep 10 23:49:26.708448 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.708416    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-home" (OuterVolumeSpecName: "home") pod "ee804aff-eee8-4ac7-a0d1-2e78cb63119b" (UID: "ee804aff-eee8-4ac7-a0d1-2e78cb63119b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:49:26.708448 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.708430    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee804aff-eee8-4ac7-a0d1-2e78cb63119b" (UID: "ee804aff-eee8-4ac7-a0d1-2e78cb63119b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:49:26.708683 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.708663    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee804aff-eee8-4ac7-a0d1-2e78cb63119b" (UID: "ee804aff-eee8-4ac7-a0d1-2e78cb63119b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:49:26.708788 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.708759    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:49:26.708869 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.708795    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:49:26.708869 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.708811    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:49:26.710416 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.710390    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-dshm" (OuterVolumeSpecName: "dshm") pod "ee804aff-eee8-4ac7-a0d1-2e78cb63119b" (UID: "ee804aff-eee8-4ac7-a0d1-2e78cb63119b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:49:26.710542 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.710456    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-kube-api-access-kzpss" (OuterVolumeSpecName: "kube-api-access-kzpss") pod "ee804aff-eee8-4ac7-a0d1-2e78cb63119b" (UID: "ee804aff-eee8-4ac7-a0d1-2e78cb63119b"). InnerVolumeSpecName "kube-api-access-kzpss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:49:26.710542 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.710524    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee804aff-eee8-4ac7-a0d1-2e78cb63119b" (UID: "ee804aff-eee8-4ac7-a0d1-2e78cb63119b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:49:26.810020 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.809988    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:49:26.810020 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.810013    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzpss\" (UniqueName: \"kubernetes.io/projected/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-kube-api-access-kzpss\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:49:26.810020 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:26.810023    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee804aff-eee8-4ac7-a0d1-2e78cb63119b-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:49:27.244384 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:27.244346    2574 generic.go:356] "Generic (PLEG): container finished" podID="ee804aff-eee8-4ac7-a0d1-2e78cb63119b" containerID="075339c79030519b71b77841d9dfa5680bc91ebfd53f4e195acbc728fae79904" exitCode=0
Sep 10 23:49:27.244593 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:27.244392    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"
Sep 10 23:49:27.244593 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:27.244428    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn" event={"ID":"ee804aff-eee8-4ac7-a0d1-2e78cb63119b","Type":"ContainerDied","Data":"075339c79030519b71b77841d9dfa5680bc91ebfd53f4e195acbc728fae79904"}
Sep 10 23:49:27.244593 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:27.244482    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn" event={"ID":"ee804aff-eee8-4ac7-a0d1-2e78cb63119b","Type":"ContainerDied","Data":"6d08dbe041c3d631da53a477fea691fb8d3fd78142a9cf9d1986060d97990429"}
Sep 10 23:49:27.244593 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:27.244519    2574 scope.go:117] "RemoveContainer" containerID="075339c79030519b71b77841d9dfa5680bc91ebfd53f4e195acbc728fae79904"
Sep 10 23:49:27.257859 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:27.255327    2574 scope.go:117] "RemoveContainer" containerID="075339c79030519b71b77841d9dfa5680bc91ebfd53f4e195acbc728fae79904"
Sep 10 23:49:27.257859 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:49:27.255681    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"075339c79030519b71b77841d9dfa5680bc91ebfd53f4e195acbc728fae79904\": container with ID starting with 075339c79030519b71b77841d9dfa5680bc91ebfd53f4e195acbc728fae79904 not found: ID does not exist" containerID="075339c79030519b71b77841d9dfa5680bc91ebfd53f4e195acbc728fae79904"
Sep 10 23:49:27.257859 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:27.255743    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"075339c79030519b71b77841d9dfa5680bc91ebfd53f4e195acbc728fae79904"} err="failed to get container status \"075339c79030519b71b77841d9dfa5680bc91ebfd53f4e195acbc728fae79904\": rpc error: code = NotFound desc = could not find container \"075339c79030519b71b77841d9dfa5680bc91ebfd53f4e195acbc728fae79904\": container with ID starting with 075339c79030519b71b77841d9dfa5680bc91ebfd53f4e195acbc728fae79904 not found: ID does not exist"
Sep 10 23:49:27.272542 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:27.272515    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"]
Sep 10 23:49:27.277804 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:27.277777    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-a66ef6/explicit-model-a66ef6-kserve-7b9d578c8f-cgxfn"]
Sep 10 23:49:27.328736 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:27.328696    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:28.713234 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:28.713198    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:28.774670 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:28.774634    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:28.951916 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:28.951865    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:29.256923 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:29.256877    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee804aff-eee8-4ac7-a0d1-2e78cb63119b" path="/var/lib/kubelet/pods/ee804aff-eee8-4ac7-a0d1-2e78cb63119b/volumes"
Sep 10 23:49:29.363628 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:29.363596    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:29.738508 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:29.738465    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:29.978552 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:29.978506    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:31.343155 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:31.343113    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:31.441390 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:31.441349    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:31.541074 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:31.541038    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:33.002277 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:33.002243    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:33.109816 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:33.109780    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:33.202921 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:33.202868    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:34.905660 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:34.905615    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:49:35.196669 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.196580    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"]
Sep 10 23:49:35.196977 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.196963    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee804aff-eee8-4ac7-a0d1-2e78cb63119b" containerName="main"
Sep 10 23:49:35.197026 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.196979    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee804aff-eee8-4ac7-a0d1-2e78cb63119b" containerName="main"
Sep 10 23:49:35.197062 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.197044    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee804aff-eee8-4ac7-a0d1-2e78cb63119b" containerName="main"
Sep 10 23:49:35.201353 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.201330    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.204724 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.204681    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-a70fc0\"/\"noten-model-a70fc0-kserve-self-signed-certs\""
Sep 10 23:49:35.204924 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.204685    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-a70fc0\"/\"default-dockercfg-fwtr9\""
Sep 10 23:49:35.204924 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.204743    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-a70fc0\"/\"kube-root-ca.crt\""
Sep 10 23:49:35.204924 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.204685    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-a70fc0\"/\"openshift-service-ca.crt\""
Sep 10 23:49:35.208467 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.208436    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"]
Sep 10 23:49:35.214681 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.214650    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:35.294089 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.294052    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-home\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.294294 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.294103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-model-cache\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.294294 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.294160    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-dshm\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.294294 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.294199    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-tmp-dir\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.294294 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.294224    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9kfx\" (UniqueName: \"kubernetes.io/projected/e09cd548-b691-4418-aae7-23b222152d64-kube-api-access-k9kfx\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.294462 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.294292    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09cd548-b691-4418-aae7-23b222152d64-tls-certs\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.395542 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.395497    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-home\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.395782 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.395556    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-model-cache\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.395782 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.395593    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-dshm\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.395782 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.395628    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-tmp-dir\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.395782 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.395651    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9kfx\" (UniqueName: \"kubernetes.io/projected/e09cd548-b691-4418-aae7-23b222152d64-kube-api-access-k9kfx\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.395998 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.395794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09cd548-b691-4418-aae7-23b222152d64-tls-certs\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.395998 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.395965    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-home\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.395998 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.395987    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-model-cache\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.396110 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.396066    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-tmp-dir\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.397920 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.397903    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-dshm\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.398232 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.398216    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09cd548-b691-4418-aae7-23b222152d64-tls-certs\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.403606 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.403587    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9kfx\" (UniqueName: \"kubernetes.io/projected/e09cd548-b691-4418-aae7-23b222152d64-kube-api-access-k9kfx\") pod \"noten-model-a70fc0-kserve-55d5cfd54c-68sdt\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") " pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.511503 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.511412    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:35.789688 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:35.789599    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"]
Sep 10 23:49:35.792937 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:49:35.792898    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode09cd548_b691_4418_aae7_23b222152d64.slice/crio-7f8aac1a61a167365958e51bd0c12b2791376c80d542a25d44edf75e0279a1d9 WatchSource:0}: Error finding container 7f8aac1a61a167365958e51bd0c12b2791376c80d542a25d44edf75e0279a1d9: Status 404 returned error can't find the container with id 7f8aac1a61a167365958e51bd0c12b2791376c80d542a25d44edf75e0279a1d9
Sep 10 23:49:36.295626 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:36.295588    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt" event={"ID":"e09cd548-b691-4418-aae7-23b222152d64","Type":"ContainerStarted","Data":"15b6d63c9c408faa98434a1ae8d1f595613e9accd0d189e502235267c838069c"}
Sep 10 23:49:36.295626 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:36.295636    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt" event={"ID":"e09cd548-b691-4418-aae7-23b222152d64","Type":"ContainerStarted","Data":"7f8aac1a61a167365958e51bd0c12b2791376c80d542a25d44edf75e0279a1d9"}
Sep 10 23:49:36.313838 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:36.313781    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt" podStartSLOduration=1.313761851 podStartE2EDuration="1.313761851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:49:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:49:36.311563139 +0000 UTC m=+973.493721266" watchObservedRunningTime="2026-09-10 23:49:36.313761851 +0000 UTC m=+973.495919976"
Sep 10 23:49:43.640205 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:43.640169    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:44.386487 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:44.386449    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:45.512104 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:45.512069    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:45.512512 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:45.512146    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:45.524532 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:45.524505    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:46.364633 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:46.364598    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:49:47.138747 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:47.138696    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:47.575227 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:47.575132    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"]
Sep 10 23:49:47.590896 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:47.590860    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:47.705823 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:47.705792    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:47.909561 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:47.909522    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:49:47.919215 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:47.919177    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:48.026129 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:48.026090    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:50.236858 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:50.236814    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:50.340658 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:50.340609    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:50.437288 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:50.437251    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:50.538499 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:50.538410    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:51.119627 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:51.119596    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:51.215135 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:51.215098    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:51.320066 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:51.320028    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:52.702237 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:52.702194    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:53.042892 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:53.042792    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:58.719844 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:58.719808    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:58.819112 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:58.819079    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:59.363954 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:49:59.363916    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:00.198787 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:00.198749    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:50:03.383822 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.383773    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt" podUID="e09cd548-b691-4418-aae7-23b222152d64" containerName="main" containerID="cri-o://15b6d63c9c408faa98434a1ae8d1f595613e9accd0d189e502235267c838069c" gracePeriod=45
Sep 10 23:50:03.642189 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.642119    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:50:03.749270 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.749235    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-dshm\") pod \"e09cd548-b691-4418-aae7-23b222152d64\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") "
Sep 10 23:50:03.749488 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.749282    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-home\") pod \"e09cd548-b691-4418-aae7-23b222152d64\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") "
Sep 10 23:50:03.749488 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.749299    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09cd548-b691-4418-aae7-23b222152d64-tls-certs\") pod \"e09cd548-b691-4418-aae7-23b222152d64\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") "
Sep 10 23:50:03.749488 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.749362    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-model-cache\") pod \"e09cd548-b691-4418-aae7-23b222152d64\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") "
Sep 10 23:50:03.749488 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.749388    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-tmp-dir\") pod \"e09cd548-b691-4418-aae7-23b222152d64\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") "
Sep 10 23:50:03.749488 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.749419    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9kfx\" (UniqueName: \"kubernetes.io/projected/e09cd548-b691-4418-aae7-23b222152d64-kube-api-access-k9kfx\") pod \"e09cd548-b691-4418-aae7-23b222152d64\" (UID: \"e09cd548-b691-4418-aae7-23b222152d64\") "
Sep 10 23:50:03.749847 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.749589    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-home" (OuterVolumeSpecName: "home") pod "e09cd548-b691-4418-aae7-23b222152d64" (UID: "e09cd548-b691-4418-aae7-23b222152d64"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:03.749847 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.749628    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-model-cache" (OuterVolumeSpecName: "model-cache") pod "e09cd548-b691-4418-aae7-23b222152d64" (UID: "e09cd548-b691-4418-aae7-23b222152d64"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:03.749847 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.749768    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:03.749847 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.749779    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e09cd548-b691-4418-aae7-23b222152d64" (UID: "e09cd548-b691-4418-aae7-23b222152d64"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:03.751550 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.751518    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e09cd548-b691-4418-aae7-23b222152d64-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e09cd548-b691-4418-aae7-23b222152d64" (UID: "e09cd548-b691-4418-aae7-23b222152d64"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:50:03.751655 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.751567    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-dshm" (OuterVolumeSpecName: "dshm") pod "e09cd548-b691-4418-aae7-23b222152d64" (UID: "e09cd548-b691-4418-aae7-23b222152d64"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:03.751695 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.751649    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e09cd548-b691-4418-aae7-23b222152d64-kube-api-access-k9kfx" (OuterVolumeSpecName: "kube-api-access-k9kfx") pod "e09cd548-b691-4418-aae7-23b222152d64" (UID: "e09cd548-b691-4418-aae7-23b222152d64"). InnerVolumeSpecName "kube-api-access-k9kfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:03.850247 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.850206    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:03.850395 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.850259    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:03.850395 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.850269    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9kfx\" (UniqueName: \"kubernetes.io/projected/e09cd548-b691-4418-aae7-23b222152d64-kube-api-access-k9kfx\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:03.850395 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.850278    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e09cd548-b691-4418-aae7-23b222152d64-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:03.850395 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:03.850285    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09cd548-b691-4418-aae7-23b222152d64-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:04.350944 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:04.350908    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"]
Sep 10 23:50:04.371549 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:04.371512    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:04.454067 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:04.454033    2574 generic.go:356] "Generic (PLEG): container finished" podID="e09cd548-b691-4418-aae7-23b222152d64" containerID="15b6d63c9c408faa98434a1ae8d1f595613e9accd0d189e502235267c838069c" exitCode=0
Sep 10 23:50:04.454471 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:04.454085    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"
Sep 10 23:50:04.454471 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:04.454110    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt" event={"ID":"e09cd548-b691-4418-aae7-23b222152d64","Type":"ContainerDied","Data":"15b6d63c9c408faa98434a1ae8d1f595613e9accd0d189e502235267c838069c"}
Sep 10 23:50:04.454471 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:04.454152    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt" event={"ID":"e09cd548-b691-4418-aae7-23b222152d64","Type":"ContainerDied","Data":"7f8aac1a61a167365958e51bd0c12b2791376c80d542a25d44edf75e0279a1d9"}
Sep 10 23:50:04.454471 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:04.454169    2574 scope.go:117] "RemoveContainer" containerID="15b6d63c9c408faa98434a1ae8d1f595613e9accd0d189e502235267c838069c"
Sep 10 23:50:04.464197 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:04.464177    2574 scope.go:117] "RemoveContainer" containerID="15b6d63c9c408faa98434a1ae8d1f595613e9accd0d189e502235267c838069c"
Sep 10 23:50:04.464539 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:50:04.464519    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15b6d63c9c408faa98434a1ae8d1f595613e9accd0d189e502235267c838069c\": container with ID starting with 15b6d63c9c408faa98434a1ae8d1f595613e9accd0d189e502235267c838069c not found: ID does not exist" containerID="15b6d63c9c408faa98434a1ae8d1f595613e9accd0d189e502235267c838069c"
Sep 10 23:50:04.464600 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:04.464552    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15b6d63c9c408faa98434a1ae8d1f595613e9accd0d189e502235267c838069c"} err="failed to get container status \"15b6d63c9c408faa98434a1ae8d1f595613e9accd0d189e502235267c838069c\": rpc error: code = NotFound desc = could not find container \"15b6d63c9c408faa98434a1ae8d1f595613e9accd0d189e502235267c838069c\": container with ID starting with 15b6d63c9c408faa98434a1ae8d1f595613e9accd0d189e502235267c838069c not found: ID does not exist"
Sep 10 23:50:04.476619 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:04.476592    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"]
Sep 10 23:50:04.481667 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:04.481642    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-a70fc0/noten-model-a70fc0-kserve-55d5cfd54c-68sdt"]
Sep 10 23:50:05.256372 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:05.256337    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e09cd548-b691-4418-aae7-23b222152d64" path="/var/lib/kubelet/pods/e09cd548-b691-4418-aae7-23b222152d64/volumes"
Sep 10 23:50:05.388065 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:05.388030    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"]
Sep 10 23:50:05.398651 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:05.398621    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:05.498673 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:05.498643    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:05.610907 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:05.610877    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:05.711358 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:05.711317    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:05.923473 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:05.923387    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:06.133632 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:06.133590    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:09.139279 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:09.139245    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:09.242137 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:09.242100    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:09.598996 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:09.598908    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:50:10.290450 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:10.290414    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:10.391349 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:10.391311    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:10.530169 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:10.530134    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:10.857970 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:10.857940    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:10.956650 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:10.956615    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:15.763311 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:15.763272    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:16.446602 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:16.446562    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:16.546867 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:16.546827    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:16.632095 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:16.632058    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:16.690961 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:16.690924    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:16.978794 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:16.978758    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:19.371008 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.370945    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm" podUID="e4a2a420-d599-4bd8-9023-dd8cd1b65ae9" containerName="main" containerID="cri-o://bf856e83b127e49f20232dbcc4e73c5b10f95ed5aadfe5456fd48dbb567db985" gracePeriod=45
Sep 10 23:50:19.542724 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.542676    2574 generic.go:356] "Generic (PLEG): container finished" podID="e4a2a420-d599-4bd8-9023-dd8cd1b65ae9" containerID="bf856e83b127e49f20232dbcc4e73c5b10f95ed5aadfe5456fd48dbb567db985" exitCode=0
Sep 10 23:50:19.542864 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.542745    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm" event={"ID":"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9","Type":"ContainerDied","Data":"bf856e83b127e49f20232dbcc4e73c5b10f95ed5aadfe5456fd48dbb567db985"}
Sep 10 23:50:19.626243 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.626177    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:50:19.695177 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.695138    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:50:19.700905 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.700875    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-tmp-dir\") pod \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") "
Sep 10 23:50:19.701035 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.700917    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfjsf\" (UniqueName: \"kubernetes.io/projected/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-kube-api-access-nfjsf\") pod \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") "
Sep 10 23:50:19.701035 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.700935    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-home\") pod \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") "
Sep 10 23:50:19.701035 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.700957    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-tls-certs\") pod \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") "
Sep 10 23:50:19.701035 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.700997    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-model-cache\") pod \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") "
Sep 10 23:50:19.701035 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.701030    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-dshm\") pod \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\" (UID: \"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9\") "
Sep 10 23:50:19.701265 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.701217    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e4a2a420-d599-4bd8-9023-dd8cd1b65ae9" (UID: "e4a2a420-d599-4bd8-9023-dd8cd1b65ae9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:19.701265 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.701231    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-home" (OuterVolumeSpecName: "home") pod "e4a2a420-d599-4bd8-9023-dd8cd1b65ae9" (UID: "e4a2a420-d599-4bd8-9023-dd8cd1b65ae9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:19.701378 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.701356    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:19.701434 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.701380    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:19.701434 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.701382    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-model-cache" (OuterVolumeSpecName: "model-cache") pod "e4a2a420-d599-4bd8-9023-dd8cd1b65ae9" (UID: "e4a2a420-d599-4bd8-9023-dd8cd1b65ae9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:19.703317 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.703295    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-kube-api-access-nfjsf" (OuterVolumeSpecName: "kube-api-access-nfjsf") pod "e4a2a420-d599-4bd8-9023-dd8cd1b65ae9" (UID: "e4a2a420-d599-4bd8-9023-dd8cd1b65ae9"). InnerVolumeSpecName "kube-api-access-nfjsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:19.703421 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.703313    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-dshm" (OuterVolumeSpecName: "dshm") pod "e4a2a420-d599-4bd8-9023-dd8cd1b65ae9" (UID: "e4a2a420-d599-4bd8-9023-dd8cd1b65ae9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:19.703421 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.703341    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e4a2a420-d599-4bd8-9023-dd8cd1b65ae9" (UID: "e4a2a420-d599-4bd8-9023-dd8cd1b65ae9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:50:19.802764 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.802691    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfjsf\" (UniqueName: \"kubernetes.io/projected/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-kube-api-access-nfjsf\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:19.802764 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.802763    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:19.802994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.802777    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:19.802994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:19.802791    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:20.407293 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.407230    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4" podUID="6dedc6d2-920b-49e6-9535-f72d3b235233" containerName="main" containerID="cri-o://e54e1c9ffce6bc6da7e53ef6b3dff15b16580bb416c991ac0a6e90b66becb2a9" gracePeriod=45
Sep 10 23:50:20.552083 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.552052    2574 generic.go:356] "Generic (PLEG): container finished" podID="6dedc6d2-920b-49e6-9535-f72d3b235233" containerID="e54e1c9ffce6bc6da7e53ef6b3dff15b16580bb416c991ac0a6e90b66becb2a9" exitCode=0
Sep 10 23:50:20.552237 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.552128    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4" event={"ID":"6dedc6d2-920b-49e6-9535-f72d3b235233","Type":"ContainerDied","Data":"e54e1c9ffce6bc6da7e53ef6b3dff15b16580bb416c991ac0a6e90b66becb2a9"}
Sep 10 23:50:20.553946 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.553757    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm" event={"ID":"e4a2a420-d599-4bd8-9023-dd8cd1b65ae9","Type":"ContainerDied","Data":"eb86981218a2f871e13b46195fe0a0b8c974ca2c49bab0abb1e23fe225a51eef"}
Sep 10 23:50:20.553946 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.553786    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"
Sep 10 23:50:20.553946 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.553808    2574 scope.go:117] "RemoveContainer" containerID="bf856e83b127e49f20232dbcc4e73c5b10f95ed5aadfe5456fd48dbb567db985"
Sep 10 23:50:20.577828 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.577795    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"]
Sep 10 23:50:20.583496 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.583470    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-487960/test-model-487960-kserve-5d48ffdccc-prgmm"]
Sep 10 23:50:20.665226 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.665163    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:50:20.814030 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.813999    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-dshm\") pod \"6dedc6d2-920b-49e6-9535-f72d3b235233\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") "
Sep 10 23:50:20.814216 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.814063    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-tmp-dir\") pod \"6dedc6d2-920b-49e6-9535-f72d3b235233\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") "
Sep 10 23:50:20.814216 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.814084    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-home\") pod \"6dedc6d2-920b-49e6-9535-f72d3b235233\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") "
Sep 10 23:50:20.814216 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.814105    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-model-cache\") pod \"6dedc6d2-920b-49e6-9535-f72d3b235233\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") "
Sep 10 23:50:20.814216 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.814139    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dedc6d2-920b-49e6-9535-f72d3b235233-tls-certs\") pod \"6dedc6d2-920b-49e6-9535-f72d3b235233\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") "
Sep 10 23:50:20.814216 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.814162    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wxjq\" (UniqueName: \"kubernetes.io/projected/6dedc6d2-920b-49e6-9535-f72d3b235233-kube-api-access-2wxjq\") pod \"6dedc6d2-920b-49e6-9535-f72d3b235233\" (UID: \"6dedc6d2-920b-49e6-9535-f72d3b235233\") "
Sep 10 23:50:20.814472 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.814386    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-home" (OuterVolumeSpecName: "home") pod "6dedc6d2-920b-49e6-9535-f72d3b235233" (UID: "6dedc6d2-920b-49e6-9535-f72d3b235233"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:20.814472 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.814440    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6dedc6d2-920b-49e6-9535-f72d3b235233" (UID: "6dedc6d2-920b-49e6-9535-f72d3b235233"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:20.814566 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.814483    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-model-cache" (OuterVolumeSpecName: "model-cache") pod "6dedc6d2-920b-49e6-9535-f72d3b235233" (UID: "6dedc6d2-920b-49e6-9535-f72d3b235233"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:20.816305 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.816274    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-dshm" (OuterVolumeSpecName: "dshm") pod "6dedc6d2-920b-49e6-9535-f72d3b235233" (UID: "6dedc6d2-920b-49e6-9535-f72d3b235233"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:20.816417 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.816314    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dedc6d2-920b-49e6-9535-f72d3b235233-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6dedc6d2-920b-49e6-9535-f72d3b235233" (UID: "6dedc6d2-920b-49e6-9535-f72d3b235233"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:50:20.816417 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.816376    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dedc6d2-920b-49e6-9535-f72d3b235233-kube-api-access-2wxjq" (OuterVolumeSpecName: "kube-api-access-2wxjq") pod "6dedc6d2-920b-49e6-9535-f72d3b235233" (UID: "6dedc6d2-920b-49e6-9535-f72d3b235233"). InnerVolumeSpecName "kube-api-access-2wxjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:20.915376 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.915289    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:20.915376 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.915323    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dedc6d2-920b-49e6-9535-f72d3b235233-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:20.915376 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.915333    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wxjq\" (UniqueName: \"kubernetes.io/projected/6dedc6d2-920b-49e6-9535-f72d3b235233-kube-api-access-2wxjq\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:20.915376 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.915344    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:20.915376 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.915353    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:20.915376 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:20.915360    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dedc6d2-920b-49e6-9535-f72d3b235233-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:21.256946 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:21.256859    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4a2a420-d599-4bd8-9023-dd8cd1b65ae9" path="/var/lib/kubelet/pods/e4a2a420-d599-4bd8-9023-dd8cd1b65ae9/volumes"
Sep 10 23:50:21.561782 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:21.561657    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"
Sep 10 23:50:21.561782 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:21.561667    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4" event={"ID":"6dedc6d2-920b-49e6-9535-f72d3b235233","Type":"ContainerDied","Data":"bcc56be52a5f09f3f91cf93ce909126752c6772470ba169d3a66d07cb19930d4"}
Sep 10 23:50:21.561782 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:21.561756    2574 scope.go:117] "RemoveContainer" containerID="e54e1c9ffce6bc6da7e53ef6b3dff15b16580bb416c991ac0a6e90b66becb2a9"
Sep 10 23:50:21.577851 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:21.577822    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"]
Sep 10 23:50:21.583459 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:21.583429    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ea66ce/test-model-ea66ce-kserve-6c464b77c-lf8n4"]
Sep 10 23:50:22.891338 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:22.891297    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:22.953547 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:22.953510    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:23.138815 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.138769    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:23.257160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.257081    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dedc6d2-920b-49e6-9535-f72d3b235233" path="/var/lib/kubelet/pods/6dedc6d2-920b-49e6-9535-f72d3b235233/volumes"
Sep 10 23:50:23.459269 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.459230    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz"]
Sep 10 23:50:23.459803 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.459779    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4a2a420-d599-4bd8-9023-dd8cd1b65ae9" containerName="main"
Sep 10 23:50:23.459803 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.459801    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4a2a420-d599-4bd8-9023-dd8cd1b65ae9" containerName="main"
Sep 10 23:50:23.459962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.459818    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dedc6d2-920b-49e6-9535-f72d3b235233" containerName="main"
Sep 10 23:50:23.459962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.459824    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dedc6d2-920b-49e6-9535-f72d3b235233" containerName="main"
Sep 10 23:50:23.459962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.459843    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09cd548-b691-4418-aae7-23b222152d64" containerName="main"
Sep 10 23:50:23.459962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.459848    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09cd548-b691-4418-aae7-23b222152d64" containerName="main"
Sep 10 23:50:23.459962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.459914    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4a2a420-d599-4bd8-9023-dd8cd1b65ae9" containerName="main"
Sep 10 23:50:23.459962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.459926    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e09cd548-b691-4418-aae7-23b222152d64" containerName="main"
Sep 10 23:50:23.459962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.459932    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dedc6d2-920b-49e6-9535-f72d3b235233" containerName="main"
Sep 10 23:50:23.464309 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.464293    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz"
Sep 10 23:50:23.466798 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.466778    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-55278\""
Sep 10 23:50:23.466915 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.466779    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:50:23.473358 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.473332    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz"]
Sep 10 23:50:23.569466 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.569371    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:23.642014 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.641975    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001d6348-af74-49bc-8e70-3c3303be1a09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz\" (UID: \"001d6348-af74-49bc-8e70-3c3303be1a09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz"
Sep 10 23:50:23.743569 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.743535    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001d6348-af74-49bc-8e70-3c3303be1a09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz\" (UID: \"001d6348-af74-49bc-8e70-3c3303be1a09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz"
Sep 10 23:50:23.744156 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.744136    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001d6348-af74-49bc-8e70-3c3303be1a09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz\" (UID: \"001d6348-af74-49bc-8e70-3c3303be1a09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz"
Sep 10 23:50:23.777276 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:23.777241    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz"
Sep 10 23:50:24.050753 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:24.050727    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz"]
Sep 10 23:50:24.053326 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:50:24.053297    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001d6348_af74_49bc_8e70_3c3303be1a09.slice/crio-dc76532d5722fdf262d61f063ef97b58a6400d6c835f32436fefde458b415db5 WatchSource:0}: Error finding container dc76532d5722fdf262d61f063ef97b58a6400d6c835f32436fefde458b415db5: Status 404 returned error can't find the container with id dc76532d5722fdf262d61f063ef97b58a6400d6c835f32436fefde458b415db5
Sep 10 23:50:24.586314 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:24.586276    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz" event={"ID":"001d6348-af74-49bc-8e70-3c3303be1a09","Type":"ContainerStarted","Data":"d50a137c18583ca82a851cd250dd6b283eafbc945394a71c5523e40e73381db1"}
Sep 10 23:50:24.586464 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:24.586370    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz" event={"ID":"001d6348-af74-49bc-8e70-3c3303be1a09","Type":"ContainerStarted","Data":"dc76532d5722fdf262d61f063ef97b58a6400d6c835f32436fefde458b415db5"}
Sep 10 23:50:24.602078 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:24.602023    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz" podStartSLOduration=1.602008104 podStartE2EDuration="1.602008104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:24.59953792 +0000 UTC m=+1021.781696048" watchObservedRunningTime="2026-09-10 23:50:24.602008104 +0000 UTC m=+1021.784166233"
Sep 10 23:50:25.592756 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:25.592702    2574 generic.go:356] "Generic (PLEG): container finished" podID="001d6348-af74-49bc-8e70-3c3303be1a09" containerID="d50a137c18583ca82a851cd250dd6b283eafbc945394a71c5523e40e73381db1" exitCode=0
Sep 10 23:50:25.593148 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:25.592784    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz" event={"ID":"001d6348-af74-49bc-8e70-3c3303be1a09","Type":"ContainerDied","Data":"d50a137c18583ca82a851cd250dd6b283eafbc945394a71c5523e40e73381db1"}
Sep 10 23:50:26.726922 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:26.726896    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz"
Sep 10 23:50:26.873277 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:26.873241    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001d6348-af74-49bc-8e70-3c3303be1a09-maas-api-service-ca\") pod \"001d6348-af74-49bc-8e70-3c3303be1a09\" (UID: \"001d6348-af74-49bc-8e70-3c3303be1a09\") "
Sep 10 23:50:26.873619 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:26.873593    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/001d6348-af74-49bc-8e70-3c3303be1a09-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "001d6348-af74-49bc-8e70-3c3303be1a09" (UID: "001d6348-af74-49bc-8e70-3c3303be1a09"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:50:26.974413 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:26.974378    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001d6348-af74-49bc-8e70-3c3303be1a09-maas-api-service-ca\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:50:27.605227 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:27.605147    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz"
Sep 10 23:50:27.605383 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:27.605148    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz" event={"ID":"001d6348-af74-49bc-8e70-3c3303be1a09","Type":"ContainerDied","Data":"dc76532d5722fdf262d61f063ef97b58a6400d6c835f32436fefde458b415db5"}
Sep 10 23:50:27.605383 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:27.605286    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc76532d5722fdf262d61f063ef97b58a6400d6c835f32436fefde458b415db5"
Sep 10 23:50:30.059677 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:30.059634    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:31.225591 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:31.225548    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:33.585922 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:33.585886    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:34.060890 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:34.060842    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:34.126523 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:34.126481    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:34.189948 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:34.189911    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:34.290975 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:34.290941    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:34.307168 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:34.307133    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz"]
Sep 10 23:50:34.310779 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:34.310739    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ea66ce-w8xdz"]
Sep 10 23:50:34.349477 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:34.349392    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:34.685619 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:34.685583    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:34.765871 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:34.765834    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:35.092867 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:35.092786    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:35.256171 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:35.256129    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="001d6348-af74-49bc-8e70-3c3303be1a09" path="/var/lib/kubelet/pods/001d6348-af74-49bc-8e70-3c3303be1a09/volumes"
Sep 10 23:50:37.101908 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:37.101869    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:50:40.580163 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:40.580129    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:40.680761 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:40.680693    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:40.819215 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:40.819175    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:41.287861 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:41.287828    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:41.387981 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:41.387938    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:41.630909 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:41.630865    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:41.732119 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:41.732082    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:41.840116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:41.840085    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:44.348514 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:44.348472    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:44.448701 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:44.448670    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:45.652209 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:45.652171    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:45.753253 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:45.753214    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:46.201657 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:46.201617    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:46.301601 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:46.301562    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:47.231310 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:47.231253    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:49.801749 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:49.801254    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:50:51.722314 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:51.722278    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:52.244898 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:52.244864    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:52.345398 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:52.345365    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:52.416516 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:52.416473    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:52.472486 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:52.472435    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:52.789842 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:52.789804    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:58.645609 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:58.645556    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:58.706606 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:58.706566    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:58.916018 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:58.915920    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:59.257078 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:59.256989    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:59.354019 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:59.353989    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:59.458324 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:59.458286    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:59.699090 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:50:59.699056    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:51:05.088516 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:05.088479    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:05.189183 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:05.189153    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:05.290122 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:05.290083    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:05.410693 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:05.410660    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:07.509067 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:07.509027    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:09.260019 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:09.259971    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:09.574348 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:09.574254    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:09.872753 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:09.872699    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:10.490543 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:10.490503    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:11.583415 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:11.583381    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:11.685331 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:11.685291    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:12.437654 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:12.437616    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:12.726816 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:12.726699    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:12.818033 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:12.817998    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:13.138526 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:13.138489    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:13.855570 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:13.855533    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:13.912251 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:13.912200    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:14.427778 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:14.427746    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:14.533814 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:14.533777    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:15.809234 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:15.809192    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:15.956652 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:15.956614    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:16.927588 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:16.927558    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:17.027816 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:17.027781    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:17.417949 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:17.417912    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:17.506139 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:17.506100    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:17.589989 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:17.589953    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:20.205190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:20.205144    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:51:34.887179 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:34.887126    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:37.554373 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:37.554337    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:37.782698 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:37.782657    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:40.637809 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:40.637766    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:40.955029 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:40.954937    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:41.237345 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.237261    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"]
Sep 10 23:51:41.237898 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.237876    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001d6348-af74-49bc-8e70-3c3303be1a09" containerName="revoke-keys"
Sep 10 23:51:41.237951 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.237902    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="001d6348-af74-49bc-8e70-3c3303be1a09" containerName="revoke-keys"
Sep 10 23:51:41.238023 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.238011    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="001d6348-af74-49bc-8e70-3c3303be1a09" containerName="revoke-keys"
Sep 10 23:51:41.241320 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.241300    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.244002 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.243972    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 23:51:41.244119 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.244082    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-57be92-openshift-default-dockercfg-q4tnk\""
Sep 10 23:51:41.258079 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.258049    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"]
Sep 10 23:51:41.266786 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.266756    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:41.328747 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.328688    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:41.333860 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.333836    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-workload-certs\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.333958 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.333866    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lffx6\" (UniqueName: \"kubernetes.io/projected/842b27ae-6e31-4d60-8884-c6edfd10f4a4-kube-api-access-lffx6\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.333958 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.333897    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-envoy\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.333958 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.333918    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-credential-socket\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.333958 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.333943    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-token\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.334151 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.333979    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istiod-ca-cert\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.334151 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.333995    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-data\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.334151 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.334024    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-workload-socket\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.334151 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.334047    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-podinfo\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.435276 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.435238    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-podinfo\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.435488 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.435294    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-workload-certs\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.435488 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.435402    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lffx6\" (UniqueName: \"kubernetes.io/projected/842b27ae-6e31-4d60-8884-c6edfd10f4a4-kube-api-access-lffx6\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.435488 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.435451    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-envoy\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.435488 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.435471    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-credential-socket\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.435769 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.435511    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-token\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.435769 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.435570    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istiod-ca-cert\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.435769 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.435594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-data\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.435769 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.435646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-workload-socket\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.435769 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.435674    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-workload-certs\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.436054 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.435941    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-credential-socket\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.436054 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.435995    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-data\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.436054 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.436017    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-workload-socket\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.436377 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.436357    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istiod-ca-cert\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.437704 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.437680    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-envoy\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.437921 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.437904    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-podinfo\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.442841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.442817    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-token\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.443023 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.443002    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lffx6\" (UniqueName: \"kubernetes.io/projected/842b27ae-6e31-4d60-8884-c6edfd10f4a4-kube-api-access-lffx6\") pod \"e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") " pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.552934 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.552831    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:41.829846 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.829818    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"]
Sep 10 23:51:41.831815 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:51:41.831787    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842b27ae_6e31_4d60_8884_c6edfd10f4a4.slice/crio-5c88b05bd8350bf4504d28bc76d354ae8b58004516b90ec1bad26b4afef12eca WatchSource:0}: Error finding container 5c88b05bd8350bf4504d28bc76d354ae8b58004516b90ec1bad26b4afef12eca: Status 404 returned error can't find the container with id 5c88b05bd8350bf4504d28bc76d354ae8b58004516b90ec1bad26b4afef12eca
Sep 10 23:51:41.834245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.834207    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:51:41.834354 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.834296    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:51:41.834354 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:41.834343    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:51:42.015818 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:42.015780    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" event={"ID":"842b27ae-6e31-4d60-8884-c6edfd10f4a4","Type":"ContainerStarted","Data":"d8228567ba17d9e4030a4982f141946c0902278755d54d58d2d6db81bdba07f2"}
Sep 10 23:51:42.016027 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:42.015842    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" event={"ID":"842b27ae-6e31-4d60-8884-c6edfd10f4a4","Type":"ContainerStarted","Data":"5c88b05bd8350bf4504d28bc76d354ae8b58004516b90ec1bad26b4afef12eca"}
Sep 10 23:51:42.036245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:42.036187    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" podStartSLOduration=1.03617285 podStartE2EDuration="1.03617285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:51:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:51:42.033322124 +0000 UTC m=+1099.215480251" watchObservedRunningTime="2026-09-10 23:51:42.03617285 +0000 UTC m=+1099.218330978"
Sep 10 23:51:42.553311 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:42.553273    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:42.554883 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:42.554854    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 23:51:42.555034 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:42.554903    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 23:51:43.557597 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:43.557567    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:43.910159 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:43.910118    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:44.002952 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:44.002917    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:44.026464 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:44.026431    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:44.027515 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:44.027491    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:51:45.062538 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:45.062501    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:45.163569 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:45.163530    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:45.435309 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:45.435269    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:45.542221 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:45.542179    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:45.637493 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:45.637457    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:51.096495 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:51:51.096460    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:52:00.068896 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:00.068839    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 23:52:00.069398 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:00.068920    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:52:02.131052 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:02.131014    2574 generic.go:356] "Generic (PLEG): container finished" podID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerID="d8228567ba17d9e4030a4982f141946c0902278755d54d58d2d6db81bdba07f2" exitCode=0
Sep 10 23:52:02.131501 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:02.131087    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" event={"ID":"842b27ae-6e31-4d60-8884-c6edfd10f4a4","Type":"ContainerDied","Data":"d8228567ba17d9e4030a4982f141946c0902278755d54d58d2d6db81bdba07f2"}
Sep 10 23:52:02.131584 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:02.131545    2574 scope.go:117] "RemoveContainer" containerID="d8228567ba17d9e4030a4982f141946c0902278755d54d58d2d6db81bdba07f2"
Sep 10 23:52:02.132707 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:02.132670    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:52:02.132824 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:02.132767    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:52:02.132824 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:02.132801    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:52:03.138983 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:03.138934    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" event={"ID":"842b27ae-6e31-4d60-8884-c6edfd10f4a4","Type":"ContainerStarted","Data":"8264d25a0f004c77e7395561346329676694459e219916323ff3ea47fdc027f4"}
Sep 10 23:52:03.553567 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:03.553452    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:52:03.553784 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:03.553600    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 23:52:03.553784 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:03.553648    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 23:52:04.553493 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:04.553455    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 23:52:04.554107 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:04.554070    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 23:52:05.553443 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:05.553394    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 23:52:05.553802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:05.553764    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 23:52:06.553755 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:06.553681    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 23:52:06.554095 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:06.554059    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 23:52:07.554431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:07.554370    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 23:52:07.555111 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:07.555051    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 23:52:08.557075 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:08.557041    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:52:08.557493 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:08.557401    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:52:08.558026 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:08.558006    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:52:08.837519 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:08.837438    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:09.570258 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:09.570218    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7809-447d68"]
Sep 10 23:52:09.572601 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:09.572584    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-447d68"
Sep 10 23:52:09.574865 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:09.574843    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9kl27\""
Sep 10 23:52:09.579574 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:09.579545    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7809-447d68"]
Sep 10 23:52:09.608261 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:09.608233    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcttc\" (UniqueName: \"kubernetes.io/projected/10deeca4-6f5d-470b-a0d8-66ca18a21130-kube-api-access-zcttc\") pod \"test-curl-7809-447d68\" (UID: \"10deeca4-6f5d-470b-a0d8-66ca18a21130\") " pod="opendatahub/test-curl-7809-447d68"
Sep 10 23:52:09.709422 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:09.709393    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcttc\" (UniqueName: \"kubernetes.io/projected/10deeca4-6f5d-470b-a0d8-66ca18a21130-kube-api-access-zcttc\") pod \"test-curl-7809-447d68\" (UID: \"10deeca4-6f5d-470b-a0d8-66ca18a21130\") " pod="opendatahub/test-curl-7809-447d68"
Sep 10 23:52:09.717676 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:09.717647    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcttc\" (UniqueName: \"kubernetes.io/projected/10deeca4-6f5d-470b-a0d8-66ca18a21130-kube-api-access-zcttc\") pod \"test-curl-7809-447d68\" (UID: \"10deeca4-6f5d-470b-a0d8-66ca18a21130\") " pod="opendatahub/test-curl-7809-447d68"
Sep 10 23:52:09.883001 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:09.882973    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-447d68"
Sep 10 23:52:10.096746 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.096697    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"]
Sep 10 23:52:10.099258 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.099237    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.102701 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.102682    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-0b637b\"/\"openshift-service-ca.crt\""
Sep 10 23:52:10.102843 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.102733    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-0b637b\"/\"auth-test-model-0b637b-kserve-self-signed-certs\""
Sep 10 23:52:10.102907 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.102849    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-0b637b\"/\"default-dockercfg-fv4vx\""
Sep 10 23:52:10.102956 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.102926    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-0b637b\"/\"kube-root-ca.crt\""
Sep 10 23:52:10.110667 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.110643    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"]
Sep 10 23:52:10.112871 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.112845    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-model-cache\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.113008 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.112884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6a65e57-ece7-4652-ad00-f8a0ba739584-tls-certs\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.113008 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.112917    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27ws6\" (UniqueName: \"kubernetes.io/projected/b6a65e57-ece7-4652-ad00-f8a0ba739584-kube-api-access-27ws6\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.113008 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.112996    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-home\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.113169 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.113102    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-dshm\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.113226 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.113185    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-tmp-dir\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.129404 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.129372    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:10.155860 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.155831    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7809-447d68"]
Sep 10 23:52:10.157562 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:52:10.157533    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10deeca4_6f5d_470b_a0d8_66ca18a21130.slice/crio-e3534fc955d36dfd993376d75e9e65d08c88ba955a015d6397a1769a3fd32b60 WatchSource:0}: Error finding container e3534fc955d36dfd993376d75e9e65d08c88ba955a015d6397a1769a3fd32b60: Status 404 returned error can't find the container with id e3534fc955d36dfd993376d75e9e65d08c88ba955a015d6397a1769a3fd32b60
Sep 10 23:52:10.190072 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.190044    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7809-447d68" event={"ID":"10deeca4-6f5d-470b-a0d8-66ca18a21130","Type":"ContainerStarted","Data":"e3534fc955d36dfd993376d75e9e65d08c88ba955a015d6397a1769a3fd32b60"}
Sep 10 23:52:10.213808 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.213776    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-dshm\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.213959 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.213844    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-tmp-dir\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.214087 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.214066    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-model-cache\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.214154 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.214143    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6a65e57-ece7-4652-ad00-f8a0ba739584-tls-certs\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.214213 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.214183    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-tmp-dir\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.214268 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.214219    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27ws6\" (UniqueName: \"kubernetes.io/projected/b6a65e57-ece7-4652-ad00-f8a0ba739584-kube-api-access-27ws6\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.214268 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.214251    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-home\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.214458 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.214434    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-model-cache\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.214762 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.214705    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-home\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.216427 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.216402    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-dshm\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.216741 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.216723    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6a65e57-ece7-4652-ad00-f8a0ba739584-tls-certs\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.222853 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.222833    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27ws6\" (UniqueName: \"kubernetes.io/projected/b6a65e57-ece7-4652-ad00-f8a0ba739584-kube-api-access-27ws6\") pod \"auth-test-model-0b637b-kserve-689775d8c9-5sgdw\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.411323 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.411221    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:10.686998 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:10.686966    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"]
Sep 10 23:52:10.688452 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:52:10.688415    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6a65e57_ece7_4652_ad00_f8a0ba739584.slice/crio-73892200b95faecd8ad97169077a43c0155253c68f8c7f0b4b66363d1f5fcfde WatchSource:0}: Error finding container 73892200b95faecd8ad97169077a43c0155253c68f8c7f0b4b66363d1f5fcfde: Status 404 returned error can't find the container with id 73892200b95faecd8ad97169077a43c0155253c68f8c7f0b4b66363d1f5fcfde
Sep 10 23:52:11.200368 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.200327    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7809-447d68" event={"ID":"10deeca4-6f5d-470b-a0d8-66ca18a21130","Type":"ContainerStarted","Data":"7ec41514612aaa4ef011611a5b8aabe90c4befdad722e7b50f6f7b301840714b"}
Sep 10 23:52:11.201976 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.201947    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw" event={"ID":"b6a65e57-ece7-4652-ad00-f8a0ba739584","Type":"ContainerStarted","Data":"bb20086468489af3b00569d7ab4bae2f676cecf442119d52efc5132b4517d293"}
Sep 10 23:52:11.202094 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.201984    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw" event={"ID":"b6a65e57-ece7-4652-ad00-f8a0ba739584","Type":"ContainerStarted","Data":"73892200b95faecd8ad97169077a43c0155253c68f8c7f0b4b66363d1f5fcfde"}
Sep 10 23:52:11.218790 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.218736    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7809-447d68" podStartSLOduration=2.218703014 podStartE2EDuration="2.218703014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:52:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:52:11.216541965 +0000 UTC m=+1128.398700093" watchObservedRunningTime="2026-09-10 23:52:11.218703014 +0000 UTC m=+1128.400861144"
Sep 10 23:52:11.237702 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.237650    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw" podStartSLOduration=1.237634702 podStartE2EDuration="1.237634702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:52:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:52:11.234815406 +0000 UTC m=+1128.416973535" watchObservedRunningTime="2026-09-10 23:52:11.237634702 +0000 UTC m=+1128.419792885"
Sep 10 23:52:11.799971 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.799928    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7809-447d68"]
Sep 10 23:52:11.802695 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.802664    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7809-447d68"]
Sep 10 23:52:11.912881 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.912843    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7809-8caa2a"]
Sep 10 23:52:11.913229 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.913215    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10deeca4-6f5d-470b-a0d8-66ca18a21130" containerName="test-curl-7809-447d68"
Sep 10 23:52:11.913275 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.913230    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="10deeca4-6f5d-470b-a0d8-66ca18a21130" containerName="test-curl-7809-447d68"
Sep 10 23:52:11.913310 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.913299    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="10deeca4-6f5d-470b-a0d8-66ca18a21130" containerName="test-curl-7809-447d68"
Sep 10 23:52:11.915889 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.915872    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-8caa2a"
Sep 10 23:52:11.922552 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.922480    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7809-8caa2a"]
Sep 10 23:52:11.930508 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:11.930483    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm5zk\" (UniqueName: \"kubernetes.io/projected/0617dad3-bb21-45d8-b06d-e551822f8073-kube-api-access-bm5zk\") pod \"test-curl-7809-8caa2a\" (UID: \"0617dad3-bb21-45d8-b06d-e551822f8073\") " pod="opendatahub/test-curl-7809-8caa2a"
Sep 10 23:52:12.031787 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:12.031737    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm5zk\" (UniqueName: \"kubernetes.io/projected/0617dad3-bb21-45d8-b06d-e551822f8073-kube-api-access-bm5zk\") pod \"test-curl-7809-8caa2a\" (UID: \"0617dad3-bb21-45d8-b06d-e551822f8073\") " pod="opendatahub/test-curl-7809-8caa2a"
Sep 10 23:52:12.040153 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:12.040120    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm5zk\" (UniqueName: \"kubernetes.io/projected/0617dad3-bb21-45d8-b06d-e551822f8073-kube-api-access-bm5zk\") pod \"test-curl-7809-8caa2a\" (UID: \"0617dad3-bb21-45d8-b06d-e551822f8073\") " pod="opendatahub/test-curl-7809-8caa2a"
Sep 10 23:52:12.208076 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:12.207988    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7809-447d68" container="test-curl-7809-447d68"
Sep 10 23:52:12.226403 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:12.226377    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-8caa2a"
Sep 10 23:52:12.495676 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:12.495652    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7809-8caa2a"]
Sep 10 23:52:12.496844 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:52:12.496815    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0617dad3_bb21_45d8_b06d_e551822f8073.slice/crio-dc267fd2f5920235d637472fba6095ce313dcccd23039d6ec085f0ceb62b3b88 WatchSource:0}: Error finding container dc267fd2f5920235d637472fba6095ce313dcccd23039d6ec085f0ceb62b3b88: Status 404 returned error can't find the container with id dc267fd2f5920235d637472fba6095ce313dcccd23039d6ec085f0ceb62b3b88
Sep 10 23:52:13.215824 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:13.215780    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7809-8caa2a" event={"ID":"0617dad3-bb21-45d8-b06d-e551822f8073","Type":"ContainerStarted","Data":"d184e3d56f9bf997c7383a99fb81f55127bcfd7111a76a6604d2dcefac6b4d34"}
Sep 10 23:52:13.216316 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:13.215832    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7809-8caa2a" event={"ID":"0617dad3-bb21-45d8-b06d-e551822f8073","Type":"ContainerStarted","Data":"dc267fd2f5920235d637472fba6095ce313dcccd23039d6ec085f0ceb62b3b88"}
Sep 10 23:52:13.216316 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:13.215959    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7809-447d68" podUID="10deeca4-6f5d-470b-a0d8-66ca18a21130" containerName="test-curl-7809-447d68" containerID="cri-o://7ec41514612aaa4ef011611a5b8aabe90c4befdad722e7b50f6f7b301840714b" gracePeriod=2
Sep 10 23:52:13.227540 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:13.227478    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7809-8caa2a" podStartSLOduration=2.227459385 podStartE2EDuration="2.227459385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:52:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:52:13.227424483 +0000 UTC m=+1130.409582611" watchObservedRunningTime="2026-09-10 23:52:13.227459385 +0000 UTC m=+1130.409617514"
Sep 10 23:52:13.229266 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:13.229231    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7809-447d68\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="10deeca4-6f5d-470b-a0d8-66ca18a21130" pod="opendatahub/test-curl-7809-447d68"
Sep 10 23:52:13.254939 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:13.254900    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7809-447d68\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="10deeca4-6f5d-470b-a0d8-66ca18a21130" pod="opendatahub/test-curl-7809-447d68"
Sep 10 23:52:13.802782 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:13.802740    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:52:13.815072 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:13.815040    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7809-8caa2a"]
Sep 10 23:52:13.822779 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:13.822753    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7809-8caa2a"]
Sep 10 23:52:13.933732 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:13.933678    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7809-045761"]
Sep 10 23:52:13.934099 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:13.934084    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0617dad3-bb21-45d8-b06d-e551822f8073" containerName="test-curl-7809-8caa2a"
Sep 10 23:52:13.934152 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:13.934103    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0617dad3-bb21-45d8-b06d-e551822f8073" containerName="test-curl-7809-8caa2a"
Sep 10 23:52:13.934205 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:13.934195    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0617dad3-bb21-45d8-b06d-e551822f8073" containerName="test-curl-7809-8caa2a"
Sep 10 23:52:13.937470 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:13.937441    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-045761"
Sep 10 23:52:13.940249 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:13.940220    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7809-045761"]
Sep 10 23:52:14.052491 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:14.052452    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9269\" (UniqueName: \"kubernetes.io/projected/c22d831a-6e55-4e26-b3c5-5ca83ee8db65-kube-api-access-f9269\") pod \"test-curl-7809-045761\" (UID: \"c22d831a-6e55-4e26-b3c5-5ca83ee8db65\") " pod="opendatahub/test-curl-7809-045761"
Sep 10 23:52:14.153170 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:14.153127    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9269\" (UniqueName: \"kubernetes.io/projected/c22d831a-6e55-4e26-b3c5-5ca83ee8db65-kube-api-access-f9269\") pod \"test-curl-7809-045761\" (UID: \"c22d831a-6e55-4e26-b3c5-5ca83ee8db65\") " pod="opendatahub/test-curl-7809-045761"
Sep 10 23:52:14.161083 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:14.161051    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9269\" (UniqueName: \"kubernetes.io/projected/c22d831a-6e55-4e26-b3c5-5ca83ee8db65-kube-api-access-f9269\") pod \"test-curl-7809-045761\" (UID: \"c22d831a-6e55-4e26-b3c5-5ca83ee8db65\") " pod="opendatahub/test-curl-7809-045761"
Sep 10 23:52:14.221644 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:14.221551    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7809-8caa2a" container="test-curl-7809-8caa2a"
Sep 10 23:52:14.248165 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:14.248136    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-045761"
Sep 10 23:52:14.520803 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:14.520776    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7809-045761"]
Sep 10 23:52:14.522694 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:52:14.522667    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc22d831a_6e55_4e26_b3c5_5ca83ee8db65.slice/crio-f1a5404a4c673696be3259c2574e2afa821c0699c928464253ad14162015425a WatchSource:0}: Error finding container f1a5404a4c673696be3259c2574e2afa821c0699c928464253ad14162015425a: Status 404 returned error can't find the container with id f1a5404a4c673696be3259c2574e2afa821c0699c928464253ad14162015425a
Sep 10 23:52:15.230267 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.230146    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7809-045761" event={"ID":"c22d831a-6e55-4e26-b3c5-5ca83ee8db65","Type":"ContainerStarted","Data":"3aa4669a095d0387f7b4aa568e569b79347596863e31c4e110b468c05b97047f"}
Sep 10 23:52:15.230267 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.230199    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7809-045761" event={"ID":"c22d831a-6e55-4e26-b3c5-5ca83ee8db65","Type":"ContainerStarted","Data":"f1a5404a4c673696be3259c2574e2afa821c0699c928464253ad14162015425a"}
Sep 10 23:52:15.230634 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.230288    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7809-8caa2a" podUID="0617dad3-bb21-45d8-b06d-e551822f8073" containerName="test-curl-7809-8caa2a" containerID="cri-o://d184e3d56f9bf997c7383a99fb81f55127bcfd7111a76a6604d2dcefac6b4d34" gracePeriod=2
Sep 10 23:52:15.245628 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:15.245598    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7809-8caa2a\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="0617dad3-bb21-45d8-b06d-e551822f8073" pod="opendatahub/test-curl-7809-8caa2a"
Sep 10 23:52:15.246352 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.246310    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7809-045761" podStartSLOduration=2.24629583 podStartE2EDuration="2.24629583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:52:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:52:15.243585684 +0000 UTC m=+1132.425743812" watchObservedRunningTime="2026-09-10 23:52:15.24629583 +0000 UTC m=+1132.428453954"
Sep 10 23:52:15.412639 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.412609    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-447d68"
Sep 10 23:52:15.466270 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.466240    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcttc\" (UniqueName: \"kubernetes.io/projected/10deeca4-6f5d-470b-a0d8-66ca18a21130-kube-api-access-zcttc\") pod \"10deeca4-6f5d-470b-a0d8-66ca18a21130\" (UID: \"10deeca4-6f5d-470b-a0d8-66ca18a21130\") "
Sep 10 23:52:15.468171 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.468139    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10deeca4-6f5d-470b-a0d8-66ca18a21130-kube-api-access-zcttc" (OuterVolumeSpecName: "kube-api-access-zcttc") pod "10deeca4-6f5d-470b-a0d8-66ca18a21130" (UID: "10deeca4-6f5d-470b-a0d8-66ca18a21130"). InnerVolumeSpecName "kube-api-access-zcttc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:52:15.567334 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.567294    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcttc\" (UniqueName: \"kubernetes.io/projected/10deeca4-6f5d-470b-a0d8-66ca18a21130-kube-api-access-zcttc\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:52:15.810707 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.810593    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7809-045761"]
Sep 10 23:52:15.813849 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.813816    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7809-045761"]
Sep 10 23:52:15.924144 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.924107    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7809-a0c3be"]
Sep 10 23:52:15.924497 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.924483    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c22d831a-6e55-4e26-b3c5-5ca83ee8db65" containerName="test-curl-7809-045761"
Sep 10 23:52:15.924553 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.924498    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c22d831a-6e55-4e26-b3c5-5ca83ee8db65" containerName="test-curl-7809-045761"
Sep 10 23:52:15.924593 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.924564    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c22d831a-6e55-4e26-b3c5-5ca83ee8db65" containerName="test-curl-7809-045761"
Sep 10 23:52:15.927583 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.927568    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-a0c3be"
Sep 10 23:52:15.933300 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.933272    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7809-a0c3be"]
Sep 10 23:52:15.970442 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:15.970406    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xml72\" (UniqueName: \"kubernetes.io/projected/59dc57a1-c77e-42e1-baba-5c5dbe993fc2-kube-api-access-xml72\") pod \"test-curl-7809-a0c3be\" (UID: \"59dc57a1-c77e-42e1-baba-5c5dbe993fc2\") " pod="opendatahub/test-curl-7809-a0c3be"
Sep 10 23:52:16.071903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:16.071813    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xml72\" (UniqueName: \"kubernetes.io/projected/59dc57a1-c77e-42e1-baba-5c5dbe993fc2-kube-api-access-xml72\") pod \"test-curl-7809-a0c3be\" (UID: \"59dc57a1-c77e-42e1-baba-5c5dbe993fc2\") " pod="opendatahub/test-curl-7809-a0c3be"
Sep 10 23:52:16.082606 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:16.082574    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xml72\" (UniqueName: \"kubernetes.io/projected/59dc57a1-c77e-42e1-baba-5c5dbe993fc2-kube-api-access-xml72\") pod \"test-curl-7809-a0c3be\" (UID: \"59dc57a1-c77e-42e1-baba-5c5dbe993fc2\") " pod="opendatahub/test-curl-7809-a0c3be"
Sep 10 23:52:16.237514 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:16.237482    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-a0c3be"
Sep 10 23:52:16.237963 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:16.237829    2574 generic.go:356] "Generic (PLEG): container finished" podID="10deeca4-6f5d-470b-a0d8-66ca18a21130" containerID="7ec41514612aaa4ef011611a5b8aabe90c4befdad722e7b50f6f7b301840714b" exitCode=137
Sep 10 23:52:16.237963 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:16.237887    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-447d68"
Sep 10 23:52:16.237963 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:16.237929    2574 scope.go:117] "RemoveContainer" containerID="7ec41514612aaa4ef011611a5b8aabe90c4befdad722e7b50f6f7b301840714b"
Sep 10 23:52:16.238159 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:16.238144    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7809-045761" container="test-curl-7809-045761"
Sep 10 23:52:16.249303 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:16.249274    2574 scope.go:117] "RemoveContainer" containerID="7ec41514612aaa4ef011611a5b8aabe90c4befdad722e7b50f6f7b301840714b"
Sep 10 23:52:16.249408 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:16.249324    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7809-447d68\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="10deeca4-6f5d-470b-a0d8-66ca18a21130" pod="opendatahub/test-curl-7809-447d68"
Sep 10 23:52:16.249642 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:16.249625    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ec41514612aaa4ef011611a5b8aabe90c4befdad722e7b50f6f7b301840714b\": container with ID starting with 7ec41514612aaa4ef011611a5b8aabe90c4befdad722e7b50f6f7b301840714b not found: ID does not exist" containerID="7ec41514612aaa4ef011611a5b8aabe90c4befdad722e7b50f6f7b301840714b"
Sep 10 23:52:16.249705 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:16.249654    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ec41514612aaa4ef011611a5b8aabe90c4befdad722e7b50f6f7b301840714b"} err="failed to get container status \"7ec41514612aaa4ef011611a5b8aabe90c4befdad722e7b50f6f7b301840714b\": rpc error: code = NotFound desc = could not find container \"7ec41514612aaa4ef011611a5b8aabe90c4befdad722e7b50f6f7b301840714b\": container with ID starting with 7ec41514612aaa4ef011611a5b8aabe90c4befdad722e7b50f6f7b301840714b not found: ID does not exist"
Sep 10 23:52:16.511512 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:16.511480    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7809-a0c3be"]
Sep 10 23:52:16.512779 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:52:16.512753    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59dc57a1_c77e_42e1_baba_5c5dbe993fc2.slice/crio-fe954a84d92c6aaf4a54ec44b24179b10f6075ce868bc105b38211533c3cfeb4 WatchSource:0}: Error finding container fe954a84d92c6aaf4a54ec44b24179b10f6075ce868bc105b38211533c3cfeb4: Status 404 returned error can't find the container with id fe954a84d92c6aaf4a54ec44b24179b10f6075ce868bc105b38211533c3cfeb4
Sep 10 23:52:17.246130 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:17.246010    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7809-a0c3be" event={"ID":"59dc57a1-c77e-42e1-baba-5c5dbe993fc2","Type":"ContainerStarted","Data":"6c0d7829b0d0301a6c3a6f8a544b724ecbee5e0a5ca5ddcf6af7ea8db24b83cb"}
Sep 10 23:52:17.246130 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:17.246059    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7809-a0c3be" event={"ID":"59dc57a1-c77e-42e1-baba-5c5dbe993fc2","Type":"ContainerStarted","Data":"fe954a84d92c6aaf4a54ec44b24179b10f6075ce868bc105b38211533c3cfeb4"}
Sep 10 23:52:17.247197 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:17.247173    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7809-045761" podUID="c22d831a-6e55-4e26-b3c5-5ca83ee8db65" containerName="test-curl-7809-045761" containerID="cri-o://3aa4669a095d0387f7b4aa568e569b79347596863e31c4e110b468c05b97047f" gracePeriod=2
Sep 10 23:52:17.248392 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:17.248360    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7809-447d68\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="10deeca4-6f5d-470b-a0d8-66ca18a21130" pod="opendatahub/test-curl-7809-447d68"
Sep 10 23:52:17.258034 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:17.258004    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10deeca4-6f5d-470b-a0d8-66ca18a21130" path="/var/lib/kubelet/pods/10deeca4-6f5d-470b-a0d8-66ca18a21130/volumes"
Sep 10 23:52:17.265631 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:17.265572    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7809-a0c3be" podStartSLOduration=2.26555069 podStartE2EDuration="2.26555069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:52:17.263909342 +0000 UTC m=+1134.446067471" watchObservedRunningTime="2026-09-10 23:52:17.26555069 +0000 UTC m=+1134.447708822"
Sep 10 23:52:17.377876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:17.377848    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-8caa2a"
Sep 10 23:52:17.487356 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:17.487270    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm5zk\" (UniqueName: \"kubernetes.io/projected/0617dad3-bb21-45d8-b06d-e551822f8073-kube-api-access-bm5zk\") pod \"0617dad3-bb21-45d8-b06d-e551822f8073\" (UID: \"0617dad3-bb21-45d8-b06d-e551822f8073\") "
Sep 10 23:52:17.489187 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:17.489159    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0617dad3-bb21-45d8-b06d-e551822f8073-kube-api-access-bm5zk" (OuterVolumeSpecName: "kube-api-access-bm5zk") pod "0617dad3-bb21-45d8-b06d-e551822f8073" (UID: "0617dad3-bb21-45d8-b06d-e551822f8073"). InnerVolumeSpecName "kube-api-access-bm5zk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:52:17.588264 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:17.588217    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm5zk\" (UniqueName: \"kubernetes.io/projected/0617dad3-bb21-45d8-b06d-e551822f8073-kube-api-access-bm5zk\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:52:17.839113 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:17.839019    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7809-a0c3be"]
Sep 10 23:52:17.842973 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:17.842941    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7809-a0c3be"]
Sep 10 23:52:18.254541 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:18.254498    2574 generic.go:356] "Generic (PLEG): container finished" podID="0617dad3-bb21-45d8-b06d-e551822f8073" containerID="d184e3d56f9bf997c7383a99fb81f55127bcfd7111a76a6604d2dcefac6b4d34" exitCode=137
Sep 10 23:52:18.255020 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:18.254607    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-8caa2a"
Sep 10 23:52:18.255020 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:18.254655    2574 scope.go:117] "RemoveContainer" containerID="d184e3d56f9bf997c7383a99fb81f55127bcfd7111a76a6604d2dcefac6b4d34"
Sep 10 23:52:18.255138 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:18.255009    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7809-a0c3be" container="test-curl-7809-a0c3be"
Sep 10 23:52:18.264414 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:18.264397    2574 scope.go:117] "RemoveContainer" containerID="d184e3d56f9bf997c7383a99fb81f55127bcfd7111a76a6604d2dcefac6b4d34"
Sep 10 23:52:18.264747 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:18.264704    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d184e3d56f9bf997c7383a99fb81f55127bcfd7111a76a6604d2dcefac6b4d34\": container with ID starting with d184e3d56f9bf997c7383a99fb81f55127bcfd7111a76a6604d2dcefac6b4d34 not found: ID does not exist" containerID="d184e3d56f9bf997c7383a99fb81f55127bcfd7111a76a6604d2dcefac6b4d34"
Sep 10 23:52:18.264800 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:18.264756    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d184e3d56f9bf997c7383a99fb81f55127bcfd7111a76a6604d2dcefac6b4d34"} err="failed to get container status \"d184e3d56f9bf997c7383a99fb81f55127bcfd7111a76a6604d2dcefac6b4d34\": rpc error: code = NotFound desc = could not find container \"d184e3d56f9bf997c7383a99fb81f55127bcfd7111a76a6604d2dcefac6b4d34\": container with ID starting with d184e3d56f9bf997c7383a99fb81f55127bcfd7111a76a6604d2dcefac6b4d34 not found: ID does not exist"
Sep 10 23:52:18.264971 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:18.264952    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7809-8caa2a\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="0617dad3-bb21-45d8-b06d-e551822f8073" pod="opendatahub/test-curl-7809-8caa2a"
Sep 10 23:52:18.403362 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:18.403326    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:18.711829 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:18.711792    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:19.087364 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:19.087262    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:19.258268 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:19.258232    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0617dad3-bb21-45d8-b06d-e551822f8073" path="/var/lib/kubelet/pods/0617dad3-bb21-45d8-b06d-e551822f8073/volumes"
Sep 10 23:52:19.262011 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:19.261983    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7809-a0c3be" podUID="59dc57a1-c77e-42e1-baba-5c5dbe993fc2" containerName="test-curl-7809-a0c3be" containerID="cri-o://6c0d7829b0d0301a6c3a6f8a544b724ecbee5e0a5ca5ddcf6af7ea8db24b83cb" gracePeriod=2
Sep 10 23:52:19.406602 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:19.406575    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-045761"
Sep 10 23:52:19.507535 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:19.507501    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9269\" (UniqueName: \"kubernetes.io/projected/c22d831a-6e55-4e26-b3c5-5ca83ee8db65-kube-api-access-f9269\") pod \"c22d831a-6e55-4e26-b3c5-5ca83ee8db65\" (UID: \"c22d831a-6e55-4e26-b3c5-5ca83ee8db65\") "
Sep 10 23:52:19.509624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:19.509598    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22d831a-6e55-4e26-b3c5-5ca83ee8db65-kube-api-access-f9269" (OuterVolumeSpecName: "kube-api-access-f9269") pod "c22d831a-6e55-4e26-b3c5-5ca83ee8db65" (UID: "c22d831a-6e55-4e26-b3c5-5ca83ee8db65"). InnerVolumeSpecName "kube-api-access-f9269". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:52:19.608562 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:19.608524    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9269\" (UniqueName: \"kubernetes.io/projected/c22d831a-6e55-4e26-b3c5-5ca83ee8db65-kube-api-access-f9269\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:52:20.268889 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:20.268852    2574 generic.go:356] "Generic (PLEG): container finished" podID="c22d831a-6e55-4e26-b3c5-5ca83ee8db65" containerID="3aa4669a095d0387f7b4aa568e569b79347596863e31c4e110b468c05b97047f" exitCode=137
Sep 10 23:52:20.269294 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:20.268895    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-045761"
Sep 10 23:52:20.269294 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:20.268904    2574 scope.go:117] "RemoveContainer" containerID="3aa4669a095d0387f7b4aa568e569b79347596863e31c4e110b468c05b97047f"
Sep 10 23:52:20.278339 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:20.278321    2574 scope.go:117] "RemoveContainer" containerID="3aa4669a095d0387f7b4aa568e569b79347596863e31c4e110b468c05b97047f"
Sep 10 23:52:20.278644 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:20.278621    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aa4669a095d0387f7b4aa568e569b79347596863e31c4e110b468c05b97047f\": container with ID starting with 3aa4669a095d0387f7b4aa568e569b79347596863e31c4e110b468c05b97047f not found: ID does not exist" containerID="3aa4669a095d0387f7b4aa568e569b79347596863e31c4e110b468c05b97047f"
Sep 10 23:52:20.278740 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:20.278651    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa4669a095d0387f7b4aa568e569b79347596863e31c4e110b468c05b97047f"} err="failed to get container status \"3aa4669a095d0387f7b4aa568e569b79347596863e31c4e110b468c05b97047f\": rpc error: code = NotFound desc = could not find container \"3aa4669a095d0387f7b4aa568e569b79347596863e31c4e110b468c05b97047f\": container with ID starting with 3aa4669a095d0387f7b4aa568e569b79347596863e31c4e110b468c05b97047f not found: ID does not exist"
Sep 10 23:52:20.279643 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:20.279619    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7809-045761\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="c22d831a-6e55-4e26-b3c5-5ca83ee8db65" pod="opendatahub/test-curl-7809-045761"
Sep 10 23:52:20.411602 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:20.411564    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:20.411828 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:20.411623    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:20.424211 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:20.424179    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:20.459949 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:20.459915    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7809-045761\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="c22d831a-6e55-4e26-b3c5-5ca83ee8db65" pod="opendatahub/test-curl-7809-045761"
Sep 10 23:52:21.256365 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:21.256329    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c22d831a-6e55-4e26-b3c5-5ca83ee8db65" path="/var/lib/kubelet/pods/c22d831a-6e55-4e26-b3c5-5ca83ee8db65/volumes"
Sep 10 23:52:21.287395 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:21.287365    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:52:21.437439 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:21.437414    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-a0c3be"
Sep 10 23:52:21.526959 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:21.526862    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xml72\" (UniqueName: \"kubernetes.io/projected/59dc57a1-c77e-42e1-baba-5c5dbe993fc2-kube-api-access-xml72\") pod \"59dc57a1-c77e-42e1-baba-5c5dbe993fc2\" (UID: \"59dc57a1-c77e-42e1-baba-5c5dbe993fc2\") "
Sep 10 23:52:21.528966 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:21.528940    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59dc57a1-c77e-42e1-baba-5c5dbe993fc2-kube-api-access-xml72" (OuterVolumeSpecName: "kube-api-access-xml72") pod "59dc57a1-c77e-42e1-baba-5c5dbe993fc2" (UID: "59dc57a1-c77e-42e1-baba-5c5dbe993fc2"). InnerVolumeSpecName "kube-api-access-xml72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:52:21.628472 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:21.628442    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xml72\" (UniqueName: \"kubernetes.io/projected/59dc57a1-c77e-42e1-baba-5c5dbe993fc2-kube-api-access-xml72\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:52:22.009036 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:22.009005    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:22.104656 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:22.104619    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:22.281906 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:22.281799    2574 generic.go:356] "Generic (PLEG): container finished" podID="59dc57a1-c77e-42e1-baba-5c5dbe993fc2" containerID="6c0d7829b0d0301a6c3a6f8a544b724ecbee5e0a5ca5ddcf6af7ea8db24b83cb" exitCode=137
Sep 10 23:52:22.281906 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:22.281859    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7809-a0c3be"
Sep 10 23:52:22.282144 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:22.281907    2574 scope.go:117] "RemoveContainer" containerID="6c0d7829b0d0301a6c3a6f8a544b724ecbee5e0a5ca5ddcf6af7ea8db24b83cb"
Sep 10 23:52:22.291122 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:22.291104    2574 scope.go:117] "RemoveContainer" containerID="6c0d7829b0d0301a6c3a6f8a544b724ecbee5e0a5ca5ddcf6af7ea8db24b83cb"
Sep 10 23:52:22.291436 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:22.291412    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c0d7829b0d0301a6c3a6f8a544b724ecbee5e0a5ca5ddcf6af7ea8db24b83cb\": container with ID starting with 6c0d7829b0d0301a6c3a6f8a544b724ecbee5e0a5ca5ddcf6af7ea8db24b83cb not found: ID does not exist" containerID="6c0d7829b0d0301a6c3a6f8a544b724ecbee5e0a5ca5ddcf6af7ea8db24b83cb"
Sep 10 23:52:22.291494 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:22.291446    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c0d7829b0d0301a6c3a6f8a544b724ecbee5e0a5ca5ddcf6af7ea8db24b83cb"} err="failed to get container status \"6c0d7829b0d0301a6c3a6f8a544b724ecbee5e0a5ca5ddcf6af7ea8db24b83cb\": rpc error: code = NotFound desc = could not find container \"6c0d7829b0d0301a6c3a6f8a544b724ecbee5e0a5ca5ddcf6af7ea8db24b83cb\": container with ID starting with 6c0d7829b0d0301a6c3a6f8a544b724ecbee5e0a5ca5ddcf6af7ea8db24b83cb not found: ID does not exist"
Sep 10 23:52:22.291924 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:22.291902    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7809-a0c3be\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="59dc57a1-c77e-42e1-baba-5c5dbe993fc2" pod="opendatahub/test-curl-7809-a0c3be"
Sep 10 23:52:23.255198 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:52:23.255151    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7809-a0c3be\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="59dc57a1-c77e-42e1-baba-5c5dbe993fc2" pod="opendatahub/test-curl-7809-a0c3be"
Sep 10 23:52:23.256326 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:23.256306    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59dc57a1-c77e-42e1-baba-5c5dbe993fc2" path="/var/lib/kubelet/pods/59dc57a1-c77e-42e1-baba-5c5dbe993fc2/volumes"
Sep 10 23:52:23.338902 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:23.338866    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:23.403243 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:23.403206    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:23.679853 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:23.679819    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:23.788573 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:23.788525    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:23.892452 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:23.892406    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:30.457539 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:30.457498    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:30.515171 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:30.515133    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:32.097333 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:32.097292    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:52:41.592967 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.592932    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"]
Sep 10 23:52:41.593409 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.593305    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59dc57a1-c77e-42e1-baba-5c5dbe993fc2" containerName="test-curl-7809-a0c3be"
Sep 10 23:52:41.593409 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.593316    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="59dc57a1-c77e-42e1-baba-5c5dbe993fc2" containerName="test-curl-7809-a0c3be"
Sep 10 23:52:41.593409 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.593376    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="59dc57a1-c77e-42e1-baba-5c5dbe993fc2" containerName="test-curl-7809-a0c3be"
Sep 10 23:52:41.598131 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.598109    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.600575 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.600554    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-6d2e31\"/\"openshift-service-ca.crt\""
Sep 10 23:52:41.602088 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.602013    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-6d2e31\"/\"auth-test-model-6d2e31-kserve-self-signed-certs\""
Sep 10 23:52:41.602088 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.602020    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-6d2e31\"/\"kube-root-ca.crt\""
Sep 10 23:52:41.602358 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.602338    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-6d2e31\"/\"default-dockercfg-c9x4z\""
Sep 10 23:52:41.605373 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.605349    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"]
Sep 10 23:52:41.624552 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.624509    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:41.724817 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.724766    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-tmp-dir\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.725046 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.724837    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-model-cache\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.725046 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.724967    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-dshm\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.725046 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.725023    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-home\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.725221 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.725091    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wb99\" (UniqueName: \"kubernetes.io/projected/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-kube-api-access-6wb99\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.725221 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.725133    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-tls-certs\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.825890 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.825846    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-dshm\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.825890 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.825896    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-home\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.826146 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.825934    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wb99\" (UniqueName: \"kubernetes.io/projected/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-kube-api-access-6wb99\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.826146 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.825956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-tls-certs\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.826146 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.825976    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-tmp-dir\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.826146 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.826010    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-model-cache\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.826436 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.826408    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-home\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.826490 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.826438    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-model-cache\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.826490 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.826421    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-tmp-dir\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.828210 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.828186    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-dshm\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.828477 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.828460    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-tls-certs\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.833534 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.833512    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wb99\" (UniqueName: \"kubernetes.io/projected/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-kube-api-access-6wb99\") pod \"auth-test-model-6d2e31-kserve-5845cb54d7-sfglc\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:41.910067 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:41.910029    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:42.184812 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:42.184778    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"]
Sep 10 23:52:42.186838 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:52:42.186813    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00d6d234_fbc5_45b5_a369_0d9fb9f46c36.slice/crio-aaf916e66361822e374a35ebb82afd19ab263dfa6e51b8b6d93221a4bb70935d WatchSource:0}: Error finding container aaf916e66361822e374a35ebb82afd19ab263dfa6e51b8b6d93221a4bb70935d: Status 404 returned error can't find the container with id aaf916e66361822e374a35ebb82afd19ab263dfa6e51b8b6d93221a4bb70935d
Sep 10 23:52:42.396998 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:42.396963    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc" event={"ID":"00d6d234-fbc5-45b5-a369-0d9fb9f46c36","Type":"ContainerStarted","Data":"76d588c9870a37c4d88f3348f59ed02200f50e686e5f57b5a924e11b2e0ff7a2"}
Sep 10 23:52:42.397181 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:42.397007    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc" event={"ID":"00d6d234-fbc5-45b5-a369-0d9fb9f46c36","Type":"ContainerStarted","Data":"aaf916e66361822e374a35ebb82afd19ab263dfa6e51b8b6d93221a4bb70935d"}
Sep 10 23:52:42.414073 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:42.414024    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc" podStartSLOduration=1.414003885 podStartE2EDuration="1.414003885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:52:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:52:42.412617181 +0000 UTC m=+1159.594775334" watchObservedRunningTime="2026-09-10 23:52:42.414003885 +0000 UTC m=+1159.596162024"
Sep 10 23:52:46.958913 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:46.958830    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:48.004343 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:48.004301    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:52:51.911193 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:51.911137    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:51.911705 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:51.911212    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:51.923932 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:51.923906    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:52:52.463919 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:52:52.463886    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:53:04.596268 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.596234    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:53:04.880513 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.880478    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"]
Sep 10 23:53:04.884100 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.884073    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:04.886425 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.886397    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-42591aef\"/\"default-dockercfg-knlkw\""
Sep 10 23:53:04.886553 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.886425    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-42591aef\"/\"kube-root-ca.crt\""
Sep 10 23:53:04.887276 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.887245    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-42591aef\"/\"e2e-lifecycle-model-42591aef-kserve-self-signed-certs\""
Sep 10 23:53:04.887375 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.887302    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-42591aef\"/\"openshift-service-ca.crt\""
Sep 10 23:53:04.894241 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.894216    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"]
Sep 10 23:53:04.903722 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.903683    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:04.942508 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.942473    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-tmp-dir\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:04.942660 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.942518    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76767609-90ed-408d-b3cb-14487b51a249-tls-certs\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:04.942660 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.942567    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-dshm\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:04.942660 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.942620    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-home\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:04.942660 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.942647    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgxlk\" (UniqueName: \"kubernetes.io/projected/76767609-90ed-408d-b3cb-14487b51a249-kube-api-access-bgxlk\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:04.942841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:04.942671    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-model-cache\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.043840 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.043798    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-model-cache\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.044015 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.043888    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-tmp-dir\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.044015 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.043919    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76767609-90ed-408d-b3cb-14487b51a249-tls-certs\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.044015 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.043938    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-dshm\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.044015 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.043998    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-home\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.044214 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.044025    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgxlk\" (UniqueName: \"kubernetes.io/projected/76767609-90ed-408d-b3cb-14487b51a249-kube-api-access-bgxlk\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.044328 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.044302    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-model-cache\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.044405 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.044387    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-tmp-dir\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.044465 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.044443    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-home\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.046335 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.046300    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-dshm\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.046526 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.046510    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76767609-90ed-408d-b3cb-14487b51a249-tls-certs\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.052116 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.052095    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgxlk\" (UniqueName: \"kubernetes.io/projected/76767609-90ed-408d-b3cb-14487b51a249-kube-api-access-bgxlk\") pod \"e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") " pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.195222 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.195124    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:05.477033 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.477005    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"]
Sep 10 23:53:05.478793 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:53:05.478760    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76767609_90ed_408d_b3cb_14487b51a249.slice/crio-214160ab3c5091681353b9ae9c3f97686344f9825a02a73c0ca029f196b6f847 WatchSource:0}: Error finding container 214160ab3c5091681353b9ae9c3f97686344f9825a02a73c0ca029f196b6f847: Status 404 returned error can't find the container with id 214160ab3c5091681353b9ae9c3f97686344f9825a02a73c0ca029f196b6f847
Sep 10 23:53:05.525064 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:05.525034    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89" event={"ID":"76767609-90ed-408d-b3cb-14487b51a249","Type":"ContainerStarted","Data":"214160ab3c5091681353b9ae9c3f97686344f9825a02a73c0ca029f196b6f847"}
Sep 10 23:53:06.532603 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:06.532564    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89" event={"ID":"76767609-90ed-408d-b3cb-14487b51a249","Type":"ContainerStarted","Data":"ae9a1b0265ecc8772b4a19b8ffe7859cb9a4d852c82b5b0582376f725465f800"}
Sep 10 23:53:06.550812 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:06.550762    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89" podStartSLOduration=2.550745738 podStartE2EDuration="2.550745738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:53:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:53:06.548301134 +0000 UTC m=+1183.730459273" watchObservedRunningTime="2026-09-10 23:53:06.550745738 +0000 UTC m=+1183.732903866"
Sep 10 23:53:15.195835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:15.195778    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:15.196314 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:15.195856    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:15.208447 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:15.208417    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:15.592606 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:15.592521    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:53:18.281994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:18.281948    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:19.921207 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:19.921171    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:21.193106 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:21.193066    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:53:23.420967 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:23.420936    2574 scope.go:117] "RemoveContainer" containerID="68edd301d69907c32b21d483e1dc977141c9fc38a2f061b045f5997a02c0fbf7"
Sep 10 23:53:23.432870 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:23.432845    2574 scope.go:117] "RemoveContainer" containerID="ea931b6fa1e0ba61c454277c4ccd8a2aabfd2225c36f73e38e40b6f3a82d5204"
Sep 10 23:53:25.331941 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:25.331903    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:31.420966 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:31.420929    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:38.398388 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:38.398347    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:53:46.768752 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:46.768695    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:46.835500 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:46.835462    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:46.936424 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:46.936376    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:47.037328 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:47.037227    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:49.969587 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:49.969550    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:54.951867 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:54.951829    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"]
Sep 10 23:53:54.992948 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:54.992912    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:57.403677 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:53:57.403637    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:54:09.971050 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:09.971003    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89" podUID="76767609-90ed-408d-b3cb-14487b51a249" containerName="main" containerID="cri-o://ae9a1b0265ecc8772b4a19b8ffe7859cb9a4d852c82b5b0582376f725465f800" gracePeriod=45
Sep 10 23:54:10.231491 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.231428    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:54:10.373061 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.373018    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76767609-90ed-408d-b3cb-14487b51a249-tls-certs\") pod \"76767609-90ed-408d-b3cb-14487b51a249\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") "
Sep 10 23:54:10.373265 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.373092    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-model-cache\") pod \"76767609-90ed-408d-b3cb-14487b51a249\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") "
Sep 10 23:54:10.373265 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.373159    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgxlk\" (UniqueName: \"kubernetes.io/projected/76767609-90ed-408d-b3cb-14487b51a249-kube-api-access-bgxlk\") pod \"76767609-90ed-408d-b3cb-14487b51a249\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") "
Sep 10 23:54:10.373265 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.373213    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-tmp-dir\") pod \"76767609-90ed-408d-b3cb-14487b51a249\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") "
Sep 10 23:54:10.373265 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.373248    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-home\") pod \"76767609-90ed-408d-b3cb-14487b51a249\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") "
Sep 10 23:54:10.373484 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.373326    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-dshm\") pod \"76767609-90ed-408d-b3cb-14487b51a249\" (UID: \"76767609-90ed-408d-b3cb-14487b51a249\") "
Sep 10 23:54:10.373484 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.373349    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-model-cache" (OuterVolumeSpecName: "model-cache") pod "76767609-90ed-408d-b3cb-14487b51a249" (UID: "76767609-90ed-408d-b3cb-14487b51a249"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:54:10.373583 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.373504    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "76767609-90ed-408d-b3cb-14487b51a249" (UID: "76767609-90ed-408d-b3cb-14487b51a249"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:54:10.373627 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.373574    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-home" (OuterVolumeSpecName: "home") pod "76767609-90ed-408d-b3cb-14487b51a249" (UID: "76767609-90ed-408d-b3cb-14487b51a249"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:54:10.373832 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.373805    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:54:10.374029 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.374000    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:54:10.374029 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.374026    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:54:10.375421 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.375396    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76767609-90ed-408d-b3cb-14487b51a249-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "76767609-90ed-408d-b3cb-14487b51a249" (UID: "76767609-90ed-408d-b3cb-14487b51a249"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:54:10.375508 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.375466    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-dshm" (OuterVolumeSpecName: "dshm") pod "76767609-90ed-408d-b3cb-14487b51a249" (UID: "76767609-90ed-408d-b3cb-14487b51a249"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:54:10.375508 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.375465    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76767609-90ed-408d-b3cb-14487b51a249-kube-api-access-bgxlk" (OuterVolumeSpecName: "kube-api-access-bgxlk") pod "76767609-90ed-408d-b3cb-14487b51a249" (UID: "76767609-90ed-408d-b3cb-14487b51a249"). InnerVolumeSpecName "kube-api-access-bgxlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:54:10.474818 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.474781    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76767609-90ed-408d-b3cb-14487b51a249-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:54:10.474818 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.474807    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76767609-90ed-408d-b3cb-14487b51a249-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:54:10.474818 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.474818    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgxlk\" (UniqueName: \"kubernetes.io/projected/76767609-90ed-408d-b3cb-14487b51a249-kube-api-access-bgxlk\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:54:10.893557 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.893516    2574 generic.go:356] "Generic (PLEG): container finished" podID="76767609-90ed-408d-b3cb-14487b51a249" containerID="ae9a1b0265ecc8772b4a19b8ffe7859cb9a4d852c82b5b0582376f725465f800" exitCode=0
Sep 10 23:54:10.893771 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.893575    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"
Sep 10 23:54:10.893771 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.893602    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89" event={"ID":"76767609-90ed-408d-b3cb-14487b51a249","Type":"ContainerDied","Data":"ae9a1b0265ecc8772b4a19b8ffe7859cb9a4d852c82b5b0582376f725465f800"}
Sep 10 23:54:10.893771 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.893649    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89" event={"ID":"76767609-90ed-408d-b3cb-14487b51a249","Type":"ContainerDied","Data":"214160ab3c5091681353b9ae9c3f97686344f9825a02a73c0ca029f196b6f847"}
Sep 10 23:54:10.893771 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.893668    2574 scope.go:117] "RemoveContainer" containerID="ae9a1b0265ecc8772b4a19b8ffe7859cb9a4d852c82b5b0582376f725465f800"
Sep 10 23:54:10.904071 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.904044    2574 scope.go:117] "RemoveContainer" containerID="ae9a1b0265ecc8772b4a19b8ffe7859cb9a4d852c82b5b0582376f725465f800"
Sep 10 23:54:10.904385 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:54:10.904365    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae9a1b0265ecc8772b4a19b8ffe7859cb9a4d852c82b5b0582376f725465f800\": container with ID starting with ae9a1b0265ecc8772b4a19b8ffe7859cb9a4d852c82b5b0582376f725465f800 not found: ID does not exist" containerID="ae9a1b0265ecc8772b4a19b8ffe7859cb9a4d852c82b5b0582376f725465f800"
Sep 10 23:54:10.904435 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.904394    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9a1b0265ecc8772b4a19b8ffe7859cb9a4d852c82b5b0582376f725465f800"} err="failed to get container status \"ae9a1b0265ecc8772b4a19b8ffe7859cb9a4d852c82b5b0582376f725465f800\": rpc error: code = NotFound desc = could not find container \"ae9a1b0265ecc8772b4a19b8ffe7859cb9a4d852c82b5b0582376f725465f800\": container with ID starting with ae9a1b0265ecc8772b4a19b8ffe7859cb9a4d852c82b5b0582376f725465f800 not found: ID does not exist"
Sep 10 23:54:10.915953 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.915921    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"]
Sep 10 23:54:10.921521 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:10.921488    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-42591aef/e2e-lifecycle-model-42591aef-kserve-755ddc5b87-gph89"]
Sep 10 23:54:11.256633 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:11.256554    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76767609-90ed-408d-b3cb-14487b51a249" path="/var/lib/kubelet/pods/76767609-90ed-408d-b3cb-14487b51a249/volumes"
Sep 10 23:54:14.599160 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:14.599128    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:54:17.690582 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:17.690500    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:18.484856 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:18.484819    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:23.460608 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:23.460572    2574 scope.go:117] "RemoveContainer" containerID="452c9291fb13980b99ba3de9a52cf4c919368f4acdc9673f9b349bbbf615a762"
Sep 10 23:54:23.919073 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:23.919035    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:24.020187 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:24.020151    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:24.216383 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:24.216280    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:25.447965 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:25.447924    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:25.545808 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:25.545768    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:25.645176 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:25.645137    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:26.194696 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:26.194626    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:26.293212 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:26.293172    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:26.393370 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:26.393337    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:27.568932 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:27.568895    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:31.797417 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:31.797385    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:54:33.643113 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:33.643075    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:33.743325 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:33.743279    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:34.288734 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:34.288682    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:37.878799 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:37.878753    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:37.947516 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:37.947474    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:40.114490 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:40.114448    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:40.173898 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:40.173863    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:40.260098 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:40.260060    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:40.357527 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:40.357494    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:45.903695 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:45.903657    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:54:48.986881 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:48.986846    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7812-06e7ca"]
Sep 10 23:54:48.987326 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:48.987213    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76767609-90ed-408d-b3cb-14487b51a249" containerName="main"
Sep 10 23:54:48.987326 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:48.987225    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="76767609-90ed-408d-b3cb-14487b51a249" containerName="main"
Sep 10 23:54:48.987326 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:48.987285    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="76767609-90ed-408d-b3cb-14487b51a249" containerName="main"
Sep 10 23:54:48.991950 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:48.991921    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7812-06e7ca"
Sep 10 23:54:48.993199 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:48.993170    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7812-06e7ca"]
Sep 10 23:54:48.994266 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:48.994249    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9kl27\""
Sep 10 23:54:49.139975 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:49.139945    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c7s9\" (UniqueName: \"kubernetes.io/projected/c8109f58-c5fc-48c3-b202-15a13c48d49c-kube-api-access-8c7s9\") pod \"test-curl-7812-06e7ca\" (UID: \"c8109f58-c5fc-48c3-b202-15a13c48d49c\") " pod="opendatahub/test-curl-7812-06e7ca"
Sep 10 23:54:49.240961 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:49.240884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c7s9\" (UniqueName: \"kubernetes.io/projected/c8109f58-c5fc-48c3-b202-15a13c48d49c-kube-api-access-8c7s9\") pod \"test-curl-7812-06e7ca\" (UID: \"c8109f58-c5fc-48c3-b202-15a13c48d49c\") " pod="opendatahub/test-curl-7812-06e7ca"
Sep 10 23:54:49.248308 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:49.248278    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c7s9\" (UniqueName: \"kubernetes.io/projected/c8109f58-c5fc-48c3-b202-15a13c48d49c-kube-api-access-8c7s9\") pod \"test-curl-7812-06e7ca\" (UID: \"c8109f58-c5fc-48c3-b202-15a13c48d49c\") " pod="opendatahub/test-curl-7812-06e7ca"
Sep 10 23:54:49.301867 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:49.301843    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7812-06e7ca"
Sep 10 23:54:49.573630 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:49.573601    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7812-06e7ca"]
Sep 10 23:54:49.575210 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:54:49.575180    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8109f58_c5fc_48c3_b202_15a13c48d49c.slice/crio-523ed25514439fafbd9d394e88df533c86d7e050f347e475be0a0c82204c96a6 WatchSource:0}: Error finding container 523ed25514439fafbd9d394e88df533c86d7e050f347e475be0a0c82204c96a6: Status 404 returned error can't find the container with id 523ed25514439fafbd9d394e88df533c86d7e050f347e475be0a0c82204c96a6
Sep 10 23:54:50.119115 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:50.119081    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7812-06e7ca" event={"ID":"c8109f58-c5fc-48c3-b202-15a13c48d49c","Type":"ContainerStarted","Data":"26f006ce227d0c3e6f14211ec9513fbd13a511a0a4e305ae58f499809a9a57a9"}
Sep 10 23:54:50.119517 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:50.119124    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7812-06e7ca" event={"ID":"c8109f58-c5fc-48c3-b202-15a13c48d49c","Type":"ContainerStarted","Data":"523ed25514439fafbd9d394e88df533c86d7e050f347e475be0a0c82204c96a6"}
Sep 10 23:54:50.137786 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:50.137733    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7812-06e7ca" podStartSLOduration=2.137699568 podStartE2EDuration="2.137699568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:54:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:54:50.135047283 +0000 UTC m=+1287.317205411" watchObservedRunningTime="2026-09-10 23:54:50.137699568 +0000 UTC m=+1287.319857695"
Sep 10 23:54:50.706996 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:50.706940    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7812-06e7ca"]
Sep 10 23:54:50.713860 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:50.713825    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7812-06e7ca"]
Sep 10 23:54:50.794043 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:50.793953    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:51.016188 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:51.016147    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:51.125110 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:54:51.125074    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7812-06e7ca" container="test-curl-7812-06e7ca"
Sep 10 23:54:51.193872 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:51.193840    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:51.294205 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:51.294168    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:51.987144 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:51.987111    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"]
Sep 10 23:54:52.009132 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:52.009087    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:52.131915 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:52.131853    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7812-06e7ca" podUID="c8109f58-c5fc-48c3-b202-15a13c48d49c" containerName="test-curl-7812-06e7ca" containerID="cri-o://26f006ce227d0c3e6f14211ec9513fbd13a511a0a4e305ae58f499809a9a57a9" gracePeriod=2
Sep 10 23:54:52.876342 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:52.876312    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"]
Sep 10 23:54:52.897515 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:52.897481    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:54.267919 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:54.267891    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7812-06e7ca"
Sep 10 23:54:54.390703 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:54.390608    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c7s9\" (UniqueName: \"kubernetes.io/projected/c8109f58-c5fc-48c3-b202-15a13c48d49c-kube-api-access-8c7s9\") pod \"c8109f58-c5fc-48c3-b202-15a13c48d49c\" (UID: \"c8109f58-c5fc-48c3-b202-15a13c48d49c\") "
Sep 10 23:54:54.392929 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:54.392897    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8109f58-c5fc-48c3-b202-15a13c48d49c-kube-api-access-8c7s9" (OuterVolumeSpecName: "kube-api-access-8c7s9") pod "c8109f58-c5fc-48c3-b202-15a13c48d49c" (UID: "c8109f58-c5fc-48c3-b202-15a13c48d49c"). InnerVolumeSpecName "kube-api-access-8c7s9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:54:54.492484 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:54.492429    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c7s9\" (UniqueName: \"kubernetes.io/projected/c8109f58-c5fc-48c3-b202-15a13c48d49c-kube-api-access-8c7s9\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:54:55.155652 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:55.155614    2574 generic.go:356] "Generic (PLEG): container finished" podID="c8109f58-c5fc-48c3-b202-15a13c48d49c" containerID="26f006ce227d0c3e6f14211ec9513fbd13a511a0a4e305ae58f499809a9a57a9" exitCode=137
Sep 10 23:54:55.155840 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:55.155670    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7812-06e7ca"
Sep 10 23:54:55.155840 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:55.155735    2574 scope.go:117] "RemoveContainer" containerID="26f006ce227d0c3e6f14211ec9513fbd13a511a0a4e305ae58f499809a9a57a9"
Sep 10 23:54:55.165049 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:55.165027    2574 scope.go:117] "RemoveContainer" containerID="26f006ce227d0c3e6f14211ec9513fbd13a511a0a4e305ae58f499809a9a57a9"
Sep 10 23:54:55.165330 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:54:55.165309    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26f006ce227d0c3e6f14211ec9513fbd13a511a0a4e305ae58f499809a9a57a9\": container with ID starting with 26f006ce227d0c3e6f14211ec9513fbd13a511a0a4e305ae58f499809a9a57a9 not found: ID does not exist" containerID="26f006ce227d0c3e6f14211ec9513fbd13a511a0a4e305ae58f499809a9a57a9"
Sep 10 23:54:55.165427 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:55.165336    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f006ce227d0c3e6f14211ec9513fbd13a511a0a4e305ae58f499809a9a57a9"} err="failed to get container status \"26f006ce227d0c3e6f14211ec9513fbd13a511a0a4e305ae58f499809a9a57a9\": rpc error: code = NotFound desc = could not find container \"26f006ce227d0c3e6f14211ec9513fbd13a511a0a4e305ae58f499809a9a57a9\": container with ID starting with 26f006ce227d0c3e6f14211ec9513fbd13a511a0a4e305ae58f499809a9a57a9 not found: ID does not exist"
Sep 10 23:54:55.166629 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:54:55.166604    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7812-06e7ca\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="c8109f58-c5fc-48c3-b202-15a13c48d49c" pod="opendatahub/test-curl-7812-06e7ca"
Sep 10 23:54:55.256625 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:54:55.256591    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8109f58-c5fc-48c3-b202-15a13c48d49c" path="/var/lib/kubelet/pods/c8109f58-c5fc-48c3-b202-15a13c48d49c/volumes"
Sep 10 23:55:03.493732 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:03.493678    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:55:07.006500 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.006463    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw" podUID="b6a65e57-ece7-4652-ad00-f8a0ba739584" containerName="main" containerID="cri-o://bb20086468489af3b00569d7ab4bae2f676cecf442119d52efc5132b4517d293" gracePeriod=45
Sep 10 23:55:07.222536 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.222503    2574 generic.go:356] "Generic (PLEG): container finished" podID="b6a65e57-ece7-4652-ad00-f8a0ba739584" containerID="bb20086468489af3b00569d7ab4bae2f676cecf442119d52efc5132b4517d293" exitCode=0
Sep 10 23:55:07.222740 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.222581    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw" event={"ID":"b6a65e57-ece7-4652-ad00-f8a0ba739584","Type":"ContainerDied","Data":"bb20086468489af3b00569d7ab4bae2f676cecf442119d52efc5132b4517d293"}
Sep 10 23:55:07.257284 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.257222    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:55:07.303398 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.303362    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27ws6\" (UniqueName: \"kubernetes.io/projected/b6a65e57-ece7-4652-ad00-f8a0ba739584-kube-api-access-27ws6\") pod \"b6a65e57-ece7-4652-ad00-f8a0ba739584\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") "
Sep 10 23:55:07.303560 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.303405    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-home\") pod \"b6a65e57-ece7-4652-ad00-f8a0ba739584\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") "
Sep 10 23:55:07.303560 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.303433    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-tmp-dir\") pod \"b6a65e57-ece7-4652-ad00-f8a0ba739584\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") "
Sep 10 23:55:07.303560 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.303540    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-dshm\") pod \"b6a65e57-ece7-4652-ad00-f8a0ba739584\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") "
Sep 10 23:55:07.303669 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.303629    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6a65e57-ece7-4652-ad00-f8a0ba739584-tls-certs\") pod \"b6a65e57-ece7-4652-ad00-f8a0ba739584\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") "
Sep 10 23:55:07.303737 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.303675    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-home" (OuterVolumeSpecName: "home") pod "b6a65e57-ece7-4652-ad00-f8a0ba739584" (UID: "b6a65e57-ece7-4652-ad00-f8a0ba739584"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:07.303737 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.303692    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b6a65e57-ece7-4652-ad00-f8a0ba739584" (UID: "b6a65e57-ece7-4652-ad00-f8a0ba739584"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:07.303862 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.303699    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-model-cache\") pod \"b6a65e57-ece7-4652-ad00-f8a0ba739584\" (UID: \"b6a65e57-ece7-4652-ad00-f8a0ba739584\") "
Sep 10 23:55:07.303926 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.303890    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-model-cache" (OuterVolumeSpecName: "model-cache") pod "b6a65e57-ece7-4652-ad00-f8a0ba739584" (UID: "b6a65e57-ece7-4652-ad00-f8a0ba739584"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:07.304138 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.304116    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:55:07.304138 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.304141    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:55:07.304314 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.304151    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:55:07.305783 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.305758    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-dshm" (OuterVolumeSpecName: "dshm") pod "b6a65e57-ece7-4652-ad00-f8a0ba739584" (UID: "b6a65e57-ece7-4652-ad00-f8a0ba739584"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:07.305884 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.305855    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6a65e57-ece7-4652-ad00-f8a0ba739584-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b6a65e57-ece7-4652-ad00-f8a0ba739584" (UID: "b6a65e57-ece7-4652-ad00-f8a0ba739584"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:55:07.305884 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.305868    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a65e57-ece7-4652-ad00-f8a0ba739584-kube-api-access-27ws6" (OuterVolumeSpecName: "kube-api-access-27ws6") pod "b6a65e57-ece7-4652-ad00-f8a0ba739584" (UID: "b6a65e57-ece7-4652-ad00-f8a0ba739584"). InnerVolumeSpecName "kube-api-access-27ws6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:55:07.405075 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.405039    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27ws6\" (UniqueName: \"kubernetes.io/projected/b6a65e57-ece7-4652-ad00-f8a0ba739584-kube-api-access-27ws6\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:55:07.405075 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.405068    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6a65e57-ece7-4652-ad00-f8a0ba739584-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:55:07.405075 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.405078    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6a65e57-ece7-4652-ad00-f8a0ba739584-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:55:07.572648 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.572557    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:07.896661 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:07.896620    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc" podUID="00d6d234-fbc5-45b5-a369-0d9fb9f46c36" containerName="main" containerID="cri-o://76d588c9870a37c4d88f3348f59ed02200f50e686e5f57b5a924e11b2e0ff7a2" gracePeriod=45
Sep 10 23:55:08.139468 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.139441    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:55:08.213537 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.213456    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-tls-certs\") pod \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") "
Sep 10 23:55:08.213537 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.213508    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-home\") pod \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") "
Sep 10 23:55:08.213746 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.213547    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-dshm\") pod \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") "
Sep 10 23:55:08.213746 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.213564    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wb99\" (UniqueName: \"kubernetes.io/projected/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-kube-api-access-6wb99\") pod \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") "
Sep 10 23:55:08.213746 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.213585    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-tmp-dir\") pod \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") "
Sep 10 23:55:08.213746 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.213681    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-model-cache\") pod \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\" (UID: \"00d6d234-fbc5-45b5-a369-0d9fb9f46c36\") "
Sep 10 23:55:08.213964 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.213917    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-home" (OuterVolumeSpecName: "home") pod "00d6d234-fbc5-45b5-a369-0d9fb9f46c36" (UID: "00d6d234-fbc5-45b5-a369-0d9fb9f46c36"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:08.214019 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.213967    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-model-cache" (OuterVolumeSpecName: "model-cache") pod "00d6d234-fbc5-45b5-a369-0d9fb9f46c36" (UID: "00d6d234-fbc5-45b5-a369-0d9fb9f46c36"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:08.214069 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.214002    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "00d6d234-fbc5-45b5-a369-0d9fb9f46c36" (UID: "00d6d234-fbc5-45b5-a369-0d9fb9f46c36"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:08.214069 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.214035    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:55:08.214069 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.214054    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:55:08.215980 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.215961    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-kube-api-access-6wb99" (OuterVolumeSpecName: "kube-api-access-6wb99") pod "00d6d234-fbc5-45b5-a369-0d9fb9f46c36" (UID: "00d6d234-fbc5-45b5-a369-0d9fb9f46c36"). InnerVolumeSpecName "kube-api-access-6wb99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:55:08.216155 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.216140    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-dshm" (OuterVolumeSpecName: "dshm") pod "00d6d234-fbc5-45b5-a369-0d9fb9f46c36" (UID: "00d6d234-fbc5-45b5-a369-0d9fb9f46c36"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:08.216199 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.216162    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "00d6d234-fbc5-45b5-a369-0d9fb9f46c36" (UID: "00d6d234-fbc5-45b5-a369-0d9fb9f46c36"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:55:08.230788 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.230763    2574 generic.go:356] "Generic (PLEG): container finished" podID="00d6d234-fbc5-45b5-a369-0d9fb9f46c36" containerID="76d588c9870a37c4d88f3348f59ed02200f50e686e5f57b5a924e11b2e0ff7a2" exitCode=0
Sep 10 23:55:08.230912 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.230803    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"
Sep 10 23:55:08.230912 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.230844    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc" event={"ID":"00d6d234-fbc5-45b5-a369-0d9fb9f46c36","Type":"ContainerDied","Data":"76d588c9870a37c4d88f3348f59ed02200f50e686e5f57b5a924e11b2e0ff7a2"}
Sep 10 23:55:08.230912 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.230897    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc" event={"ID":"00d6d234-fbc5-45b5-a369-0d9fb9f46c36","Type":"ContainerDied","Data":"aaf916e66361822e374a35ebb82afd19ab263dfa6e51b8b6d93221a4bb70935d"}
Sep 10 23:55:08.231075 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.230922    2574 scope.go:117] "RemoveContainer" containerID="76d588c9870a37c4d88f3348f59ed02200f50e686e5f57b5a924e11b2e0ff7a2"
Sep 10 23:55:08.232312 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.232291    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"
Sep 10 23:55:08.232399 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.232292    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw" event={"ID":"b6a65e57-ece7-4652-ad00-f8a0ba739584","Type":"ContainerDied","Data":"73892200b95faecd8ad97169077a43c0155253c68f8c7f0b4b66363d1f5fcfde"}
Sep 10 23:55:08.241258 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.241231    2574 scope.go:117] "RemoveContainer" containerID="76d588c9870a37c4d88f3348f59ed02200f50e686e5f57b5a924e11b2e0ff7a2"
Sep 10 23:55:08.241595 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:55:08.241574    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76d588c9870a37c4d88f3348f59ed02200f50e686e5f57b5a924e11b2e0ff7a2\": container with ID starting with 76d588c9870a37c4d88f3348f59ed02200f50e686e5f57b5a924e11b2e0ff7a2 not found: ID does not exist" containerID="76d588c9870a37c4d88f3348f59ed02200f50e686e5f57b5a924e11b2e0ff7a2"
Sep 10 23:55:08.241692 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.241606    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d588c9870a37c4d88f3348f59ed02200f50e686e5f57b5a924e11b2e0ff7a2"} err="failed to get container status \"76d588c9870a37c4d88f3348f59ed02200f50e686e5f57b5a924e11b2e0ff7a2\": rpc error: code = NotFound desc = could not find container \"76d588c9870a37c4d88f3348f59ed02200f50e686e5f57b5a924e11b2e0ff7a2\": container with ID starting with 76d588c9870a37c4d88f3348f59ed02200f50e686e5f57b5a924e11b2e0ff7a2 not found: ID does not exist"
Sep 10 23:55:08.241692 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.241630    2574 scope.go:117] "RemoveContainer" containerID="bb20086468489af3b00569d7ab4bae2f676cecf442119d52efc5132b4517d293"
Sep 10 23:55:08.255891 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.255866    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"]
Sep 10 23:55:08.259876 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.259855    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/auth-test-model-0b637b-kserve-689775d8c9-5sgdw"]
Sep 10 23:55:08.268770 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.268748    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"]
Sep 10 23:55:08.270924 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.270898    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/auth-test-model-6d2e31-kserve-5845cb54d7-sfglc"]
Sep 10 23:55:08.314888 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.314857    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:55:08.314888 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.314884    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:55:08.315046 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.314896    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wb99\" (UniqueName: \"kubernetes.io/projected/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-kube-api-access-6wb99\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:55:08.315046 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:08.314911    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00d6d234-fbc5-45b5-a369-0d9fb9f46c36-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:55:09.256014 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:09.255973    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00d6d234-fbc5-45b5-a369-0d9fb9f46c36" path="/var/lib/kubelet/pods/00d6d234-fbc5-45b5-a369-0d9fb9f46c36/volumes"
Sep 10 23:55:09.256398 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:09.256383    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6a65e57-ece7-4652-ad00-f8a0ba739584" path="/var/lib/kubelet/pods/b6a65e57-ece7-4652-ad00-f8a0ba739584/volumes"
Sep 10 23:55:11.901910 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:11.901863    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:16.613459 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.613427    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"]
Sep 10 23:55:16.613855 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.613791    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d6d234-fbc5-45b5-a369-0d9fb9f46c36" containerName="main"
Sep 10 23:55:16.613855 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.613804    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d6d234-fbc5-45b5-a369-0d9fb9f46c36" containerName="main"
Sep 10 23:55:16.613855 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.613820    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a65e57-ece7-4652-ad00-f8a0ba739584" containerName="main"
Sep 10 23:55:16.613855 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.613825    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a65e57-ece7-4652-ad00-f8a0ba739584" containerName="main"
Sep 10 23:55:16.613855 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.613840    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8109f58-c5fc-48c3-b202-15a13c48d49c" containerName="test-curl-7812-06e7ca"
Sep 10 23:55:16.613855 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.613845    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8109f58-c5fc-48c3-b202-15a13c48d49c" containerName="test-curl-7812-06e7ca"
Sep 10 23:55:16.614091 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.613905    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8109f58-c5fc-48c3-b202-15a13c48d49c" containerName="test-curl-7812-06e7ca"
Sep 10 23:55:16.614091 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.613915    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a65e57-ece7-4652-ad00-f8a0ba739584" containerName="main"
Sep 10 23:55:16.614091 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.613922    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d6d234-fbc5-45b5-a369-0d9fb9f46c36" containerName="main"
Sep 10 23:55:16.618382 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.618365    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.621075 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.621047    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-0b637b\"/\"openshift-service-ca.crt\""
Sep 10 23:55:16.621223 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.621200    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-0b637b\"/\"sub-test-model-0b637b-kserve-self-signed-certs\""
Sep 10 23:55:16.622208 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.622187    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-0b637b\"/\"kube-root-ca.crt\""
Sep 10 23:55:16.622315 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.622276    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-0b637b\"/\"default-dockercfg-fv4vx\""
Sep 10 23:55:16.631188 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.631164    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"]
Sep 10 23:55:16.644725 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.644681    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:16.689084 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.689062    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-tls-certs\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.689202 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.689091    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-tmp-dir\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.689202 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.689118    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-model-cache\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.689293 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.689233    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z6s7\" (UniqueName: \"kubernetes.io/projected/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-kube-api-access-8z6s7\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.689293 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.689250    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-dshm\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.689399 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.689341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-home\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.790772 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.790742    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-home\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.790962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.790781    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-tls-certs\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.790962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.790809    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-tmp-dir\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.790962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.790851    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-model-cache\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.790962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.790940    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z6s7\" (UniqueName: \"kubernetes.io/projected/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-kube-api-access-8z6s7\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.791189 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.790970    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-dshm\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.791245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.791191    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-home\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.791327 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.791302    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-tmp-dir\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.791379 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.791324    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-model-cache\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.793118 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.793089    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-dshm\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.793444 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.793424    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-tls-certs\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.798913 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.798893    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z6s7\" (UniqueName: \"kubernetes.io/projected/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-kube-api-access-8z6s7\") pod \"sub-test-model-0b637b-kserve-79747d79d7-6rg6v\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:16.928331 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:16.928251    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:17.203405 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:17.203369    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"]
Sep 10 23:55:17.205080 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:55:17.205051    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7de0ba54_4bc5_4725_9eab_2b4d2cd77a8a.slice/crio-83c7fae9bedec7b83bbb8ec184c70551f859db2e72559482dd924b52bd7586b3 WatchSource:0}: Error finding container 83c7fae9bedec7b83bbb8ec184c70551f859db2e72559482dd924b52bd7586b3: Status 404 returned error can't find the container with id 83c7fae9bedec7b83bbb8ec184c70551f859db2e72559482dd924b52bd7586b3
Sep 10 23:55:17.284144 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:17.284106    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v" event={"ID":"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a","Type":"ContainerStarted","Data":"f4f826f51fd307b28c823faccf52111b4c55eeb0761dcccf092e0df49adf8d4a"}
Sep 10 23:55:17.284144 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:17.284146    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v" event={"ID":"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a","Type":"ContainerStarted","Data":"83c7fae9bedec7b83bbb8ec184c70551f859db2e72559482dd924b52bd7586b3"}
Sep 10 23:55:17.302526 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:17.302471    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v" podStartSLOduration=1.302455807 podStartE2EDuration="1.302455807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:55:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:55:17.299915553 +0000 UTC m=+1314.482073718" watchObservedRunningTime="2026-09-10 23:55:17.302455807 +0000 UTC m=+1314.484613956"
Sep 10 23:55:17.933012 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:17.932958    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:17.991768 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:17.991732    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:18.276934 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.276845    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:18.544283 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.544193    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"]
Sep 10 23:55:18.547818 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.547794    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.550231 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.550210    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-7c0647-openshift-default-dockercfg-7zspz\""
Sep 10 23:55:18.560063 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.560035    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"]
Sep 10 23:55:18.567382 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.567356    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:18.608627 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.608600    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk9fb\" (UniqueName: \"kubernetes.io/projected/10aca7e9-b492-4cc0-83b6-9b6226a116e0-kube-api-access-pk9fb\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.608762 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.608640    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istiod-ca-cert\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.608762 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.608661    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-workload-socket\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.608762 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.608739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-credential-socket\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.608879 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.608799    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-podinfo\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.608879 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.608825    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-data\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.608879 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.608847    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-workload-certs\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.608879 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.608867    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-envoy\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.609008 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.608945    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-token\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.710196 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.710153    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istiod-ca-cert\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.710196 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.710198    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-workload-socket\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.710431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.710219    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-credential-socket\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.710431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.710244    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-podinfo\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.710431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.710267    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-data\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.710431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.710286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-workload-certs\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.710431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.710306    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-envoy\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.710431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.710360    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-token\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.710431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.710417    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk9fb\" (UniqueName: \"kubernetes.io/projected/10aca7e9-b492-4cc0-83b6-9b6226a116e0-kube-api-access-pk9fb\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.710878 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.710691    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-credential-socket\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.710878 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.710743    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-data\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.710878 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.710779    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-workload-socket\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.710878 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.710831    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-workload-certs\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.711068 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.711014    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istiod-ca-cert\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.712811 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.712791    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-envoy\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.712899 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.712854    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-podinfo\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.718427 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.718399    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-token\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.718521 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.718449    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk9fb\" (UniqueName: \"kubernetes.io/projected/10aca7e9-b492-4cc0-83b6-9b6226a116e0-kube-api-access-pk9fb\") pod \"e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") " pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:18.861417 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:18.861381    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:19.138129 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:19.138096    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"]
Sep 10 23:55:19.139490 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:55:19.139463    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10aca7e9_b492_4cc0_83b6_9b6226a116e0.slice/crio-8c4775d6c424b6e4be0d0c856172212bcc155eee51da46aaf273062e82c5e91c WatchSource:0}: Error finding container 8c4775d6c424b6e4be0d0c856172212bcc155eee51da46aaf273062e82c5e91c: Status 404 returned error can't find the container with id 8c4775d6c424b6e4be0d0c856172212bcc155eee51da46aaf273062e82c5e91c
Sep 10 23:55:19.141874 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:19.141841    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:55:19.141952 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:19.141906    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:55:19.141952 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:19.141934    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:55:19.299012 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:19.298973    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5" event={"ID":"10aca7e9-b492-4cc0-83b6-9b6226a116e0","Type":"ContainerStarted","Data":"df8a17c71ab02fcf3d34321daaa381be308b6fc842771f6579527f3d3491df22"}
Sep 10 23:55:19.299179 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:19.299033    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5" event={"ID":"10aca7e9-b492-4cc0-83b6-9b6226a116e0","Type":"ContainerStarted","Data":"8c4775d6c424b6e4be0d0c856172212bcc155eee51da46aaf273062e82c5e91c"}
Sep 10 23:55:19.308157 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:19.308126    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:19.318057 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:19.318013    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5" podStartSLOduration=1.317996762 podStartE2EDuration="1.317996762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:55:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:55:19.316690616 +0000 UTC m=+1316.498848746" watchObservedRunningTime="2026-09-10 23:55:19.317996762 +0000 UTC m=+1316.500154891"
Sep 10 23:55:19.861649 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:19.861614    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:20.866862 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:20.866832    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:21.231875 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:21.231791    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:21.311051 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:21.311016    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:21.312023 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:21.312003    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:21.327747 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:21.327688    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:21.914148 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:21.914108    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:55:22.561331 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:22.561292    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:22.661692 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:22.661658    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:22.768091 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:22.768046    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:23.062702 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:23.062662    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:23.156999 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:23.156960    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:26.928887 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:26.928846    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:26.929340 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:26.928940    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:26.941468 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:26.941442    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:27.354977 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:27.354893    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:55:31.831282 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:31.831240    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:36.195017 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:36.194981    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:55:40.397068 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.397033    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"]
Sep 10 23:55:40.399574 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.399557    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.402085 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.402066    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-6d2e31\"/\"kube-root-ca.crt\""
Sep 10 23:55:40.403059 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.403042    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-6d2e31\"/\"default-dockercfg-c9x4z\""
Sep 10 23:55:40.403155 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.403096    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-6d2e31\"/\"openshift-service-ca.crt\""
Sep 10 23:55:40.403155 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.403115    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-6d2e31\"/\"sub-test-model-6d2e31-kserve-self-signed-certs\""
Sep 10 23:55:40.408515 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.408490    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"]
Sep 10 23:55:40.414899 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.414879    2574 generic.go:356] "Generic (PLEG): container finished" podID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerID="df8a17c71ab02fcf3d34321daaa381be308b6fc842771f6579527f3d3491df22" exitCode=0
Sep 10 23:55:40.414992 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.414938    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5" event={"ID":"10aca7e9-b492-4cc0-83b6-9b6226a116e0","Type":"ContainerDied","Data":"df8a17c71ab02fcf3d34321daaa381be308b6fc842771f6579527f3d3491df22"}
Sep 10 23:55:40.415336 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.415319    2574 scope.go:117] "RemoveContainer" containerID="df8a17c71ab02fcf3d34321daaa381be308b6fc842771f6579527f3d3491df22"
Sep 10 23:55:40.416567 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.416535    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:55:40.416641 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.416600    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:55:40.416641 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.416634    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:55:40.419024 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.418999    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:40.429977 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.429946    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-dshm\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.430068 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.430010    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkfk5\" (UniqueName: \"kubernetes.io/projected/e73e2dde-9f95-4d02-a288-846315717a2a-kube-api-access-bkfk5\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.430068 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.430047    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-model-cache\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.430153 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.430136    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-tmp-dir\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.430193 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.430162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-home\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.430193 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.430184    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e73e2dde-9f95-4d02-a288-846315717a2a-tls-certs\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.531524 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.531439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-dshm\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.531524 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.531481    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkfk5\" (UniqueName: \"kubernetes.io/projected/e73e2dde-9f95-4d02-a288-846315717a2a-kube-api-access-bkfk5\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.531524 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.531515    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-model-cache\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.531820 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.531590    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-tmp-dir\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.531820 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.531617    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-home\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.531820 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.531662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e73e2dde-9f95-4d02-a288-846315717a2a-tls-certs\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.532293 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.531973    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-model-cache\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.532293 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.532252    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-home\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.532453 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.532303    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-tmp-dir\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.533930 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.533911    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-dshm\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.534303 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.534285    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e73e2dde-9f95-4d02-a288-846315717a2a-tls-certs\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.539848 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.539826    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkfk5\" (UniqueName: \"kubernetes.io/projected/e73e2dde-9f95-4d02-a288-846315717a2a-kube-api-access-bkfk5\") pod \"sub-test-model-6d2e31-kserve-84f56f485-tmfrv\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.710207 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.710174    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:40.989777 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:40.989747    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"]
Sep 10 23:55:40.990830 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:55:40.990804    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode73e2dde_9f95_4d02_a288_846315717a2a.slice/crio-a29266c50570933e71c3fe0a6d86864e677fef770b2ac36907a9d76a30fcd0a9 WatchSource:0}: Error finding container a29266c50570933e71c3fe0a6d86864e677fef770b2ac36907a9d76a30fcd0a9: Status 404 returned error can't find the container with id a29266c50570933e71c3fe0a6d86864e677fef770b2ac36907a9d76a30fcd0a9
Sep 10 23:55:41.422768 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:41.422730    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5" event={"ID":"10aca7e9-b492-4cc0-83b6-9b6226a116e0","Type":"ContainerStarted","Data":"eab5e7880d6e60ebd0372a55bcf20df83e3a32888c2feb60d0467094cd02e016"}
Sep 10 23:55:41.424306 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:41.424281    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv" event={"ID":"e73e2dde-9f95-4d02-a288-846315717a2a","Type":"ContainerStarted","Data":"f5fa21e39100ce9df373464c8438087d8f4b8468c3fc5ef4a92d56b54c44076f"}
Sep 10 23:55:41.424410 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:41.424314    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv" event={"ID":"e73e2dde-9f95-4d02-a288-846315717a2a","Type":"ContainerStarted","Data":"a29266c50570933e71c3fe0a6d86864e677fef770b2ac36907a9d76a30fcd0a9"}
Sep 10 23:55:41.460242 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:41.460167    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv" podStartSLOduration=1.460128595 podStartE2EDuration="1.460128595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:55:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:55:41.459857619 +0000 UTC m=+1338.642015745" watchObservedRunningTime="2026-09-10 23:55:41.460128595 +0000 UTC m=+1338.642286721"
Sep 10 23:55:41.862373 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:41.862328    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:41.862598 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:41.862479    2574 patch_prober.go:28] interesting pod/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 23:55:41.862598 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:41.862528    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5" podUID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 23:55:42.862975 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:42.862933    2574 patch_prober.go:28] interesting pod/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 23:55:42.863584 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:42.863547    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5" podUID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 23:55:43.864599 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:43.864556    2574 patch_prober.go:28] interesting pod/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 23:55:43.865101 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:43.864634    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5" podUID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 23:55:44.861936 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:44.861887    2574 patch_prober.go:28] interesting pod/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 23:55:44.862147 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:44.861962    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5" podUID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 23:55:45.804550 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:45.804515    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:55:45.861879 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:45.861842    2574 patch_prober.go:28] interesting pod/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 23:55:45.862065 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:45.861909    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5" podUID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 23:55:46.181122 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.181080    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:46.624348 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.624307    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:46.866158 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.866125    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:46.866629 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.866429    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:46.867165 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.867149    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:55:46.897153 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.897061    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"]
Sep 10 23:55:46.900006 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.899978    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:46.902356 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.902322    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-bcad17-openshift-default-dockercfg-bd4xf\""
Sep 10 23:55:46.911321 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.911298    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"]
Sep 10 23:55:46.934300 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.934261    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:46.997509 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.997470    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-data\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:46.997704 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.997605    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-workload-socket\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:46.997704 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.997659    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-podinfo\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:46.997704 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.997690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvnwc\" (UniqueName: \"kubernetes.io/projected/7091ae18-18e9-42cd-969a-6ce850a849f0-kube-api-access-rvnwc\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:46.997866 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.997743    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7091ae18-18e9-42cd-969a-6ce850a849f0-istiod-ca-cert\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:46.997866 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.997801    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-credential-socket\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:46.997866 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.997850    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-workload-certs\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:46.997963 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.997892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-token\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:46.997963 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:46.997947    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-envoy\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.099576 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.099529    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-data\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.099805 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.099585    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-workload-socket\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.099805 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.099620    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-podinfo\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.099805 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.099649    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvnwc\" (UniqueName: \"kubernetes.io/projected/7091ae18-18e9-42cd-969a-6ce850a849f0-kube-api-access-rvnwc\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.099805 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.099679    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7091ae18-18e9-42cd-969a-6ce850a849f0-istiod-ca-cert\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.099805 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.099741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-credential-socket\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.099805 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.099773    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-workload-certs\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.100147 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.099810    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-token\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.100147 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.099864    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-envoy\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.100147 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.100084    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-data\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.100147 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.100115    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-workload-socket\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.100337 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.100223    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-workload-certs\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.100337 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.100280    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-credential-socket\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.100535 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.100514    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7091ae18-18e9-42cd-969a-6ce850a849f0-istiod-ca-cert\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.102178 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.102156    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-envoy\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.102315 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.102297    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-podinfo\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.107846 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.107817    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-token\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.107956 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.107888    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvnwc\" (UniqueName: \"kubernetes.io/projected/7091ae18-18e9-42cd-969a-6ce850a849f0-kube-api-access-rvnwc\") pod \"e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") " pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.179470 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.179372    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:47.212320 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.212286    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:47.493399 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.493369    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"]
Sep 10 23:55:47.495597 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:55:47.495565    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7091ae18_18e9_42cd_969a_6ce850a849f0.slice/crio-2cb19f3d97fa618bd2c1579abfb63e7008d09d24e63c2d9671d8ab7160347516 WatchSource:0}: Error finding container 2cb19f3d97fa618bd2c1579abfb63e7008d09d24e63c2d9671d8ab7160347516: Status 404 returned error can't find the container with id 2cb19f3d97fa618bd2c1579abfb63e7008d09d24e63c2d9671d8ab7160347516
Sep 10 23:55:47.498407 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.498375    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:55:47.498492 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.498441    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:55:47.498492 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:47.498477    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:55:48.475327 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:48.475287    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" event={"ID":"7091ae18-18e9-42cd-969a-6ce850a849f0","Type":"ContainerStarted","Data":"b40e8e909285000cb2a0a964e0cf5ab45b005f8463fb8398938dd8deed7d818d"}
Sep 10 23:55:48.475806 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:48.475351    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" event={"ID":"7091ae18-18e9-42cd-969a-6ce850a849f0","Type":"ContainerStarted","Data":"2cb19f3d97fa618bd2c1579abfb63e7008d09d24e63c2d9671d8ab7160347516"}
Sep 10 23:55:48.497468 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:48.497413    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" podStartSLOduration=2.497391691 podStartE2EDuration="2.497391691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:55:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:55:48.495459086 +0000 UTC m=+1345.677617215" watchObservedRunningTime="2026-09-10 23:55:48.497391691 +0000 UTC m=+1345.679549819"
Sep 10 23:55:49.213390 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:49.213355    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:49.218395 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:49.218363    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:49.485366 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:49.485270    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:49.486497 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:49.486476    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:55:50.364411 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:50.364376    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:50.462344 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:50.462309    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:50.710528 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:50.710452    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:50.710528 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:50.710505    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:50.723140 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:50.723120    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:51.511885 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:51.511855    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:55:51.543358 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:51.543325    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:51.647594 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:51.647557    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:51.972028 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:51.971972    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:52.072345 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:52.072308    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:52.159267 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:55:52.159230    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:03.002340 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:03.002301    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:56:08.146647 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:08.146604    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:12.397564 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:12.397523    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:12.618241 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:12.618209    2574 generic.go:356] "Generic (PLEG): container finished" podID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerID="b40e8e909285000cb2a0a964e0cf5ab45b005f8463fb8398938dd8deed7d818d" exitCode=0
Sep 10 23:56:12.618466 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:12.618260    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" event={"ID":"7091ae18-18e9-42cd-969a-6ce850a849f0","Type":"ContainerDied","Data":"b40e8e909285000cb2a0a964e0cf5ab45b005f8463fb8398938dd8deed7d818d"}
Sep 10 23:56:12.618678 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:12.618663    2574 scope.go:117] "RemoveContainer" containerID="b40e8e909285000cb2a0a964e0cf5ab45b005f8463fb8398938dd8deed7d818d"
Sep 10 23:56:12.620001 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:12.619973    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:56:12.620062 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:12.620041    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:56:12.620098 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:12.620074    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:56:13.632409 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:13.628606    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" event={"ID":"7091ae18-18e9-42cd-969a-6ce850a849f0","Type":"ContainerStarted","Data":"c94a915ee1e8357cd2fa08050db079e2a7255b89aa92a2084f5955d8ab006966"}
Sep 10 23:56:14.213256 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:14.213221    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:56:14.213592 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:14.213569    2574 patch_prober.go:28] interesting pod/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 23:56:14.213647 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:14.213630    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 23:56:15.213031 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:15.212990    2574 patch_prober.go:28] interesting pod/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 23:56:15.213449 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:15.213063    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 23:56:15.322100 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:15.322053    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:16.213168 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:16.213132    2574 patch_prober.go:28] interesting pod/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 23:56:16.213594 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:16.213204    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 23:56:17.213339 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:17.213303    2574 patch_prober.go:28] interesting pod/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 23:56:17.213784 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:17.213375    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 23:56:18.123882 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:18.123842    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6"]
Sep 10 23:56:18.126547 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:18.126528    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6"
Sep 10 23:56:18.129102 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:18.129074    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-55278\""
Sep 10 23:56:18.129254 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:18.129235    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:56:18.133960 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:18.133931    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6"]
Sep 10 23:56:18.206485 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:18.206443    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb454469-2378-4bb5-a61f-3331d663e1d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6\" (UID: \"cb454469-2378-4bb5-a61f-3331d663e1d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6"
Sep 10 23:56:18.213591 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:18.213565    2574 patch_prober.go:28] interesting pod/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 23:56:18.213917 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:18.213618    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 23:56:18.307986 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:18.307946    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb454469-2378-4bb5-a61f-3331d663e1d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6\" (UID: \"cb454469-2378-4bb5-a61f-3331d663e1d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6"
Sep 10 23:56:18.308597 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:18.308576    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb454469-2378-4bb5-a61f-3331d663e1d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6\" (UID: \"cb454469-2378-4bb5-a61f-3331d663e1d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6"
Sep 10 23:56:18.318267 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:18.318236    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:18.439020 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:18.438922    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6"
Sep 10 23:56:18.726361 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:18.726336    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6"]
Sep 10 23:56:18.728473 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:56:18.728437    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb454469_2378_4bb5_a61f_3331d663e1d3.slice/crio-3c653b588ff42ca181f99081a0c03b52d64253c463a2d69def3a26c00bc6f049 WatchSource:0}: Error finding container 3c653b588ff42ca181f99081a0c03b52d64253c463a2d69def3a26c00bc6f049: Status 404 returned error can't find the container with id 3c653b588ff42ca181f99081a0c03b52d64253c463a2d69def3a26c00bc6f049
Sep 10 23:56:19.213011 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:19.212972    2574 patch_prober.go:28] interesting pod/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 23:56:19.213197 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:19.213030    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 23:56:19.485576 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:19.485468    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:56:19.677255 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:19.677219    2574 generic.go:356] "Generic (PLEG): container finished" podID="cb454469-2378-4bb5-a61f-3331d663e1d3" containerID="b8856b516811ae3f321a5efbcae42517a0ed6f99c831ed7e2bc4c0a1d9e07a94" exitCode=0
Sep 10 23:56:19.677430 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:19.677261    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6" event={"ID":"cb454469-2378-4bb5-a61f-3331d663e1d3","Type":"ContainerDied","Data":"b8856b516811ae3f321a5efbcae42517a0ed6f99c831ed7e2bc4c0a1d9e07a94"}
Sep 10 23:56:19.677430 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:19.677325    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6" event={"ID":"cb454469-2378-4bb5-a61f-3331d663e1d3","Type":"ContainerStarted","Data":"3c653b588ff42ca181f99081a0c03b52d64253c463a2d69def3a26c00bc6f049"}
Sep 10 23:56:20.217368 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:20.217337    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:56:20.218272 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:20.218249    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:56:20.816438 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:20.816413    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6"
Sep 10 23:56:20.935143 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:20.935041    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb454469-2378-4bb5-a61f-3331d663e1d3-maas-api-service-ca\") pod \"cb454469-2378-4bb5-a61f-3331d663e1d3\" (UID: \"cb454469-2378-4bb5-a61f-3331d663e1d3\") "
Sep 10 23:56:20.935423 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:20.935396    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb454469-2378-4bb5-a61f-3331d663e1d3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cb454469-2378-4bb5-a61f-3331d663e1d3" (UID: "cb454469-2378-4bb5-a61f-3331d663e1d3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:56:21.035790 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:21.035751    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb454469-2378-4bb5-a61f-3331d663e1d3-maas-api-service-ca\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:21.690597 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:21.690559    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6" event={"ID":"cb454469-2378-4bb5-a61f-3331d663e1d3","Type":"ContainerDied","Data":"3c653b588ff42ca181f99081a0c03b52d64253c463a2d69def3a26c00bc6f049"}
Sep 10 23:56:21.690597 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:21.690596    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6"
Sep 10 23:56:21.690878 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:21.690611    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c653b588ff42ca181f99081a0c03b52d64253c463a2d69def3a26c00bc6f049"
Sep 10 23:56:22.495814 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:22.495776    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:56:33.632352 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:33.632320    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:33.693211 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:33.693173    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:33.753262 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:33.753222    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:33.806283 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:33.806238    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6"]
Sep 10 23:56:33.808720 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:33.808687    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7c0647-hvnt6"]
Sep 10 23:56:33.810052 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:33.810017    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:33.864074 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:33.864034    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:34.205660 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:34.205615    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:35.178567 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.178527    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7812-b86aef"]
Sep 10 23:56:35.179033 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.178974    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb454469-2378-4bb5-a61f-3331d663e1d3" containerName="revoke-keys"
Sep 10 23:56:35.179033 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.178986    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb454469-2378-4bb5-a61f-3331d663e1d3" containerName="revoke-keys"
Sep 10 23:56:35.179123 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.179046    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb454469-2378-4bb5-a61f-3331d663e1d3" containerName="revoke-keys"
Sep 10 23:56:35.182107 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.182091    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7812-b86aef"
Sep 10 23:56:35.184621 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.184593    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9kl27\""
Sep 10 23:56:35.186483 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.186456    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7812-b86aef"]
Sep 10 23:56:35.257587 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.257554    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb454469-2378-4bb5-a61f-3331d663e1d3" path="/var/lib/kubelet/pods/cb454469-2378-4bb5-a61f-3331d663e1d3/volumes"
Sep 10 23:56:35.284943 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.284911    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbkvg\" (UniqueName: \"kubernetes.io/projected/03aa0e47-0762-4cf9-823a-ab9737cce3c7-kube-api-access-qbkvg\") pod \"test-curl-7812-b86aef\" (UID: \"03aa0e47-0762-4cf9-823a-ab9737cce3c7\") " pod="opendatahub/test-curl-7812-b86aef"
Sep 10 23:56:35.385805 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.385765    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbkvg\" (UniqueName: \"kubernetes.io/projected/03aa0e47-0762-4cf9-823a-ab9737cce3c7-kube-api-access-qbkvg\") pod \"test-curl-7812-b86aef\" (UID: \"03aa0e47-0762-4cf9-823a-ab9737cce3c7\") " pod="opendatahub/test-curl-7812-b86aef"
Sep 10 23:56:35.400854 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.400821    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbkvg\" (UniqueName: \"kubernetes.io/projected/03aa0e47-0762-4cf9-823a-ab9737cce3c7-kube-api-access-qbkvg\") pod \"test-curl-7812-b86aef\" (UID: \"03aa0e47-0762-4cf9-823a-ab9737cce3c7\") " pod="opendatahub/test-curl-7812-b86aef"
Sep 10 23:56:35.492783 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.492675    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7812-b86aef"
Sep 10 23:56:35.507119 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.507078    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:35.795034 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:35.794998    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7812-b86aef"]
Sep 10 23:56:35.796510 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:56:35.796476    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03aa0e47_0762_4cf9_823a_ab9737cce3c7.slice/crio-bcc904b068ff4b32b6eccdbec6f053d44c5047d0ec7ea9ae96e53de32fe99f33 WatchSource:0}: Error finding container bcc904b068ff4b32b6eccdbec6f053d44c5047d0ec7ea9ae96e53de32fe99f33: Status 404 returned error can't find the container with id bcc904b068ff4b32b6eccdbec6f053d44c5047d0ec7ea9ae96e53de32fe99f33
Sep 10 23:56:36.779046 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:36.779008    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7812-b86aef" event={"ID":"03aa0e47-0762-4cf9-823a-ab9737cce3c7","Type":"ContainerStarted","Data":"b0775379fbbfeaa114c52ccaff312a5bb9b20c322a1175d426a75344bb4a2a0e"}
Sep 10 23:56:36.779472 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:36.779064    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7812-b86aef" event={"ID":"03aa0e47-0762-4cf9-823a-ab9737cce3c7","Type":"ContainerStarted","Data":"bcc904b068ff4b32b6eccdbec6f053d44c5047d0ec7ea9ae96e53de32fe99f33"}
Sep 10 23:56:36.794227 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:36.794175    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7812-b86aef" podStartSLOduration=1.7941581800000002 podStartE2EDuration="1.79415818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:36.79150329 +0000 UTC m=+1393.973661419" watchObservedRunningTime="2026-09-10 23:56:36.79415818 +0000 UTC m=+1393.976316308"
Sep 10 23:56:37.379192 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:37.379148    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7812-b86aef"]
Sep 10 23:56:37.382800 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:37.382763    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7812-b86aef"]
Sep 10 23:56:37.492475 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:37.492380    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7812-bdb333"]
Sep 10 23:56:37.492839 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:37.492824    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03aa0e47-0762-4cf9-823a-ab9737cce3c7" containerName="test-curl-7812-b86aef"
Sep 10 23:56:37.492888 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:37.492841    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="03aa0e47-0762-4cf9-823a-ab9737cce3c7" containerName="test-curl-7812-b86aef"
Sep 10 23:56:37.492929 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:37.492915    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="03aa0e47-0762-4cf9-823a-ab9737cce3c7" containerName="test-curl-7812-b86aef"
Sep 10 23:56:37.496305 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:37.496283    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7812-bdb333"
Sep 10 23:56:37.499750 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:37.499703    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7812-bdb333"]
Sep 10 23:56:37.610275 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:37.610235    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjf2p\" (UniqueName: \"kubernetes.io/projected/a696c051-5cb1-454f-85e4-cd19cf81f235-kube-api-access-mjf2p\") pod \"test-curl-7812-bdb333\" (UID: \"a696c051-5cb1-454f-85e4-cd19cf81f235\") " pod="opendatahub/test-curl-7812-bdb333"
Sep 10 23:56:37.711395 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:37.711353    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjf2p\" (UniqueName: \"kubernetes.io/projected/a696c051-5cb1-454f-85e4-cd19cf81f235-kube-api-access-mjf2p\") pod \"test-curl-7812-bdb333\" (UID: \"a696c051-5cb1-454f-85e4-cd19cf81f235\") " pod="opendatahub/test-curl-7812-bdb333"
Sep 10 23:56:37.720411 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:37.720389    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjf2p\" (UniqueName: \"kubernetes.io/projected/a696c051-5cb1-454f-85e4-cd19cf81f235-kube-api-access-mjf2p\") pod \"test-curl-7812-bdb333\" (UID: \"a696c051-5cb1-454f-85e4-cd19cf81f235\") " pod="opendatahub/test-curl-7812-bdb333"
Sep 10 23:56:37.784294 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:56:37.784206    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7812-b86aef" container="test-curl-7812-b86aef"
Sep 10 23:56:37.806939 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:37.806908    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7812-bdb333"
Sep 10 23:56:38.080347 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:38.077674    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7812-bdb333"]
Sep 10 23:56:38.082109 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:56:38.082076    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda696c051_5cb1_454f_85e4_cd19cf81f235.slice/crio-a688df6fe7dee4fa45d1ce7ba86ee71b754ba4d8fc0e396a1336feed23ff2fde WatchSource:0}: Error finding container a688df6fe7dee4fa45d1ce7ba86ee71b754ba4d8fc0e396a1336feed23ff2fde: Status 404 returned error can't find the container with id a688df6fe7dee4fa45d1ce7ba86ee71b754ba4d8fc0e396a1336feed23ff2fde
Sep 10 23:56:38.709294 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:38.709261    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:38.791415 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:38.791371    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7812-bdb333" event={"ID":"a696c051-5cb1-454f-85e4-cd19cf81f235","Type":"ContainerStarted","Data":"199d02f98f9c0b0cbb7ea9ac9b35a9b8fe4678c57a9ce4c59375ab13a4c7bc81"}
Sep 10 23:56:38.791879 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:38.791426    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7812-bdb333" event={"ID":"a696c051-5cb1-454f-85e4-cd19cf81f235","Type":"ContainerStarted","Data":"a688df6fe7dee4fa45d1ce7ba86ee71b754ba4d8fc0e396a1336feed23ff2fde"}
Sep 10 23:56:38.791879 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:38.791448    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7812-b86aef" podUID="03aa0e47-0762-4cf9-823a-ab9737cce3c7" containerName="test-curl-7812-b86aef" containerID="cri-o://b0775379fbbfeaa114c52ccaff312a5bb9b20c322a1175d426a75344bb4a2a0e" gracePeriod=2
Sep 10 23:56:38.793862 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:56:38.793836    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7812-b86aef\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="03aa0e47-0762-4cf9-823a-ab9737cce3c7" pod="opendatahub/test-curl-7812-b86aef"
Sep 10 23:56:38.809938 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:38.809891    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7812-bdb333" podStartSLOduration=1.809876617 podStartE2EDuration="1.809876617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:38.809170409 +0000 UTC m=+1395.991328539" watchObservedRunningTime="2026-09-10 23:56:38.809876617 +0000 UTC m=+1395.992034745"
Sep 10 23:56:38.811284 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:56:38.811258    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7812-b86aef\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="03aa0e47-0762-4cf9-823a-ab9737cce3c7" pod="opendatahub/test-curl-7812-b86aef"
Sep 10 23:56:39.391839 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:39.391781    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7812-bdb333"]
Sep 10 23:56:39.394556 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:39.394523    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7812-bdb333"]
Sep 10 23:56:39.797325 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:56:39.797294    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7812-bdb333" container="test-curl-7812-bdb333"
Sep 10 23:56:40.136142 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:40.136105    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:40.200735 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:40.200687    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:40.362464 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:40.362420    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"]
Sep 10 23:56:40.362737 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:40.362689    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5" podUID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerName="istio-proxy" containerID="cri-o://eab5e7880d6e60ebd0372a55bcf20df83e3a32888c2feb60d0467094cd02e016" gracePeriod=30
Sep 10 23:56:40.388305 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:40.388221    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:40.802666 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:40.802601    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7812-bdb333" podUID="a696c051-5cb1-454f-85e4-cd19cf81f235" containerName="test-curl-7812-bdb333" containerID="cri-o://199d02f98f9c0b0cbb7ea9ac9b35a9b8fe4678c57a9ce4c59375ab13a4c7bc81" gracePeriod=2
Sep 10 23:56:40.804936 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:56:40.804898    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7812-bdb333\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="a696c051-5cb1-454f-85e4-cd19cf81f235" pod="opendatahub/test-curl-7812-bdb333"
Sep 10 23:56:40.928220 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:40.928184    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:40.962973 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:40.962947    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7812-b86aef"
Sep 10 23:56:40.965346 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:56:40.965317    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7812-bdb333\" is forbidden: User \"system:node:ip-10-0-135-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-1.ec2.internal' and this object" podUID="a696c051-5cb1-454f-85e4-cd19cf81f235" pod="opendatahub/test-curl-7812-bdb333"
Sep 10 23:56:41.146575 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:41.146545    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbkvg\" (UniqueName: \"kubernetes.io/projected/03aa0e47-0762-4cf9-823a-ab9737cce3c7-kube-api-access-qbkvg\") pod \"03aa0e47-0762-4cf9-823a-ab9737cce3c7\" (UID: \"03aa0e47-0762-4cf9-823a-ab9737cce3c7\") "
Sep 10 23:56:41.148628 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:41.148603    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03aa0e47-0762-4cf9-823a-ab9737cce3c7-kube-api-access-qbkvg" (OuterVolumeSpecName: "kube-api-access-qbkvg") pod "03aa0e47-0762-4cf9-823a-ab9737cce3c7" (UID: "03aa0e47-0762-4cf9-823a-ab9737cce3c7"). InnerVolumeSpecName "kube-api-access-qbkvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:56:41.247915 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:41.247874    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbkvg\" (UniqueName: \"kubernetes.io/projected/03aa0e47-0762-4cf9-823a-ab9737cce3c7-kube-api-access-qbkvg\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:41.261787 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:41.259827    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03aa0e47-0762-4cf9-823a-ab9737cce3c7" path="/var/lib/kubelet/pods/03aa0e47-0762-4cf9-823a-ab9737cce3c7/volumes"
Sep 10 23:56:41.337305 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:41.337271    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"]
Sep 10 23:56:41.362598 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:41.362566    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:41.809495 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:41.809460    2574 generic.go:356] "Generic (PLEG): container finished" podID="03aa0e47-0762-4cf9-823a-ab9737cce3c7" containerID="b0775379fbbfeaa114c52ccaff312a5bb9b20c322a1175d426a75344bb4a2a0e" exitCode=137
Sep 10 23:56:41.810013 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:41.809518    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7812-b86aef"
Sep 10 23:56:41.810013 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:41.809573    2574 scope.go:117] "RemoveContainer" containerID="b0775379fbbfeaa114c52ccaff312a5bb9b20c322a1175d426a75344bb4a2a0e"
Sep 10 23:56:41.818936 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:41.818914    2574 scope.go:117] "RemoveContainer" containerID="b0775379fbbfeaa114c52ccaff312a5bb9b20c322a1175d426a75344bb4a2a0e"
Sep 10 23:56:41.819213 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:56:41.819194    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0775379fbbfeaa114c52ccaff312a5bb9b20c322a1175d426a75344bb4a2a0e\": container with ID starting with b0775379fbbfeaa114c52ccaff312a5bb9b20c322a1175d426a75344bb4a2a0e not found: ID does not exist" containerID="b0775379fbbfeaa114c52ccaff312a5bb9b20c322a1175d426a75344bb4a2a0e"
Sep 10 23:56:41.819268 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:41.819223    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0775379fbbfeaa114c52ccaff312a5bb9b20c322a1175d426a75344bb4a2a0e"} err="failed to get container status \"b0775379fbbfeaa114c52ccaff312a5bb9b20c322a1175d426a75344bb4a2a0e\": rpc error: code = NotFound desc = could not find container \"b0775379fbbfeaa114c52ccaff312a5bb9b20c322a1175d426a75344bb4a2a0e\": container with ID starting with b0775379fbbfeaa114c52ccaff312a5bb9b20c322a1175d426a75344bb4a2a0e not found: ID does not exist"
Sep 10 23:56:42.491331 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:42.491296    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"]
Sep 10 23:56:42.510621 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:42.510590    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:42.948841 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:42.948809    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7812-bdb333"
Sep 10 23:56:43.065994 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:43.065907    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjf2p\" (UniqueName: \"kubernetes.io/projected/a696c051-5cb1-454f-85e4-cd19cf81f235-kube-api-access-mjf2p\") pod \"a696c051-5cb1-454f-85e4-cd19cf81f235\" (UID: \"a696c051-5cb1-454f-85e4-cd19cf81f235\") "
Sep 10 23:56:43.067985 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:43.067958    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a696c051-5cb1-454f-85e4-cd19cf81f235-kube-api-access-mjf2p" (OuterVolumeSpecName: "kube-api-access-mjf2p") pod "a696c051-5cb1-454f-85e4-cd19cf81f235" (UID: "a696c051-5cb1-454f-85e4-cd19cf81f235"). InnerVolumeSpecName "kube-api-access-mjf2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:56:43.167373 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:43.167338    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjf2p\" (UniqueName: \"kubernetes.io/projected/a696c051-5cb1-454f-85e4-cd19cf81f235-kube-api-access-mjf2p\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:43.256183 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:43.256151    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a696c051-5cb1-454f-85e4-cd19cf81f235" path="/var/lib/kubelet/pods/a696c051-5cb1-454f-85e4-cd19cf81f235/volumes"
Sep 10 23:56:43.824346 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:43.824312    2574 generic.go:356] "Generic (PLEG): container finished" podID="a696c051-5cb1-454f-85e4-cd19cf81f235" containerID="199d02f98f9c0b0cbb7ea9ac9b35a9b8fe4678c57a9ce4c59375ab13a4c7bc81" exitCode=137
Sep 10 23:56:43.824596 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:43.824368    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7812-bdb333"
Sep 10 23:56:43.824596 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:43.824389    2574 scope.go:117] "RemoveContainer" containerID="199d02f98f9c0b0cbb7ea9ac9b35a9b8fe4678c57a9ce4c59375ab13a4c7bc81"
Sep 10 23:56:43.833436 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:43.833418    2574 scope.go:117] "RemoveContainer" containerID="199d02f98f9c0b0cbb7ea9ac9b35a9b8fe4678c57a9ce4c59375ab13a4c7bc81"
Sep 10 23:56:43.833783 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:56:43.833761    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"199d02f98f9c0b0cbb7ea9ac9b35a9b8fe4678c57a9ce4c59375ab13a4c7bc81\": container with ID starting with 199d02f98f9c0b0cbb7ea9ac9b35a9b8fe4678c57a9ce4c59375ab13a4c7bc81 not found: ID does not exist" containerID="199d02f98f9c0b0cbb7ea9ac9b35a9b8fe4678c57a9ce4c59375ab13a4c7bc81"
Sep 10 23:56:43.833871 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:43.833789    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199d02f98f9c0b0cbb7ea9ac9b35a9b8fe4678c57a9ce4c59375ab13a4c7bc81"} err="failed to get container status \"199d02f98f9c0b0cbb7ea9ac9b35a9b8fe4678c57a9ce4c59375ab13a4c7bc81\": rpc error: code = NotFound desc = could not find container \"199d02f98f9c0b0cbb7ea9ac9b35a9b8fe4678c57a9ce4c59375ab13a4c7bc81\": container with ID starting with 199d02f98f9c0b0cbb7ea9ac9b35a9b8fe4678c57a9ce4c59375ab13a4c7bc81 not found: ID does not exist"
Sep 10 23:56:44.698798 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:44.698755    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:56:45.617701 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.617676    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:56:45.690259 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690162    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-workload-socket\") pod \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") "
Sep 10 23:56:45.690259 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690211    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-token\") pod \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") "
Sep 10 23:56:45.690259 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690246    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-credential-socket\") pod \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") "
Sep 10 23:56:45.690562 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690290    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-data\") pod \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") "
Sep 10 23:56:45.690562 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690320    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istiod-ca-cert\") pod \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") "
Sep 10 23:56:45.690562 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690339    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-podinfo\") pod \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") "
Sep 10 23:56:45.690562 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690381    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-workload-certs\") pod \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") "
Sep 10 23:56:45.690562 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690424    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-envoy\") pod \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") "
Sep 10 23:56:45.690562 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690487    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk9fb\" (UniqueName: \"kubernetes.io/projected/10aca7e9-b492-4cc0-83b6-9b6226a116e0-kube-api-access-pk9fb\") pod \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\" (UID: \"10aca7e9-b492-4cc0-83b6-9b6226a116e0\") "
Sep 10 23:56:45.690904 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690478    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10aca7e9-b492-4cc0-83b6-9b6226a116e0" (UID: "10aca7e9-b492-4cc0-83b6-9b6226a116e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:56:45.690904 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690626    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-data" (OuterVolumeSpecName: "istio-data") pod "10aca7e9-b492-4cc0-83b6-9b6226a116e0" (UID: "10aca7e9-b492-4cc0-83b6-9b6226a116e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:56:45.690904 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690646    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10aca7e9-b492-4cc0-83b6-9b6226a116e0" (UID: "10aca7e9-b492-4cc0-83b6-9b6226a116e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:56:45.690904 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690752    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10aca7e9-b492-4cc0-83b6-9b6226a116e0" (UID: "10aca7e9-b492-4cc0-83b6-9b6226a116e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:56:45.691120 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690912    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-workload-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:45.691120 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690941    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-workload-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:45.691120 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690957    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-credential-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:45.691120 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690969    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-data\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:45.691120 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.690979    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10aca7e9-b492-4cc0-83b6-9b6226a116e0" (UID: "10aca7e9-b492-4cc0-83b6-9b6226a116e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:56:45.692566 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.692541    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "10aca7e9-b492-4cc0-83b6-9b6226a116e0" (UID: "10aca7e9-b492-4cc0-83b6-9b6226a116e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:56:45.692758 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.692742    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10aca7e9-b492-4cc0-83b6-9b6226a116e0-kube-api-access-pk9fb" (OuterVolumeSpecName: "kube-api-access-pk9fb") pod "10aca7e9-b492-4cc0-83b6-9b6226a116e0" (UID: "10aca7e9-b492-4cc0-83b6-9b6226a116e0"). InnerVolumeSpecName "kube-api-access-pk9fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:56:45.692843 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.692817    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10aca7e9-b492-4cc0-83b6-9b6226a116e0" (UID: "10aca7e9-b492-4cc0-83b6-9b6226a116e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:56:45.692913 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.692879    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10aca7e9-b492-4cc0-83b6-9b6226a116e0" (UID: "10aca7e9-b492-4cc0-83b6-9b6226a116e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:56:45.791561 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.791514    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk9fb\" (UniqueName: \"kubernetes.io/projected/10aca7e9-b492-4cc0-83b6-9b6226a116e0-kube-api-access-pk9fb\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:45.791561 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.791562    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-token\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:45.791561 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.791573    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istiod-ca-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:45.792038 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.791581    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-podinfo\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:45.792038 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.791589    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10aca7e9-b492-4cc0-83b6-9b6226a116e0-istio-envoy\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:45.846695 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.846656    2574 generic.go:356] "Generic (PLEG): container finished" podID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerID="eab5e7880d6e60ebd0372a55bcf20df83e3a32888c2feb60d0467094cd02e016" exitCode=0
Sep 10 23:56:45.846863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.846738    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5" event={"ID":"10aca7e9-b492-4cc0-83b6-9b6226a116e0","Type":"ContainerDied","Data":"eab5e7880d6e60ebd0372a55bcf20df83e3a32888c2feb60d0467094cd02e016"}
Sep 10 23:56:45.846863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.846812    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5" event={"ID":"10aca7e9-b492-4cc0-83b6-9b6226a116e0","Type":"ContainerDied","Data":"8c4775d6c424b6e4be0d0c856172212bcc155eee51da46aaf273062e82c5e91c"}
Sep 10 23:56:45.846863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.846743    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"
Sep 10 23:56:45.846863 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.846837    2574 scope.go:117] "RemoveContainer" containerID="eab5e7880d6e60ebd0372a55bcf20df83e3a32888c2feb60d0467094cd02e016"
Sep 10 23:56:45.856507 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.856486    2574 scope.go:117] "RemoveContainer" containerID="df8a17c71ab02fcf3d34321daaa381be308b6fc842771f6579527f3d3491df22"
Sep 10 23:56:45.865331 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.865302    2574 scope.go:117] "RemoveContainer" containerID="eab5e7880d6e60ebd0372a55bcf20df83e3a32888c2feb60d0467094cd02e016"
Sep 10 23:56:45.865773 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:56:45.865746    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab5e7880d6e60ebd0372a55bcf20df83e3a32888c2feb60d0467094cd02e016\": container with ID starting with eab5e7880d6e60ebd0372a55bcf20df83e3a32888c2feb60d0467094cd02e016 not found: ID does not exist" containerID="eab5e7880d6e60ebd0372a55bcf20df83e3a32888c2feb60d0467094cd02e016"
Sep 10 23:56:45.865885 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.865787    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab5e7880d6e60ebd0372a55bcf20df83e3a32888c2feb60d0467094cd02e016"} err="failed to get container status \"eab5e7880d6e60ebd0372a55bcf20df83e3a32888c2feb60d0467094cd02e016\": rpc error: code = NotFound desc = could not find container \"eab5e7880d6e60ebd0372a55bcf20df83e3a32888c2feb60d0467094cd02e016\": container with ID starting with eab5e7880d6e60ebd0372a55bcf20df83e3a32888c2feb60d0467094cd02e016 not found: ID does not exist"
Sep 10 23:56:45.865885 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.865812    2574 scope.go:117] "RemoveContainer" containerID="df8a17c71ab02fcf3d34321daaa381be308b6fc842771f6579527f3d3491df22"
Sep 10 23:56:45.866124 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:56:45.866096    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df8a17c71ab02fcf3d34321daaa381be308b6fc842771f6579527f3d3491df22\": container with ID starting with df8a17c71ab02fcf3d34321daaa381be308b6fc842771f6579527f3d3491df22 not found: ID does not exist" containerID="df8a17c71ab02fcf3d34321daaa381be308b6fc842771f6579527f3d3491df22"
Sep 10 23:56:45.866167 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.866135    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df8a17c71ab02fcf3d34321daaa381be308b6fc842771f6579527f3d3491df22"} err="failed to get container status \"df8a17c71ab02fcf3d34321daaa381be308b6fc842771f6579527f3d3491df22\": rpc error: code = NotFound desc = could not find container \"df8a17c71ab02fcf3d34321daaa381be308b6fc842771f6579527f3d3491df22\": container with ID starting with df8a17c71ab02fcf3d34321daaa381be308b6fc842771f6579527f3d3491df22 not found: ID does not exist"
Sep 10 23:56:45.868625 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.868582    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"]
Sep 10 23:56:45.871831 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:45.871808    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-7c0647-openshift-default-688658c6c8-h5xs5"]
Sep 10 23:56:47.256998 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:47.256963    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" path="/var/lib/kubelet/pods/10aca7e9-b492-4cc0-83b6-9b6226a116e0/volumes"
Sep 10 23:56:51.999971 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:51.999932    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"]
Sep 10 23:56:52.000433 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.000346    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerName="istio-proxy"
Sep 10 23:56:52.000433 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.000359    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerName="istio-proxy"
Sep 10 23:56:52.000433 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.000377    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerName="istio-proxy"
Sep 10 23:56:52.000433 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.000383    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerName="istio-proxy"
Sep 10 23:56:52.000433 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.000392    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a696c051-5cb1-454f-85e4-cd19cf81f235" containerName="test-curl-7812-bdb333"
Sep 10 23:56:52.000433 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.000398    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a696c051-5cb1-454f-85e4-cd19cf81f235" containerName="test-curl-7812-bdb333"
Sep 10 23:56:52.000640 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.000459    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerName="istio-proxy"
Sep 10 23:56:52.000640 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.000467    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a696c051-5cb1-454f-85e4-cd19cf81f235" containerName="test-curl-7812-bdb333"
Sep 10 23:56:52.004366 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.004346    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.006837 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.006812    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-0b637b\"/\"rate-test-model-0b637b-kserve-self-signed-certs\""
Sep 10 23:56:52.011605 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.011581    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"]
Sep 10 23:56:52.035917 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.035874    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d3ffc3-131e-4fc0-a995-3e55ebf40968-tls-certs\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.036224 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.036003    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-dshm\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.036224 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.036049    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-tmp-dir\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.036224 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.036069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zdj8\" (UniqueName: \"kubernetes.io/projected/87d3ffc3-131e-4fc0-a995-3e55ebf40968-kube-api-access-6zdj8\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.036224 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.036130    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-home\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.036224 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.036195    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-model-cache\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.087159 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.087127    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:52.137445 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.137404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d3ffc3-131e-4fc0-a995-3e55ebf40968-tls-certs\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.137640 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.137577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-dshm\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.137640 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.137623    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-tmp-dir\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.137797 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.137642    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zdj8\" (UniqueName: \"kubernetes.io/projected/87d3ffc3-131e-4fc0-a995-3e55ebf40968-kube-api-access-6zdj8\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.137797 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.137673    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-home\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.137797 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.137751    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-model-cache\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.138054 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.138036    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-tmp-dir\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.138122 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.138108    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-model-cache\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.138173 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.138131    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-home\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.139866 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.139844    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-dshm\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.140183 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.140163    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d3ffc3-131e-4fc0-a995-3e55ebf40968-tls-certs\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.146467 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.146443    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zdj8\" (UniqueName: \"kubernetes.io/projected/87d3ffc3-131e-4fc0-a995-3e55ebf40968-kube-api-access-6zdj8\") pod \"rate-test-model-0b637b-kserve-774dcc6f55-z6knh\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") " pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.315195 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.315095    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:56:52.591120 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.591094    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"]
Sep 10 23:56:52.592570 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:56:52.592529    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87d3ffc3_131e_4fc0_a995_3e55ebf40968.slice/crio-93ab2a47eb17bcf87b64c7e7f122b026ab8f5a69a71166b36311342f8b4d20ab WatchSource:0}: Error finding container 93ab2a47eb17bcf87b64c7e7f122b026ab8f5a69a71166b36311342f8b4d20ab: Status 404 returned error can't find the container with id 93ab2a47eb17bcf87b64c7e7f122b026ab8f5a69a71166b36311342f8b4d20ab
Sep 10 23:56:52.890601 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.890563    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh" event={"ID":"87d3ffc3-131e-4fc0-a995-3e55ebf40968","Type":"ContainerStarted","Data":"5779358fe916d8d77d124fdf4470580facd25c44a4e4f5a1244508787d8baad9"}
Sep 10 23:56:52.890804 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.890617    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh" event={"ID":"87d3ffc3-131e-4fc0-a995-3e55ebf40968","Type":"ContainerStarted","Data":"93ab2a47eb17bcf87b64c7e7f122b026ab8f5a69a71166b36311342f8b4d20ab"}
Sep 10 23:56:52.908187 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:52.908135    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh" podStartSLOduration=1.9081200520000001 podStartE2EDuration="1.908120052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:52.905460684 +0000 UTC m=+1410.087618815" watchObservedRunningTime="2026-09-10 23:56:52.908120052 +0000 UTC m=+1410.090278186"
Sep 10 23:56:56.177396 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.177359    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:56.307519 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.307471    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:56.356501 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.356462    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v" podUID="7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a" containerName="main" containerID="cri-o://f4f826f51fd307b28c823faccf52111b4c55eeb0761dcccf092e0df49adf8d4a" gracePeriod=45
Sep 10 23:56:56.404397 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.404359    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:56.459016 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.458927    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:56.614981 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.614955    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:56:56.678918 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.678875    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-model-cache\") pod \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") "
Sep 10 23:56:56.679135 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.678973    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-tmp-dir\") pod \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") "
Sep 10 23:56:56.679135 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.679016    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-dshm\") pod \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") "
Sep 10 23:56:56.679135 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.679111    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-home\") pod \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") "
Sep 10 23:56:56.679317 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.679128    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-model-cache" (OuterVolumeSpecName: "model-cache") pod "7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a" (UID: "7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:56:56.679317 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.679171    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a" (UID: "7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:56:56.679317 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.679176    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-tls-certs\") pod \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") "
Sep 10 23:56:56.679317 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.679206    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z6s7\" (UniqueName: \"kubernetes.io/projected/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-kube-api-access-8z6s7\") pod \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\" (UID: \"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a\") "
Sep 10 23:56:56.679317 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.679307    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-home" (OuterVolumeSpecName: "home") pod "7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a" (UID: "7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:56:56.679591 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.679558    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:56.679591 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.679583    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:56.679703 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.679598    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:56.685024 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.681863    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-dshm" (OuterVolumeSpecName: "dshm") pod "7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a" (UID: "7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:56:56.685024 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.681863    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a" (UID: "7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:56:56.685024 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.682123    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-kube-api-access-8z6s7" (OuterVolumeSpecName: "kube-api-access-8z6s7") pod "7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a" (UID: "7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a"). InnerVolumeSpecName "kube-api-access-8z6s7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:56:56.780898 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.780812    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:56.780898 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.780839    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:56.780898 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.780850    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z6s7\" (UniqueName: \"kubernetes.io/projected/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a-kube-api-access-8z6s7\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:56.807319 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.807283    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:56.915122 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.915078    2574 generic.go:356] "Generic (PLEG): container finished" podID="7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a" containerID="f4f826f51fd307b28c823faccf52111b4c55eeb0761dcccf092e0df49adf8d4a" exitCode=0
Sep 10 23:56:56.915122 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.915122    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"
Sep 10 23:56:56.915326 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.915129    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v" event={"ID":"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a","Type":"ContainerDied","Data":"f4f826f51fd307b28c823faccf52111b4c55eeb0761dcccf092e0df49adf8d4a"}
Sep 10 23:56:56.915326 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.915174    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v" event={"ID":"7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a","Type":"ContainerDied","Data":"83c7fae9bedec7b83bbb8ec184c70551f859db2e72559482dd924b52bd7586b3"}
Sep 10 23:56:56.915326 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.915200    2574 scope.go:117] "RemoveContainer" containerID="f4f826f51fd307b28c823faccf52111b4c55eeb0761dcccf092e0df49adf8d4a"
Sep 10 23:56:56.925070 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.925051    2574 scope.go:117] "RemoveContainer" containerID="f4f826f51fd307b28c823faccf52111b4c55eeb0761dcccf092e0df49adf8d4a"
Sep 10 23:56:56.925354 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:56:56.925335    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4f826f51fd307b28c823faccf52111b4c55eeb0761dcccf092e0df49adf8d4a\": container with ID starting with f4f826f51fd307b28c823faccf52111b4c55eeb0761dcccf092e0df49adf8d4a not found: ID does not exist" containerID="f4f826f51fd307b28c823faccf52111b4c55eeb0761dcccf092e0df49adf8d4a"
Sep 10 23:56:56.925418 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.925367    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4f826f51fd307b28c823faccf52111b4c55eeb0761dcccf092e0df49adf8d4a"} err="failed to get container status \"f4f826f51fd307b28c823faccf52111b4c55eeb0761dcccf092e0df49adf8d4a\": rpc error: code = NotFound desc = could not find container \"f4f826f51fd307b28c823faccf52111b4c55eeb0761dcccf092e0df49adf8d4a\": container with ID starting with f4f826f51fd307b28c823faccf52111b4c55eeb0761dcccf092e0df49adf8d4a not found: ID does not exist"
Sep 10 23:56:56.940733 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.940697    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"]
Sep 10 23:56:56.957603 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:56.957581    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/sub-test-model-0b637b-kserve-79747d79d7-6rg6v"]
Sep 10 23:56:57.256118 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.256083    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a" path="/var/lib/kubelet/pods/7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a/volumes"
Sep 10 23:56:57.510884 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.510781    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv" podUID="e73e2dde-9f95-4d02-a288-846315717a2a" containerName="main" containerID="cri-o://f5fa21e39100ce9df373464c8438087d8f4b8468c3fc5ef4a92d56b54c44076f" gracePeriod=45
Sep 10 23:56:57.762802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.762742    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:56:57.789292 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.789265    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e73e2dde-9f95-4d02-a288-846315717a2a-tls-certs\") pod \"e73e2dde-9f95-4d02-a288-846315717a2a\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") "
Sep 10 23:56:57.789456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.789335    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-dshm\") pod \"e73e2dde-9f95-4d02-a288-846315717a2a\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") "
Sep 10 23:56:57.789456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.789439    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-home\") pod \"e73e2dde-9f95-4d02-a288-846315717a2a\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") "
Sep 10 23:56:57.789579 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.789500    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-model-cache\") pod \"e73e2dde-9f95-4d02-a288-846315717a2a\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") "
Sep 10 23:56:57.789579 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.789560    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-tmp-dir\") pod \"e73e2dde-9f95-4d02-a288-846315717a2a\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") "
Sep 10 23:56:57.789679 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.789612    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkfk5\" (UniqueName: \"kubernetes.io/projected/e73e2dde-9f95-4d02-a288-846315717a2a-kube-api-access-bkfk5\") pod \"e73e2dde-9f95-4d02-a288-846315717a2a\" (UID: \"e73e2dde-9f95-4d02-a288-846315717a2a\") "
Sep 10 23:56:57.789766 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.789734    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-home" (OuterVolumeSpecName: "home") pod "e73e2dde-9f95-4d02-a288-846315717a2a" (UID: "e73e2dde-9f95-4d02-a288-846315717a2a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:56:57.789766 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.789751    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-model-cache" (OuterVolumeSpecName: "model-cache") pod "e73e2dde-9f95-4d02-a288-846315717a2a" (UID: "e73e2dde-9f95-4d02-a288-846315717a2a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:56:57.789915 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.789888    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e73e2dde-9f95-4d02-a288-846315717a2a" (UID: "e73e2dde-9f95-4d02-a288-846315717a2a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:56:57.790014 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.789995    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:57.790076 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.790020    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:57.790076 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.790059    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:57.791462 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.791437    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-dshm" (OuterVolumeSpecName: "dshm") pod "e73e2dde-9f95-4d02-a288-846315717a2a" (UID: "e73e2dde-9f95-4d02-a288-846315717a2a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:56:57.791558 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.791528    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e73e2dde-9f95-4d02-a288-846315717a2a-kube-api-access-bkfk5" (OuterVolumeSpecName: "kube-api-access-bkfk5") pod "e73e2dde-9f95-4d02-a288-846315717a2a" (UID: "e73e2dde-9f95-4d02-a288-846315717a2a"). InnerVolumeSpecName "kube-api-access-bkfk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:56:57.791625 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.791609    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e73e2dde-9f95-4d02-a288-846315717a2a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e73e2dde-9f95-4d02-a288-846315717a2a" (UID: "e73e2dde-9f95-4d02-a288-846315717a2a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:56:57.891452 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.891416    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e73e2dde-9f95-4d02-a288-846315717a2a-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:57.891452 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.891446    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkfk5\" (UniqueName: \"kubernetes.io/projected/e73e2dde-9f95-4d02-a288-846315717a2a-kube-api-access-bkfk5\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:57.891452 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.891457    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e73e2dde-9f95-4d02-a288-846315717a2a-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:56:57.923001 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.922970    2574 generic.go:356] "Generic (PLEG): container finished" podID="e73e2dde-9f95-4d02-a288-846315717a2a" containerID="f5fa21e39100ce9df373464c8438087d8f4b8468c3fc5ef4a92d56b54c44076f" exitCode=0
Sep 10 23:56:57.923168 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.923014    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"
Sep 10 23:56:57.923168 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.923054    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv" event={"ID":"e73e2dde-9f95-4d02-a288-846315717a2a","Type":"ContainerDied","Data":"f5fa21e39100ce9df373464c8438087d8f4b8468c3fc5ef4a92d56b54c44076f"}
Sep 10 23:56:57.923168 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.923096    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv" event={"ID":"e73e2dde-9f95-4d02-a288-846315717a2a","Type":"ContainerDied","Data":"a29266c50570933e71c3fe0a6d86864e677fef770b2ac36907a9d76a30fcd0a9"}
Sep 10 23:56:57.923168 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.923116    2574 scope.go:117] "RemoveContainer" containerID="f5fa21e39100ce9df373464c8438087d8f4b8468c3fc5ef4a92d56b54c44076f"
Sep 10 23:56:57.932850 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.932834    2574 scope.go:117] "RemoveContainer" containerID="f5fa21e39100ce9df373464c8438087d8f4b8468c3fc5ef4a92d56b54c44076f"
Sep 10 23:56:57.933122 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:56:57.933103    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5fa21e39100ce9df373464c8438087d8f4b8468c3fc5ef4a92d56b54c44076f\": container with ID starting with f5fa21e39100ce9df373464c8438087d8f4b8468c3fc5ef4a92d56b54c44076f not found: ID does not exist" containerID="f5fa21e39100ce9df373464c8438087d8f4b8468c3fc5ef4a92d56b54c44076f"
Sep 10 23:56:57.933170 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.933131    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5fa21e39100ce9df373464c8438087d8f4b8468c3fc5ef4a92d56b54c44076f"} err="failed to get container status \"f5fa21e39100ce9df373464c8438087d8f4b8468c3fc5ef4a92d56b54c44076f\": rpc error: code = NotFound desc = could not find container \"f5fa21e39100ce9df373464c8438087d8f4b8468c3fc5ef4a92d56b54c44076f\": container with ID starting with f5fa21e39100ce9df373464c8438087d8f4b8468c3fc5ef4a92d56b54c44076f not found: ID does not exist"
Sep 10 23:56:57.943803 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.943780    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"]
Sep 10 23:56:57.947158 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:57.947132    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/sub-test-model-6d2e31-kserve-84f56f485-tmfrv"]
Sep 10 23:56:59.256837 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:56:59.256800    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e73e2dde-9f95-4d02-a288-846315717a2a" path="/var/lib/kubelet/pods/e73e2dde-9f95-4d02-a288-846315717a2a/volumes"
Sep 10 23:57:02.315644 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:02.315585    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:57:02.316156 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:02.315663    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:57:02.330211 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:02.330173    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:57:02.479308 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:02.479275    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:02.548095 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:02.548059    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:02.718501 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:02.718466    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"]
Sep 10 23:57:02.718806 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:02.718771    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy" containerID="cri-o://c94a915ee1e8357cd2fa08050db079e2a7255b89aa92a2084f5955d8ab006966" gracePeriod=30
Sep 10 23:57:02.734195 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:02.734168    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:02.963970 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:02.963943    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:57:03.299454 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:03.299423    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:57:03.328751 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:03.328695    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:05.220410 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:05.220370    2574 patch_prober.go:28] interesting pod/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 23:57:05.220813 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:05.220430    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 23:57:06.317470 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:06.317435    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:07.983338 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:07.983266    2574 generic.go:356] "Generic (PLEG): container finished" podID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerID="c94a915ee1e8357cd2fa08050db079e2a7255b89aa92a2084f5955d8ab006966" exitCode=0
Sep 10 23:57:07.983659 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:07.983343    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" event={"ID":"7091ae18-18e9-42cd-969a-6ce850a849f0","Type":"ContainerDied","Data":"c94a915ee1e8357cd2fa08050db079e2a7255b89aa92a2084f5955d8ab006966"}
Sep 10 23:57:07.983659 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:07.983400    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92" event={"ID":"7091ae18-18e9-42cd-969a-6ce850a849f0","Type":"ContainerDied","Data":"2cb19f3d97fa618bd2c1579abfb63e7008d09d24e63c2d9671d8ab7160347516"}
Sep 10 23:57:07.983659 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:07.983416    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cb19f3d97fa618bd2c1579abfb63e7008d09d24e63c2d9671d8ab7160347516"
Sep 10 23:57:07.983659 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:07.983430    2574 scope.go:117] "RemoveContainer" containerID="b40e8e909285000cb2a0a964e0cf5ab45b005f8463fb8398938dd8deed7d818d"
Sep 10 23:57:07.983908 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:07.983776    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:57:08.092036 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.091994    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-token\") pod \"7091ae18-18e9-42cd-969a-6ce850a849f0\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") "
Sep 10 23:57:08.092036 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092040    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-data\") pod \"7091ae18-18e9-42cd-969a-6ce850a849f0\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") "
Sep 10 23:57:08.092298 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092060    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-credential-socket\") pod \"7091ae18-18e9-42cd-969a-6ce850a849f0\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") "
Sep 10 23:57:08.092298 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092088    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7091ae18-18e9-42cd-969a-6ce850a849f0-istiod-ca-cert\") pod \"7091ae18-18e9-42cd-969a-6ce850a849f0\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") "
Sep 10 23:57:08.092298 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092107    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-workload-socket\") pod \"7091ae18-18e9-42cd-969a-6ce850a849f0\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") "
Sep 10 23:57:08.092298 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092150    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvnwc\" (UniqueName: \"kubernetes.io/projected/7091ae18-18e9-42cd-969a-6ce850a849f0-kube-api-access-rvnwc\") pod \"7091ae18-18e9-42cd-969a-6ce850a849f0\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") "
Sep 10 23:57:08.092298 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092183    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-podinfo\") pod \"7091ae18-18e9-42cd-969a-6ce850a849f0\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") "
Sep 10 23:57:08.092298 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092204    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-workload-certs\") pod \"7091ae18-18e9-42cd-969a-6ce850a849f0\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") "
Sep 10 23:57:08.092298 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092229    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-envoy\") pod \"7091ae18-18e9-42cd-969a-6ce850a849f0\" (UID: \"7091ae18-18e9-42cd-969a-6ce850a849f0\") "
Sep 10 23:57:08.092673 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092429    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-data" (OuterVolumeSpecName: "istio-data") pod "7091ae18-18e9-42cd-969a-6ce850a849f0" (UID: "7091ae18-18e9-42cd-969a-6ce850a849f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:57:08.092673 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092461    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7091ae18-18e9-42cd-969a-6ce850a849f0" (UID: "7091ae18-18e9-42cd-969a-6ce850a849f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:57:08.092673 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092535    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7091ae18-18e9-42cd-969a-6ce850a849f0" (UID: "7091ae18-18e9-42cd-969a-6ce850a849f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:57:08.092673 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092668    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7091ae18-18e9-42cd-969a-6ce850a849f0" (UID: "7091ae18-18e9-42cd-969a-6ce850a849f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:57:08.092933 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092677    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-data\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:08.092933 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092696    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-credential-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:08.092933 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092695    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7091ae18-18e9-42cd-969a-6ce850a849f0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7091ae18-18e9-42cd-969a-6ce850a849f0" (UID: "7091ae18-18e9-42cd-969a-6ce850a849f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:57:08.092933 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.092738    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-workload-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:08.094364 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.094334    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-token" (OuterVolumeSpecName: "istio-token") pod "7091ae18-18e9-42cd-969a-6ce850a849f0" (UID: "7091ae18-18e9-42cd-969a-6ce850a849f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:57:08.094471 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.094447    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7091ae18-18e9-42cd-969a-6ce850a849f0" (UID: "7091ae18-18e9-42cd-969a-6ce850a849f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:57:08.094542 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.094523    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7091ae18-18e9-42cd-969a-6ce850a849f0" (UID: "7091ae18-18e9-42cd-969a-6ce850a849f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:57:08.094584 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.094538    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7091ae18-18e9-42cd-969a-6ce850a849f0-kube-api-access-rvnwc" (OuterVolumeSpecName: "kube-api-access-rvnwc") pod "7091ae18-18e9-42cd-969a-6ce850a849f0" (UID: "7091ae18-18e9-42cd-969a-6ce850a849f0"). InnerVolumeSpecName "kube-api-access-rvnwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:57:08.193419 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.193376    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7091ae18-18e9-42cd-969a-6ce850a849f0-istiod-ca-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:08.193419 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.193413    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvnwc\" (UniqueName: \"kubernetes.io/projected/7091ae18-18e9-42cd-969a-6ce850a849f0-kube-api-access-rvnwc\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:08.193419 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.193427    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-podinfo\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:08.193677 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.193439    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-workload-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:08.193677 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.193451    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-envoy\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:08.193677 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.193461    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7091ae18-18e9-42cd-969a-6ce850a849f0-istio-token\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:08.991329 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:08.991300    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"
Sep 10 23:57:09.024325 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:09.024289    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"]
Sep 10 23:57:09.031388 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:09.031358    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-bcad17-openshift-default-79bc665bb-d2n92"]
Sep 10 23:57:09.257393 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:09.257314    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" path="/var/lib/kubelet/pods/7091ae18-18e9-42cd-969a-6ce850a849f0/volumes"
Sep 10 23:57:13.321783 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:13.321742    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:13.854923 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:13.854843    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:13.918555 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:13.918519    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:13.975451 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:13.975417    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:14.031014 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:14.030976    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:14.087206 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:14.087167    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:14.387704 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:14.387671    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:18.403306 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:18.403216    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:57:20.215505 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:20.215469    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:20.315673 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:20.315640    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:20.460790 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:20.460750    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:20.924672 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:20.924635    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:23.516367 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:23.516332    2574 scope.go:117] "RemoveContainer" containerID="d50a137c18583ca82a851cd250dd6b283eafbc945394a71c5523e40e73381db1"
Sep 10 23:57:31.187318 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:31.187279    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:31.287200 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:31.287165    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:31.373088 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:31.373047    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:31.425198 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:31.425164    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:31.727476 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:31.727442    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:35.300837 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:35.300789    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:57:36.290312 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290273    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"]
Sep 10 23:57:36.290742 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290699    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy"
Sep 10 23:57:36.290742 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290732    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy"
Sep 10 23:57:36.290903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290747    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a" containerName="main"
Sep 10 23:57:36.290903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290757    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a" containerName="main"
Sep 10 23:57:36.290903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290767    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e73e2dde-9f95-4d02-a288-846315717a2a" containerName="main"
Sep 10 23:57:36.290903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290775    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e73e2dde-9f95-4d02-a288-846315717a2a" containerName="main"
Sep 10 23:57:36.290903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290790    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy"
Sep 10 23:57:36.290903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290799    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy"
Sep 10 23:57:36.291190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290925    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e73e2dde-9f95-4d02-a288-846315717a2a" containerName="main"
Sep 10 23:57:36.291190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290942    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="10aca7e9-b492-4cc0-83b6-9b6226a116e0" containerName="istio-proxy"
Sep 10 23:57:36.291190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290952    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy"
Sep 10 23:57:36.291190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290960    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7091ae18-18e9-42cd-969a-6ce850a849f0" containerName="istio-proxy"
Sep 10 23:57:36.291190 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.290970    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de0ba54-4bc5-4725-9eab-2b4d2cd77a8a" containerName="main"
Sep 10 23:57:36.294246 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.294228    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.297134 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.297108    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-6d2e31\"/\"openshift-service-ca.crt\""
Sep 10 23:57:36.298099 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.298068    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-6d2e31\"/\"default-dockercfg-c9x4z\""
Sep 10 23:57:36.298174 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.298114    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-6d2e31\"/\"rate-test-model-6d2e31-kserve-self-signed-certs\""
Sep 10 23:57:36.298174 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.298133    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-6d2e31\"/\"kube-root-ca.crt\""
Sep 10 23:57:36.303239 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.303215    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"]
Sep 10 23:57:36.360810 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.360768    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-home\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.361112 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.361085    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-dshm\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.361247 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.361140    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkxhb\" (UniqueName: \"kubernetes.io/projected/d7c06099-7a6e-4bda-b030-39568a2b0951-kube-api-access-nkxhb\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.361247 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.361182    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-tmp-dir\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.361247 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.361214    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-model-cache\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.361412 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.361335    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7c06099-7a6e-4bda-b030-39568a2b0951-tls-certs\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.402113 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.402073    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:36.461753 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.461686    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-tmp-dir\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.461753 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.461745    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-model-cache\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.462001 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.461808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7c06099-7a6e-4bda-b030-39568a2b0951-tls-certs\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.462001 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.461886    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-home\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.462001 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.461909    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-dshm\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.462001 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.461942    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxhb\" (UniqueName: \"kubernetes.io/projected/d7c06099-7a6e-4bda-b030-39568a2b0951-kube-api-access-nkxhb\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.462229 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.462083    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-tmp-dir\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.462229 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.462127    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-model-cache\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.462343 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.462255    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-home\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.464214 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.464190    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-dshm\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.464508 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.464485    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7c06099-7a6e-4bda-b030-39568a2b0951-tls-certs\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.472571 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.472546    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkxhb\" (UniqueName: \"kubernetes.io/projected/d7c06099-7a6e-4bda-b030-39568a2b0951-kube-api-access-nkxhb\") pod \"rate-test-model-6d2e31-kserve-6564547cc9-gwh8f\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") " pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.605132 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.605041    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:36.878627 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:36.878599    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"]
Sep 10 23:57:36.880622 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:57:36.880595    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7c06099_7a6e_4bda_b030_39568a2b0951.slice/crio-0dee7524d0420349d12b9184a0bb5a0be0e92cbd92779d088c7bbbcf5113baf2 WatchSource:0}: Error finding container 0dee7524d0420349d12b9184a0bb5a0be0e92cbd92779d088c7bbbcf5113baf2: Status 404 returned error can't find the container with id 0dee7524d0420349d12b9184a0bb5a0be0e92cbd92779d088c7bbbcf5113baf2
Sep 10 23:57:37.153903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:37.153794    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f" event={"ID":"d7c06099-7a6e-4bda-b030-39568a2b0951","Type":"ContainerStarted","Data":"80a38da9017f08f9b8623c095577feef4bd9388bab60322199e2fe16b988ba35"}
Sep 10 23:57:37.153903 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:37.153846    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f" event={"ID":"d7c06099-7a6e-4bda-b030-39568a2b0951","Type":"ContainerStarted","Data":"0dee7524d0420349d12b9184a0bb5a0be0e92cbd92779d088c7bbbcf5113baf2"}
Sep 10 23:57:37.170404 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:37.170353    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f" podStartSLOduration=1.170336494 podStartE2EDuration="1.170336494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:57:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:57:37.168959996 +0000 UTC m=+1454.351118137" watchObservedRunningTime="2026-09-10 23:57:37.170336494 +0000 UTC m=+1454.352494621"
Sep 10 23:57:37.620101 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:37.620050    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:37.678172 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:37.678130    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:37.876415 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:37.874478    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"]
Sep 10 23:57:37.876415 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:37.874856    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy" containerID="cri-o://8264d25a0f004c77e7395561346329676694459e219916323ff3ea47fdc027f4" gracePeriod=30
Sep 10 23:57:37.883613 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:37.883580    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:38.560024 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:38.559988    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 23:57:38.560231 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:38.560061    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 23:57:43.122490 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.122467    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:57:43.188114 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.188043    2574 generic.go:356] "Generic (PLEG): container finished" podID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerID="8264d25a0f004c77e7395561346329676694459e219916323ff3ea47fdc027f4" exitCode=0
Sep 10 23:57:43.188114 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.188094    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"
Sep 10 23:57:43.188281 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.188130    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" event={"ID":"842b27ae-6e31-4d60-8884-c6edfd10f4a4","Type":"ContainerDied","Data":"8264d25a0f004c77e7395561346329676694459e219916323ff3ea47fdc027f4"}
Sep 10 23:57:43.188281 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.188185    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst" event={"ID":"842b27ae-6e31-4d60-8884-c6edfd10f4a4","Type":"ContainerDied","Data":"5c88b05bd8350bf4504d28bc76d354ae8b58004516b90ec1bad26b4afef12eca"}
Sep 10 23:57:43.188281 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.188217    2574 scope.go:117] "RemoveContainer" containerID="8264d25a0f004c77e7395561346329676694459e219916323ff3ea47fdc027f4"
Sep 10 23:57:43.197286 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.197267    2574 scope.go:117] "RemoveContainer" containerID="d8228567ba17d9e4030a4982f141946c0902278755d54d58d2d6db81bdba07f2"
Sep 10 23:57:43.205278 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.205262    2574 scope.go:117] "RemoveContainer" containerID="8264d25a0f004c77e7395561346329676694459e219916323ff3ea47fdc027f4"
Sep 10 23:57:43.205543 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:57:43.205525    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8264d25a0f004c77e7395561346329676694459e219916323ff3ea47fdc027f4\": container with ID starting with 8264d25a0f004c77e7395561346329676694459e219916323ff3ea47fdc027f4 not found: ID does not exist" containerID="8264d25a0f004c77e7395561346329676694459e219916323ff3ea47fdc027f4"
Sep 10 23:57:43.205615 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.205555    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8264d25a0f004c77e7395561346329676694459e219916323ff3ea47fdc027f4"} err="failed to get container status \"8264d25a0f004c77e7395561346329676694459e219916323ff3ea47fdc027f4\": rpc error: code = NotFound desc = could not find container \"8264d25a0f004c77e7395561346329676694459e219916323ff3ea47fdc027f4\": container with ID starting with 8264d25a0f004c77e7395561346329676694459e219916323ff3ea47fdc027f4 not found: ID does not exist"
Sep 10 23:57:43.205615 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.205579    2574 scope.go:117] "RemoveContainer" containerID="d8228567ba17d9e4030a4982f141946c0902278755d54d58d2d6db81bdba07f2"
Sep 10 23:57:43.205899 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:57:43.205881    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8228567ba17d9e4030a4982f141946c0902278755d54d58d2d6db81bdba07f2\": container with ID starting with d8228567ba17d9e4030a4982f141946c0902278755d54d58d2d6db81bdba07f2 not found: ID does not exist" containerID="d8228567ba17d9e4030a4982f141946c0902278755d54d58d2d6db81bdba07f2"
Sep 10 23:57:43.205946 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.205905    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8228567ba17d9e4030a4982f141946c0902278755d54d58d2d6db81bdba07f2"} err="failed to get container status \"d8228567ba17d9e4030a4982f141946c0902278755d54d58d2d6db81bdba07f2\": rpc error: code = NotFound desc = could not find container \"d8228567ba17d9e4030a4982f141946c0902278755d54d58d2d6db81bdba07f2\": container with ID starting with d8228567ba17d9e4030a4982f141946c0902278755d54d58d2d6db81bdba07f2 not found: ID does not exist"
Sep 10 23:57:43.225300 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.225277    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-credential-socket\") pod \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") "
Sep 10 23:57:43.225405 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.225317    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istiod-ca-cert\") pod \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") "
Sep 10 23:57:43.225405 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.225355    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lffx6\" (UniqueName: \"kubernetes.io/projected/842b27ae-6e31-4d60-8884-c6edfd10f4a4-kube-api-access-lffx6\") pod \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") "
Sep 10 23:57:43.225405 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.225381    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-envoy\") pod \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") "
Sep 10 23:57:43.225564 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.225420    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-workload-certs\") pod \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") "
Sep 10 23:57:43.225564 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.225465    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-token\") pod \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") "
Sep 10 23:57:43.225564 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.225537    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-workload-socket\") pod \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") "
Sep 10 23:57:43.225564 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.225534    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "842b27ae-6e31-4d60-8884-c6edfd10f4a4" (UID: "842b27ae-6e31-4d60-8884-c6edfd10f4a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:57:43.225795 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.225590    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-podinfo\") pod \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") "
Sep 10 23:57:43.225795 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.225632    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-data\") pod \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\" (UID: \"842b27ae-6e31-4d60-8884-c6edfd10f4a4\") "
Sep 10 23:57:43.225795 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.225780    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "842b27ae-6e31-4d60-8884-c6edfd10f4a4" (UID: "842b27ae-6e31-4d60-8884-c6edfd10f4a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:57:43.225943 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.225892    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "842b27ae-6e31-4d60-8884-c6edfd10f4a4" (UID: "842b27ae-6e31-4d60-8884-c6edfd10f4a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:57:43.226093 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.226047    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "842b27ae-6e31-4d60-8884-c6edfd10f4a4" (UID: "842b27ae-6e31-4d60-8884-c6edfd10f4a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:57:43.226093 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.226066    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "842b27ae-6e31-4d60-8884-c6edfd10f4a4" (UID: "842b27ae-6e31-4d60-8884-c6edfd10f4a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:57:43.226245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.226155    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-credential-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:43.226245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.226173    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istiod-ca-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:43.226245 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.226188    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-workload-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:43.227489 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.227470    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/842b27ae-6e31-4d60-8884-c6edfd10f4a4-kube-api-access-lffx6" (OuterVolumeSpecName: "kube-api-access-lffx6") pod "842b27ae-6e31-4d60-8884-c6edfd10f4a4" (UID: "842b27ae-6e31-4d60-8884-c6edfd10f4a4"). InnerVolumeSpecName "kube-api-access-lffx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:57:43.227780 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.227760    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "842b27ae-6e31-4d60-8884-c6edfd10f4a4" (UID: "842b27ae-6e31-4d60-8884-c6edfd10f4a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:57:43.227899 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.227883    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "842b27ae-6e31-4d60-8884-c6edfd10f4a4" (UID: "842b27ae-6e31-4d60-8884-c6edfd10f4a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:57:43.227979 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.227904    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "842b27ae-6e31-4d60-8884-c6edfd10f4a4" (UID: "842b27ae-6e31-4d60-8884-c6edfd10f4a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:57:43.327411 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.327389    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-token\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:43.327547 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.327530    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-podinfo\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:43.327618 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.327555    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-data\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:43.327618 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.327569    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lffx6\" (UniqueName: \"kubernetes.io/projected/842b27ae-6e31-4d60-8884-c6edfd10f4a4-kube-api-access-lffx6\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:43.327618 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.327582    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-istio-envoy\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:43.327618 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.327597    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/842b27ae-6e31-4d60-8884-c6edfd10f4a4-workload-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:57:43.503661 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.503596    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"]
Sep 10 23:57:43.506991 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:43.506966    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-57be92-openshift-default-87c799c7b-2fqst"]
Sep 10 23:57:45.256131 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:45.256097    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" path="/var/lib/kubelet/pods/842b27ae-6e31-4d60-8884-c6edfd10f4a4/volumes"
Sep 10 23:57:46.606032 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:46.606001    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:46.606032 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:46.606041    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:46.618649 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:46.618628    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:47.222058 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:47.222022    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:57:48.097803 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:48.097767    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:57:55.995346 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:55.995310    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:57:57.657111 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:57:57.657075    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:03.504795 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:03.504758    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:05.303854 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:05.303816    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:58:10.941151 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:10.941109    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"]
Sep 10 23:58:10.958997 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:10.958969    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:11.975509 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:11.975466    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"]
Sep 10 23:58:11.991017 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:11.990986    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:12.399188 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:12.399154    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:12.685107 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:12.685023    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:13.149183 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:13.149152    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:16.062143 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:16.062103    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:16.169315 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:16.169279    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:17.342986 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:17.342951    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:17.443515 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:17.443479    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:17.677666 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:17.677630    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:17.790806 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:17.790777    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:17.895367 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:17.895327    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:21.798092 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:21.798048    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:58:25.961704 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:25.961650    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh" podUID="87d3ffc3-131e-4fc0-a995-3e55ebf40968" containerName="main" containerID="cri-o://5779358fe916d8d77d124fdf4470580facd25c44a4e4f5a1244508787d8baad9" gracePeriod=45
Sep 10 23:58:25.995091 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:25.995056    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:26.211431 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.211409    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:58:26.304055 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.303981    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-model-cache\") pod \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") "
Sep 10 23:58:26.304213 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.304065    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-tmp-dir\") pod \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") "
Sep 10 23:58:26.304213 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.304097    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d3ffc3-131e-4fc0-a995-3e55ebf40968-tls-certs\") pod \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") "
Sep 10 23:58:26.304213 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.304113    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-dshm\") pod \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") "
Sep 10 23:58:26.304213 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.304130    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zdj8\" (UniqueName: \"kubernetes.io/projected/87d3ffc3-131e-4fc0-a995-3e55ebf40968-kube-api-access-6zdj8\") pod \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") "
Sep 10 23:58:26.304456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.304220    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-home\") pod \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\" (UID: \"87d3ffc3-131e-4fc0-a995-3e55ebf40968\") "
Sep 10 23:58:26.304456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.304219    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-model-cache" (OuterVolumeSpecName: "model-cache") pod "87d3ffc3-131e-4fc0-a995-3e55ebf40968" (UID: "87d3ffc3-131e-4fc0-a995-3e55ebf40968"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:58:26.304456 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.304397    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "87d3ffc3-131e-4fc0-a995-3e55ebf40968" (UID: "87d3ffc3-131e-4fc0-a995-3e55ebf40968"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:58:26.304633 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.304458    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-home" (OuterVolumeSpecName: "home") pod "87d3ffc3-131e-4fc0-a995-3e55ebf40968" (UID: "87d3ffc3-131e-4fc0-a995-3e55ebf40968"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:58:26.304633 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.304619    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:58:26.304767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.304636    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:58:26.304767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.304650    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:58:26.306334 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.306308    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87d3ffc3-131e-4fc0-a995-3e55ebf40968-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "87d3ffc3-131e-4fc0-a995-3e55ebf40968" (UID: "87d3ffc3-131e-4fc0-a995-3e55ebf40968"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:58:26.306334 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.306319    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-dshm" (OuterVolumeSpecName: "dshm") pod "87d3ffc3-131e-4fc0-a995-3e55ebf40968" (UID: "87d3ffc3-131e-4fc0-a995-3e55ebf40968"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:58:26.306334 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.306333    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d3ffc3-131e-4fc0-a995-3e55ebf40968-kube-api-access-6zdj8" (OuterVolumeSpecName: "kube-api-access-6zdj8") pod "87d3ffc3-131e-4fc0-a995-3e55ebf40968" (UID: "87d3ffc3-131e-4fc0-a995-3e55ebf40968"). InnerVolumeSpecName "kube-api-access-6zdj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:58:26.405546 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.405519    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d3ffc3-131e-4fc0-a995-3e55ebf40968-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:58:26.405546 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.405541    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d3ffc3-131e-4fc0-a995-3e55ebf40968-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:58:26.405546 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.405551    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zdj8\" (UniqueName: \"kubernetes.io/projected/87d3ffc3-131e-4fc0-a995-3e55ebf40968-kube-api-access-6zdj8\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:58:26.426306 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.426278    2574 generic.go:356] "Generic (PLEG): container finished" podID="87d3ffc3-131e-4fc0-a995-3e55ebf40968" containerID="5779358fe916d8d77d124fdf4470580facd25c44a4e4f5a1244508787d8baad9" exitCode=0
Sep 10 23:58:26.426410 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.426320    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"
Sep 10 23:58:26.426410 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.426372    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh" event={"ID":"87d3ffc3-131e-4fc0-a995-3e55ebf40968","Type":"ContainerDied","Data":"5779358fe916d8d77d124fdf4470580facd25c44a4e4f5a1244508787d8baad9"}
Sep 10 23:58:26.426540 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.426422    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh" event={"ID":"87d3ffc3-131e-4fc0-a995-3e55ebf40968","Type":"ContainerDied","Data":"93ab2a47eb17bcf87b64c7e7f122b026ab8f5a69a71166b36311342f8b4d20ab"}
Sep 10 23:58:26.426540 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.426447    2574 scope.go:117] "RemoveContainer" containerID="5779358fe916d8d77d124fdf4470580facd25c44a4e4f5a1244508787d8baad9"
Sep 10 23:58:26.435501 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.435475    2574 scope.go:117] "RemoveContainer" containerID="5779358fe916d8d77d124fdf4470580facd25c44a4e4f5a1244508787d8baad9"
Sep 10 23:58:26.435817 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:58:26.435797    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5779358fe916d8d77d124fdf4470580facd25c44a4e4f5a1244508787d8baad9\": container with ID starting with 5779358fe916d8d77d124fdf4470580facd25c44a4e4f5a1244508787d8baad9 not found: ID does not exist" containerID="5779358fe916d8d77d124fdf4470580facd25c44a4e4f5a1244508787d8baad9"
Sep 10 23:58:26.435891 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.435827    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5779358fe916d8d77d124fdf4470580facd25c44a4e4f5a1244508787d8baad9"} err="failed to get container status \"5779358fe916d8d77d124fdf4470580facd25c44a4e4f5a1244508787d8baad9\": rpc error: code = NotFound desc = could not find container \"5779358fe916d8d77d124fdf4470580facd25c44a4e4f5a1244508787d8baad9\": container with ID starting with 5779358fe916d8d77d124fdf4470580facd25c44a4e4f5a1244508787d8baad9 not found: ID does not exist"
Sep 10 23:58:26.446655 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.446629    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"]
Sep 10 23:58:26.450521 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.450497    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-0b637b/rate-test-model-0b637b-kserve-774dcc6f55-z6knh"]
Sep 10 23:58:26.994840 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:26.994793    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f" podUID="d7c06099-7a6e-4bda-b030-39568a2b0951" containerName="main" containerID="cri-o://80a38da9017f08f9b8623c095577feef4bd9388bab60322199e2fe16b988ba35" gracePeriod=45
Sep 10 23:58:27.244802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.244776    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:58:27.257544 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.257484    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87d3ffc3-131e-4fc0-a995-3e55ebf40968" path="/var/lib/kubelet/pods/87d3ffc3-131e-4fc0-a995-3e55ebf40968/volumes"
Sep 10 23:58:27.311864 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.311836    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-dshm\") pod \"d7c06099-7a6e-4bda-b030-39568a2b0951\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") "
Sep 10 23:58:27.312024 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.311898    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-tmp-dir\") pod \"d7c06099-7a6e-4bda-b030-39568a2b0951\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") "
Sep 10 23:58:27.312024 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.311934    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-model-cache\") pod \"d7c06099-7a6e-4bda-b030-39568a2b0951\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") "
Sep 10 23:58:27.312024 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.311989    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7c06099-7a6e-4bda-b030-39568a2b0951-tls-certs\") pod \"d7c06099-7a6e-4bda-b030-39568a2b0951\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") "
Sep 10 23:58:27.312024 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.312005    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-home\") pod \"d7c06099-7a6e-4bda-b030-39568a2b0951\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") "
Sep 10 23:58:27.312260 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.312050    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkxhb\" (UniqueName: \"kubernetes.io/projected/d7c06099-7a6e-4bda-b030-39568a2b0951-kube-api-access-nkxhb\") pod \"d7c06099-7a6e-4bda-b030-39568a2b0951\" (UID: \"d7c06099-7a6e-4bda-b030-39568a2b0951\") "
Sep 10 23:58:27.312260 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.312210    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d7c06099-7a6e-4bda-b030-39568a2b0951" (UID: "d7c06099-7a6e-4bda-b030-39568a2b0951"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:58:27.312260 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.312225    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-model-cache" (OuterVolumeSpecName: "model-cache") pod "d7c06099-7a6e-4bda-b030-39568a2b0951" (UID: "d7c06099-7a6e-4bda-b030-39568a2b0951"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:58:27.312418 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.312297    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-home" (OuterVolumeSpecName: "home") pod "d7c06099-7a6e-4bda-b030-39568a2b0951" (UID: "d7c06099-7a6e-4bda-b030-39568a2b0951"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:58:27.312418 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.312379    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:58:27.312418 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.312396    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:58:27.312418 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.312410    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:58:27.314000 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.313974    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-dshm" (OuterVolumeSpecName: "dshm") pod "d7c06099-7a6e-4bda-b030-39568a2b0951" (UID: "d7c06099-7a6e-4bda-b030-39568a2b0951"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:58:27.314000 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.313987    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7c06099-7a6e-4bda-b030-39568a2b0951-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d7c06099-7a6e-4bda-b030-39568a2b0951" (UID: "d7c06099-7a6e-4bda-b030-39568a2b0951"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:58:27.314144 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.314105    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7c06099-7a6e-4bda-b030-39568a2b0951-kube-api-access-nkxhb" (OuterVolumeSpecName: "kube-api-access-nkxhb") pod "d7c06099-7a6e-4bda-b030-39568a2b0951" (UID: "d7c06099-7a6e-4bda-b030-39568a2b0951"). InnerVolumeSpecName "kube-api-access-nkxhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:58:27.413226 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.413198    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7c06099-7a6e-4bda-b030-39568a2b0951-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:58:27.413226 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.413222    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkxhb\" (UniqueName: \"kubernetes.io/projected/d7c06099-7a6e-4bda-b030-39568a2b0951-kube-api-access-nkxhb\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:58:27.413375 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.413233    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7c06099-7a6e-4bda-b030-39568a2b0951-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 10 23:58:27.432850 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.432819    2574 generic.go:356] "Generic (PLEG): container finished" podID="d7c06099-7a6e-4bda-b030-39568a2b0951" containerID="80a38da9017f08f9b8623c095577feef4bd9388bab60322199e2fe16b988ba35" exitCode=0
Sep 10 23:58:27.432987 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.432860    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"
Sep 10 23:58:27.432987 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.432903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f" event={"ID":"d7c06099-7a6e-4bda-b030-39568a2b0951","Type":"ContainerDied","Data":"80a38da9017f08f9b8623c095577feef4bd9388bab60322199e2fe16b988ba35"}
Sep 10 23:58:27.432987 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.432942    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f" event={"ID":"d7c06099-7a6e-4bda-b030-39568a2b0951","Type":"ContainerDied","Data":"0dee7524d0420349d12b9184a0bb5a0be0e92cbd92779d088c7bbbcf5113baf2"}
Sep 10 23:58:27.432987 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.432965    2574 scope.go:117] "RemoveContainer" containerID="80a38da9017f08f9b8623c095577feef4bd9388bab60322199e2fe16b988ba35"
Sep 10 23:58:27.448600 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.448568    2574 scope.go:117] "RemoveContainer" containerID="80a38da9017f08f9b8623c095577feef4bd9388bab60322199e2fe16b988ba35"
Sep 10 23:58:27.448937 ip-10-0-135-1 kubenswrapper[2574]: E0910 23:58:27.448916    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80a38da9017f08f9b8623c095577feef4bd9388bab60322199e2fe16b988ba35\": container with ID starting with 80a38da9017f08f9b8623c095577feef4bd9388bab60322199e2fe16b988ba35 not found: ID does not exist" containerID="80a38da9017f08f9b8623c095577feef4bd9388bab60322199e2fe16b988ba35"
Sep 10 23:58:27.449012 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.448948    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80a38da9017f08f9b8623c095577feef4bd9388bab60322199e2fe16b988ba35"} err="failed to get container status \"80a38da9017f08f9b8623c095577feef4bd9388bab60322199e2fe16b988ba35\": rpc error: code = NotFound desc = could not find container \"80a38da9017f08f9b8623c095577feef4bd9388bab60322199e2fe16b988ba35\": container with ID starting with 80a38da9017f08f9b8623c095577feef4bd9388bab60322199e2fe16b988ba35 not found: ID does not exist"
Sep 10 23:58:27.457197 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.457175    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"]
Sep 10 23:58:27.460355 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:27.460332    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f"]
Sep 10 23:58:29.256835 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:29.256797    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7c06099-7a6e-4bda-b030-39568a2b0951" path="/var/lib/kubelet/pods/d7c06099-7a6e-4bda-b030-39568a2b0951/volumes"
Sep 10 23:58:32.211705 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:32.211657    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-w3-6d2e31/rate-test-model-6d2e31-kserve-6564547cc9-gwh8f" podUID="d7c06099-7a6e-4bda-b030-39568a2b0951" containerName="main" probeResult="failure" output="Get \"https://10.133.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:58:39.013515 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:39.013469    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:41.030047 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.030003    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:41.670308 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.670273    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:41.927331 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.927254    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"]
Sep 10 23:58:41.927617 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.927605    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy"
Sep 10 23:58:41.927664 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.927620    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy"
Sep 10 23:58:41.927664 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.927629    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7c06099-7a6e-4bda-b030-39568a2b0951" containerName="main"
Sep 10 23:58:41.927664 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.927634    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7c06099-7a6e-4bda-b030-39568a2b0951" containerName="main"
Sep 10 23:58:41.927802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.927688    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy"
Sep 10 23:58:41.927802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.927695    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy"
Sep 10 23:58:41.927802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.927700    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d3ffc3-131e-4fc0-a995-3e55ebf40968" containerName="main"
Sep 10 23:58:41.927802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.927706    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d3ffc3-131e-4fc0-a995-3e55ebf40968" containerName="main"
Sep 10 23:58:41.927802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.927792    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="87d3ffc3-131e-4fc0-a995-3e55ebf40968" containerName="main"
Sep 10 23:58:41.927802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.927798    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy"
Sep 10 23:58:41.927802 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.927806    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="842b27ae-6e31-4d60-8884-c6edfd10f4a4" containerName="istio-proxy"
Sep 10 23:58:41.928059 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.927812    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7c06099-7a6e-4bda-b030-39568a2b0951" containerName="main"
Sep 10 23:58:41.932292 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.932271    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:41.934787 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.934767    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-5453e3-openshift-default-dockercfg-bf5hd\""
Sep 10 23:58:41.935035 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.935014    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 23:58:41.943121 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.943099    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"]
Sep 10 23:58:41.958777 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:41.958749    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:42.034765 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.034739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45423275-8693-4802-8396-761ef870de93-istio-token\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.035083 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.034769    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45423275-8693-4802-8396-761ef870de93-istio-podinfo\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.035083 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.034824    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45423275-8693-4802-8396-761ef870de93-istiod-ca-cert\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.035083 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.034862    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-workload-socket\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.035083 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.034902    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-istio-envoy\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.035083 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.034929    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-credential-socket\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.035083 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.034957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6p2f\" (UniqueName: \"kubernetes.io/projected/45423275-8693-4802-8396-761ef870de93-kube-api-access-w6p2f\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.035083 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.034974    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-istio-data\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.035083 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.034994    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-workload-certs\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.135408 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.135382    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-workload-certs\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.135524 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.135439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45423275-8693-4802-8396-761ef870de93-istio-token\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.135524 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.135470    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45423275-8693-4802-8396-761ef870de93-istio-podinfo\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.135524 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.135494    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45423275-8693-4802-8396-761ef870de93-istiod-ca-cert\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.135524 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.135513    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-workload-socket\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.135819 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.135540    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-istio-envoy\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.135819 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.135568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-credential-socket\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.135819 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.135607    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6p2f\" (UniqueName: \"kubernetes.io/projected/45423275-8693-4802-8396-761ef870de93-kube-api-access-w6p2f\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.135819 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.135629    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-istio-data\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.136011 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.135899    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-workload-certs\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.136011 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.135946    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-workload-socket\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.136118 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.136013    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-istio-data\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.136118 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.136058    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-credential-socket\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.136356 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.136337    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45423275-8693-4802-8396-761ef870de93-istiod-ca-cert\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.137857 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.137836    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-istio-envoy\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.138087 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.138066    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45423275-8693-4802-8396-761ef870de93-istio-podinfo\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.143077 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.143048    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45423275-8693-4802-8396-761ef870de93-istio-token\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.143240 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.143225    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6p2f\" (UniqueName: \"kubernetes.io/projected/45423275-8693-4802-8396-761ef870de93-kube-api-access-w6p2f\") pod \"e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7\" (UID: \"45423275-8693-4802-8396-761ef870de93\") " pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.145830 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.145798    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:42.243111 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.243058    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:42.521847 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.521818    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"]
Sep 10 23:58:42.522920 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:58:42.522892    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45423275_8693_4802_8396_761ef870de93.slice/crio-256160ea5a6b4076f3571488e870ce0a7b9ebe43ba012fc888b4631ada85be18 WatchSource:0}: Error finding container 256160ea5a6b4076f3571488e870ce0a7b9ebe43ba012fc888b4631ada85be18: Status 404 returned error can't find the container with id 256160ea5a6b4076f3571488e870ce0a7b9ebe43ba012fc888b4631ada85be18
Sep 10 23:58:42.525211 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.525171    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:58:42.525305 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.525255    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:58:42.525305 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:42.525296    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:58:43.519767 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:43.519736    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" event={"ID":"45423275-8693-4802-8396-761ef870de93","Type":"ContainerStarted","Data":"28e0fa17a426a49c46815c26b930363520f89a42d193a09627fd706149178526"}
Sep 10 23:58:43.520163 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:43.519789    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" event={"ID":"45423275-8693-4802-8396-761ef870de93","Type":"ContainerStarted","Data":"256160ea5a6b4076f3571488e870ce0a7b9ebe43ba012fc888b4631ada85be18"}
Sep 10 23:58:43.538972 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:43.538925    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" podStartSLOduration=2.538912072 podStartE2EDuration="2.538912072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:58:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:58:43.537689485 +0000 UTC m=+1520.719847638" watchObservedRunningTime="2026-09-10 23:58:43.538912072 +0000 UTC m=+1520.721070200"
Sep 10 23:58:44.243496 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:44.243468    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:44.248272 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:44.248245    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:44.525507 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:44.525408    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:44.526266 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:44.526246    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:58:45.404300 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:45.404265    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:45.513620 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:45.513586    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:46.555968 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:46.555912    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:46.657453 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:46.657416    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:46.771983 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:46.771953    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:47.013422 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:47.013395    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:47.104618 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:47.104576    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:53.005308 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:58:53.005271    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:59:00.566910 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:00.566866    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 23:59:00.567408 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:00.566944    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" podUID="45423275-8693-4802-8396-761ef870de93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:59:02.624761 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:02.624704    2574 generic.go:356] "Generic (PLEG): container finished" podID="45423275-8693-4802-8396-761ef870de93" containerID="28e0fa17a426a49c46815c26b930363520f89a42d193a09627fd706149178526" exitCode=0
Sep 10 23:59:02.625193 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:02.624780    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" event={"ID":"45423275-8693-4802-8396-761ef870de93","Type":"ContainerDied","Data":"28e0fa17a426a49c46815c26b930363520f89a42d193a09627fd706149178526"}
Sep 10 23:59:02.625243 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:02.625200    2574 scope.go:117] "RemoveContainer" containerID="28e0fa17a426a49c46815c26b930363520f89a42d193a09627fd706149178526"
Sep 10 23:59:02.626299 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:02.626244    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:59:02.626400 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:02.626354    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:59:02.626465 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:02.626405    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:59:03.631842 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:03.631804    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" event={"ID":"45423275-8693-4802-8396-761ef870de93","Type":"ContainerStarted","Data":"a582f9efee2061e66e33b91ccd4d912ae62fed27de349b014870075b9d5e1293"}
Sep 10 23:59:04.243962 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:04.243929    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:59:04.244194 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:04.244171    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 23:59:04.244282 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:04.244228    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" podUID="45423275-8693-4802-8396-761ef870de93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 23:59:05.244538 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:05.244489    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 23:59:05.245082 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:05.244563    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" podUID="45423275-8693-4802-8396-761ef870de93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 23:59:06.243554 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:06.243503    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 23:59:06.243794 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:06.243577    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" podUID="45423275-8693-4802-8396-761ef870de93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 23:59:07.244544 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:07.244500    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 23:59:07.245197 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:07.245157    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" podUID="45423275-8693-4802-8396-761ef870de93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 23:59:08.244248 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:08.244208    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 23:59:08.244559 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:08.244528    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" podUID="45423275-8693-4802-8396-761ef870de93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 23:59:09.247746 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:09.247704    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:59:09.248156 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:09.247986    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:59:09.248702 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:09.248685    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 10 23:59:10.387470 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:10.387439    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:18.092600 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.092563    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"]
Sep 10 23:59:18.095184 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.095164    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.098888 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.098851    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-71c1cb\"/\"ipp-route-71c1cb-kserve-self-signed-certs\""
Sep 10 23:59:18.098888 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.098884    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-71c1cb\"/\"kube-root-ca.crt\""
Sep 10 23:59:18.099099 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.098892    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-71c1cb\"/\"openshift-service-ca.crt\""
Sep 10 23:59:18.099099 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.098861    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-71c1cb\"/\"default-dockercfg-djmx9\""
Sep 10 23:59:18.103382 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.103361    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"]
Sep 10 23:59:18.125028 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.124992    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:18.181465 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.181438    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xft9g\" (UniqueName: \"kubernetes.io/projected/e1637ea0-2630-4914-95ae-c7fcd9c65292-kube-api-access-xft9g\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.181625 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.181471    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1637ea0-2630-4914-95ae-c7fcd9c65292-tls-certs\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.181625 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.181499    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-home\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.181625 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.181594    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-tmp-dir\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.181762 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.181632    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-model-cache\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.181762 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.181663    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-dshm\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.282265 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.282239    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-model-cache\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.282410 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.282276    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-dshm\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.282410 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.282322    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xft9g\" (UniqueName: \"kubernetes.io/projected/e1637ea0-2630-4914-95ae-c7fcd9c65292-kube-api-access-xft9g\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.282410 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.282342    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1637ea0-2630-4914-95ae-c7fcd9c65292-tls-certs\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.282410 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.282371    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-home\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.282624 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.282420    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-tmp-dir\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.282682 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.282634    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-model-cache\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.282831 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.282804    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-home\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.282908 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.282828    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-tmp-dir\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.284702 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.284680    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-dshm\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.284874 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.284858    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1637ea0-2630-4914-95ae-c7fcd9c65292-tls-certs\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.290154 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.290131    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xft9g\" (UniqueName: \"kubernetes.io/projected/e1637ea0-2630-4914-95ae-c7fcd9c65292-kube-api-access-xft9g\") pod \"ipp-route-71c1cb-kserve-789fdd5795-59qr4\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") " pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.406017 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.405990    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:18.677757 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.677722    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"]
Sep 10 23:59:18.679483 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:59:18.679453    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1637ea0_2630_4914_95ae_c7fcd9c65292.slice/crio-c8f7d2806fc23baee6a259c01abbc548b4e5a5c248625fbe7626cab8684d02b0 WatchSource:0}: Error finding container c8f7d2806fc23baee6a259c01abbc548b4e5a5c248625fbe7626cab8684d02b0: Status 404 returned error can't find the container with id c8f7d2806fc23baee6a259c01abbc548b4e5a5c248625fbe7626cab8684d02b0
Sep 10 23:59:18.731006 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:18.730972    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4" event={"ID":"e1637ea0-2630-4914-95ae-c7fcd9c65292","Type":"ContainerStarted","Data":"c8f7d2806fc23baee6a259c01abbc548b4e5a5c248625fbe7626cab8684d02b0"}
Sep 10 23:59:19.739183 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:19.739135    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4" event={"ID":"e1637ea0-2630-4914-95ae-c7fcd9c65292","Type":"ContainerStarted","Data":"7729ef7be3ad6bd6cfdbc61b8359a11f887f03a3a32e361fef587f49bb34b437"}
Sep 10 23:59:19.755963 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:19.755916    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4" podStartSLOduration=1.755902749 podStartE2EDuration="1.755902749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:59:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:59:19.753968239 +0000 UTC m=+1556.936126378" watchObservedRunningTime="2026-09-10 23:59:19.755902749 +0000 UTC m=+1556.938060877"
Sep 10 23:59:22.096642 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:22.096608    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:59:28.407052 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:28.407014    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:28.407540 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:28.407072    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:28.419411 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:28.419384    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:28.799297 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:28.799210    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 10 23:59:49.794074 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:49.794033    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 10 23:59:56.508037 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.507991    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:56.785904 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.785816    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"]
Sep 10 23:59:56.788648 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.788626    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.791251 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.791231    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-8405fd-openshift-default-dockercfg-tddcq\""
Sep 10 23:59:56.799179 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.799157    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"]
Sep 10 23:59:56.807371 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.807346    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:56.817619 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.817594    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-workload-certs\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.817980 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.817950    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-podinfo\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.818131 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.818112    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-data\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.818218 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.818199    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-credential-socket\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.818276 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.818227    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-envoy\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.818276 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.818250    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-workload-socket\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.818397 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.818293    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.818397 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.818339    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwkz5\" (UniqueName: \"kubernetes.io/projected/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-kube-api-access-mwkz5\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.818397 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.818379    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-token\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.919158 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.919119    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-credential-socket\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.919158 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.919158    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-envoy\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.919410 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.919188    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-workload-socket\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.919410 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.919217    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.919410 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.919259    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwkz5\" (UniqueName: \"kubernetes.io/projected/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-kube-api-access-mwkz5\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.919573 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.919458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-token\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.919573 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.919545    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-workload-certs\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.919685 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.919592    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-podinfo\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.919685 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.919626    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-credential-socket\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.919685 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.919659    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-workload-socket\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.919888 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.919690    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-data\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.920048 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.920018    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-workload-certs\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.920146 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.920083    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-data\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.920346 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.920326    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.921792 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.921773    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-envoy\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.922107 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.922088    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-podinfo\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.927021 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.926997    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-token\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:56.927363 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:56.927339    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwkz5\" (UniqueName: \"kubernetes.io/projected/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-kube-api-access-mwkz5\") pod \"e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") " pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:57.099851 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:57.099768    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:57.291203 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:57.291170    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:57.373937 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:57.373914    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"]
Sep 10 23:59:57.375357 ip-10-0-135-1 kubenswrapper[2574]: W0910 23:59:57.375318    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7df086d_be73_4c6c_8bd9_0dee2b7ec20d.slice/crio-ad2ccbccabe917352fc80d5e174c4ebbcfe0e7801abf0b8385bafb8588f0bdf0 WatchSource:0}: Error finding container ad2ccbccabe917352fc80d5e174c4ebbcfe0e7801abf0b8385bafb8588f0bdf0: Status 404 returned error can't find the container with id ad2ccbccabe917352fc80d5e174c4ebbcfe0e7801abf0b8385bafb8588f0bdf0
Sep 10 23:59:57.377722 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:57.377669    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:59:57.377799 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:57.377778    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:59:57.377844 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:57.377828    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:59:57.941932 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:57.941902    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" event={"ID":"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d","Type":"ContainerStarted","Data":"9dd82dd214dceb9d887a3ede2d6cd9a7434aa54888fd5d211ed1496a3de43a70"}
Sep 10 23:59:57.942306 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:57.941950    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" event={"ID":"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d","Type":"ContainerStarted","Data":"ad2ccbccabe917352fc80d5e174c4ebbcfe0e7801abf0b8385bafb8588f0bdf0"}
Sep 10 23:59:57.964073 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:57.964024    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" podStartSLOduration=1.964008974 podStartE2EDuration="1.964008974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:59:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:59:57.961696728 +0000 UTC m=+1595.143854856" watchObservedRunningTime="2026-09-10 23:59:57.964008974 +0000 UTC m=+1595.146167101"
Sep 10 23:59:58.100783 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:58.100750    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:58.105961 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:58.105935    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:58.947009 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:58.946978    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:58.948038 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:58.948017    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 10 23:59:59.839445 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:59.839405    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:59.931902 ip-10-0-135-1 kubenswrapper[2574]: I0910 23:59:59.931870    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:00.204660 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.204621    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4"]
Sep 11 00:00:00.207364 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.207345    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl"]
Sep 11 00:00:00.207471 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.207454    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4"
Sep 11 00:00:00.209507 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.209487    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl"
Sep 11 00:00:00.212025 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.211997    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-55278\""
Sep 11 00:00:00.213816 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.213791    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl"]
Sep 11 00:00:00.216394 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.216375    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl"
Sep 11 00:00:00.236298 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.236269    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4"]
Sep 11 00:00:00.249991 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.249962    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl"]
Sep 11 00:00:00.263192 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.263053    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4"
Sep 11 00:00:00.263705 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.263676    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl"]
Sep 11 00:00:00.273687 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.273666    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl"
Sep 11 00:00:00.313858 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.313835    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl"
Sep 11 00:00:00.548776 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.548746    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4"]
Sep 11 00:00:00.550694 ip-10-0-135-1 kubenswrapper[2574]: W0911 00:00:00.550652    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d76978f_9317_437f_be2e_079bbc687802.slice/crio-ee4b204eb4d371ea9b442f8478f5c59405b7efb5fca3724507a6a7496ffdd422 WatchSource:0}: Error finding container ee4b204eb4d371ea9b442f8478f5c59405b7efb5fca3724507a6a7496ffdd422: Status 404 returned error can't find the container with id ee4b204eb4d371ea9b442f8478f5c59405b7efb5fca3724507a6a7496ffdd422
Sep 11 00:00:00.567957 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.567930    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl"]
Sep 11 00:00:00.570760 ip-10-0-135-1 kubenswrapper[2574]: W0911 00:00:00.570727    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4af63c_1ffc_42ed_8198_4eb01effb06a.slice/crio-420ad898d0a2299d56094de9480fc4b98933e5077cf1d201391b303e951bc31d WatchSource:0}: Error finding container 420ad898d0a2299d56094de9480fc4b98933e5077cf1d201391b303e951bc31d: Status 404 returned error can't find the container with id 420ad898d0a2299d56094de9480fc4b98933e5077cf1d201391b303e951bc31d
Sep 11 00:00:00.619409 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.619375    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl"]
Sep 11 00:00:00.620661 ip-10-0-135-1 kubenswrapper[2574]: W0911 00:00:00.620632    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda862d89a_b2ce_4273_9d3d_98523eb176cb.slice/crio-a178c9bda8bd8b363c8910cc44ba9afad9b1c2bf38a2d253433953b498f347c2 WatchSource:0}: Error finding container a178c9bda8bd8b363c8910cc44ba9afad9b1c2bf38a2d253433953b498f347c2: Status 404 returned error can't find the container with id a178c9bda8bd8b363c8910cc44ba9afad9b1c2bf38a2d253433953b498f347c2
Sep 11 00:00:00.959500 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.959470    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl" event={"ID":"ea4af63c-1ffc-42ed-8198-4eb01effb06a","Type":"ContainerStarted","Data":"5262047fafd787733c2316b2a20fbc009b816d78bad6b1596862a91ff7c0de57"}
Sep 11 00:00:00.959627 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.959533    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl" event={"ID":"ea4af63c-1ffc-42ed-8198-4eb01effb06a","Type":"ContainerStarted","Data":"420ad898d0a2299d56094de9480fc4b98933e5077cf1d201391b303e951bc31d"}
Sep 11 00:00:00.961098 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.961075    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4" event={"ID":"3d76978f-9317-437f-be2e-079bbc687802","Type":"ContainerStarted","Data":"d306a01cb6087816b2e725db88c7faa9d8bdeaf85ac86ebc97da71ad19dd5720"}
Sep 11 00:00:00.961219 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.961122    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4" event={"ID":"3d76978f-9317-437f-be2e-079bbc687802","Type":"ContainerStarted","Data":"ee4b204eb4d371ea9b442f8478f5c59405b7efb5fca3724507a6a7496ffdd422"}
Sep 11 00:00:00.962686 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.962663    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl" event={"ID":"a862d89a-b2ce-4273-9d3d-98523eb176cb","Type":"ContainerStarted","Data":"a7552f47145f75a331a8dc83f33b385c3da9f807c328327978ec18dd1ec6a313"}
Sep 11 00:00:00.962816 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.962722    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl" event={"ID":"a862d89a-b2ce-4273-9d3d-98523eb176cb","Type":"ContainerStarted","Data":"a178c9bda8bd8b363c8910cc44ba9afad9b1c2bf38a2d253433953b498f347c2"}
Sep 11 00:00:00.975194 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.975156    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl" podStartSLOduration=0.97514143 podStartE2EDuration="975.14143ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:00:00.973360476 +0000 UTC m=+1598.155518604" watchObservedRunningTime="2026-09-11 00:00:00.97514143 +0000 UTC m=+1598.157299589"
Sep 11 00:00:00.997895 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:00.997850    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4" podStartSLOduration=0.997832416 podStartE2EDuration="997.832416ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:00:00.995705004 +0000 UTC m=+1598.177863132" watchObservedRunningTime="2026-09-11 00:00:00.997832416 +0000 UTC m=+1598.179990545"
Sep 11 00:00:01.022477 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:01.022427    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl" podStartSLOduration=1.022412024 podStartE2EDuration="1.022412024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:00:01.020262105 +0000 UTC m=+1598.202420234" watchObservedRunningTime="2026-09-11 00:00:01.022412024 +0000 UTC m=+1598.204570152"
Sep 11 00:00:01.065370 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:01.065338    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:01.166502 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:01.166461    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:01.659466 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:01.659440    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:01.890207 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:01.890176    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:01.969785 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:01.969745    2574 generic.go:356] "Generic (PLEG): container finished" podID="ea4af63c-1ffc-42ed-8198-4eb01effb06a" containerID="5262047fafd787733c2316b2a20fbc009b816d78bad6b1596862a91ff7c0de57" exitCode=0
Sep 11 00:00:01.969972 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:01.969827    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl" event={"ID":"ea4af63c-1ffc-42ed-8198-4eb01effb06a","Type":"ContainerDied","Data":"5262047fafd787733c2316b2a20fbc009b816d78bad6b1596862a91ff7c0de57"}
Sep 11 00:00:01.971279 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:01.971256    2574 generic.go:356] "Generic (PLEG): container finished" podID="3d76978f-9317-437f-be2e-079bbc687802" containerID="d306a01cb6087816b2e725db88c7faa9d8bdeaf85ac86ebc97da71ad19dd5720" exitCode=0
Sep 11 00:00:01.971398 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:01.971338    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4" event={"ID":"3d76978f-9317-437f-be2e-079bbc687802","Type":"ContainerDied","Data":"d306a01cb6087816b2e725db88c7faa9d8bdeaf85ac86ebc97da71ad19dd5720"}
Sep 11 00:00:01.972871 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:01.972850    2574 generic.go:356] "Generic (PLEG): container finished" podID="a862d89a-b2ce-4273-9d3d-98523eb176cb" containerID="a7552f47145f75a331a8dc83f33b385c3da9f807c328327978ec18dd1ec6a313" exitCode=0
Sep 11 00:00:01.972983 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:01.972895    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl" event={"ID":"a862d89a-b2ce-4273-9d3d-98523eb176cb","Type":"ContainerDied","Data":"a7552f47145f75a331a8dc83f33b385c3da9f807c328327978ec18dd1ec6a313"}
Sep 11 00:00:03.164555 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:03.164527    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl"
Sep 11 00:00:03.165633 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:03.165611    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4"
Sep 11 00:00:03.166688 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:03.166670    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl"
Sep 11 00:00:03.985094 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:03.985058    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl"
Sep 11 00:00:03.985094 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:03.985071    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl" event={"ID":"ea4af63c-1ffc-42ed-8198-4eb01effb06a","Type":"ContainerDied","Data":"420ad898d0a2299d56094de9480fc4b98933e5077cf1d201391b303e951bc31d"}
Sep 11 00:00:03.985325 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:03.985118    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="420ad898d0a2299d56094de9480fc4b98933e5077cf1d201391b303e951bc31d"
Sep 11 00:00:03.986507 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:03.986485    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4"
Sep 11 00:00:03.986624 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:03.986486    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4" event={"ID":"3d76978f-9317-437f-be2e-079bbc687802","Type":"ContainerDied","Data":"ee4b204eb4d371ea9b442f8478f5c59405b7efb5fca3724507a6a7496ffdd422"}
Sep 11 00:00:03.986624 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:03.986618    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee4b204eb4d371ea9b442f8478f5c59405b7efb5fca3724507a6a7496ffdd422"
Sep 11 00:00:03.987982 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:03.987960    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl" event={"ID":"a862d89a-b2ce-4273-9d3d-98523eb176cb","Type":"ContainerDied","Data":"a178c9bda8bd8b363c8910cc44ba9afad9b1c2bf38a2d253433953b498f347c2"}
Sep 11 00:00:03.988076 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:03.987993    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl"
Sep 11 00:00:03.988076 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:03.988006    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a178c9bda8bd8b363c8910cc44ba9afad9b1c2bf38a2d253433953b498f347c2"
Sep 11 00:00:04.498273 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:04.498239    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:00:14.186604 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:14.186467    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": read tcp 10.133.0.2:60464->10.133.0.78:15021: read: connection reset by peer" start-of-body=
Sep 11 00:00:14.186604 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:14.186549    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": read tcp 10.133.0.2:60464->10.133.0.78:15021: read: connection reset by peer"
Sep 11 00:00:15.052544 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:15.052508    2574 generic.go:356] "Generic (PLEG): container finished" podID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerID="9dd82dd214dceb9d887a3ede2d6cd9a7434aa54888fd5d211ed1496a3de43a70" exitCode=0
Sep 11 00:00:15.052764 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:15.052559    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" event={"ID":"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d","Type":"ContainerDied","Data":"9dd82dd214dceb9d887a3ede2d6cd9a7434aa54888fd5d211ed1496a3de43a70"}
Sep 11 00:00:15.053053 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:15.053035    2574 scope.go:117] "RemoveContainer" containerID="9dd82dd214dceb9d887a3ede2d6cd9a7434aa54888fd5d211ed1496a3de43a70"
Sep 11 00:00:15.054115 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:15.054083    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 00:00:15.054194 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:15.054155    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 00:00:15.054194 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:15.054186    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 00:00:16.064934 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:16.064846    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" event={"ID":"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d","Type":"ContainerStarted","Data":"ae1d4b856cd049f5b21c20d638e26bf1e1a54423f121da620dee29ecc506aa98"}
Sep 11 00:00:16.100279 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:16.100250    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 11 00:00:16.100474 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:16.100422    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 11 00:00:16.100552 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:16.100479    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 11 00:00:17.100958 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:17.100927    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 11 00:00:17.101350 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:17.100983    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 11 00:00:18.101032 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:18.100993    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 11 00:00:18.101478 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:18.101049    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 11 00:00:19.100645 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:19.100605    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 11 00:00:19.100860 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:19.100680    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 11 00:00:20.100437 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:20.100402    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 11 00:00:20.100880 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:20.100474    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 11 00:00:21.100825 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:21.100790    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 11 00:00:21.101225 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:21.100856    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 11 00:00:22.103520 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:22.103488    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 11 00:00:22.103997 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:22.103836    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 11 00:00:22.104646 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:22.104630    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 11 00:00:24.834069 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:24.834030    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:25.494409 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.494378    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w"]
Sep 11 00:00:25.494779 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.494765    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a862d89a-b2ce-4273-9d3d-98523eb176cb" containerName="cleanup"
Sep 11 00:00:25.494828 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.494780    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a862d89a-b2ce-4273-9d3d-98523eb176cb" containerName="cleanup"
Sep 11 00:00:25.494828 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.494806    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d76978f-9317-437f-be2e-079bbc687802" containerName="cleanup"
Sep 11 00:00:25.494828 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.494811    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d76978f-9317-437f-be2e-079bbc687802" containerName="cleanup"
Sep 11 00:00:25.494828 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.494819    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea4af63c-1ffc-42ed-8198-4eb01effb06a" containerName="cleanup"
Sep 11 00:00:25.494828 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.494824    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea4af63c-1ffc-42ed-8198-4eb01effb06a" containerName="cleanup"
Sep 11 00:00:25.494988 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.494881    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea4af63c-1ffc-42ed-8198-4eb01effb06a" containerName="cleanup"
Sep 11 00:00:25.494988 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.494889    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d76978f-9317-437f-be2e-079bbc687802" containerName="cleanup"
Sep 11 00:00:25.494988 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.494898    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a862d89a-b2ce-4273-9d3d-98523eb176cb" containerName="cleanup"
Sep 11 00:00:25.496877 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.496860    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w"
Sep 11 00:00:25.499136 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.499114    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-55278\""
Sep 11 00:00:25.499239 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.499140    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 00:00:25.505091 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.504819    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w"]
Sep 11 00:00:25.598807 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.598772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce007f6c-2de3-4935-89f8-9a3878d4030f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w\" (UID: \"ce007f6c-2de3-4935-89f8-9a3878d4030f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w"
Sep 11 00:00:25.699570 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.699530    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce007f6c-2de3-4935-89f8-9a3878d4030f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w\" (UID: \"ce007f6c-2de3-4935-89f8-9a3878d4030f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w"
Sep 11 00:00:25.700211 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.700188    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce007f6c-2de3-4935-89f8-9a3878d4030f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w\" (UID: \"ce007f6c-2de3-4935-89f8-9a3878d4030f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w"
Sep 11 00:00:25.808946 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:25.808850    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w"
Sep 11 00:00:26.077095 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:26.077062    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w"]
Sep 11 00:00:26.078134 ip-10-0-135-1 kubenswrapper[2574]: W0911 00:00:26.078099    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce007f6c_2de3_4935_89f8_9a3878d4030f.slice/crio-6bead54e2ce61730a0e9b2938b098a660f9adca046229315dca66d2e7e24f724 WatchSource:0}: Error finding container 6bead54e2ce61730a0e9b2938b098a660f9adca046229315dca66d2e7e24f724: Status 404 returned error can't find the container with id 6bead54e2ce61730a0e9b2938b098a660f9adca046229315dca66d2e7e24f724
Sep 11 00:00:26.122307 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:26.122282    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w" event={"ID":"ce007f6c-2de3-4935-89f8-9a3878d4030f","Type":"ContainerStarted","Data":"6bead54e2ce61730a0e9b2938b098a660f9adca046229315dca66d2e7e24f724"}
Sep 11 00:00:27.130139 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:27.130106    2574 generic.go:356] "Generic (PLEG): container finished" podID="ce007f6c-2de3-4935-89f8-9a3878d4030f" containerID="cb3c352e0e294ff6aa4c6310c98035d0fd476a0f751642c0ba5172b43a24b460" exitCode=0
Sep 11 00:00:27.130549 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:27.130193    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w" event={"ID":"ce007f6c-2de3-4935-89f8-9a3878d4030f","Type":"ContainerDied","Data":"cb3c352e0e294ff6aa4c6310c98035d0fd476a0f751642c0ba5172b43a24b460"}
Sep 11 00:00:28.270377 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:28.270347    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w"
Sep 11 00:00:28.324940 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:28.324908    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce007f6c-2de3-4935-89f8-9a3878d4030f-maas-api-service-ca\") pod \"ce007f6c-2de3-4935-89f8-9a3878d4030f\" (UID: \"ce007f6c-2de3-4935-89f8-9a3878d4030f\") "
Sep 11 00:00:28.325293 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:28.325267    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce007f6c-2de3-4935-89f8-9a3878d4030f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ce007f6c-2de3-4935-89f8-9a3878d4030f" (UID: "ce007f6c-2de3-4935-89f8-9a3878d4030f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:00:28.425655 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:28.425572    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce007f6c-2de3-4935-89f8-9a3878d4030f-maas-api-service-ca\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:00:29.148784 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:29.148749    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w"
Sep 11 00:00:29.148960 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:29.148779    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w" event={"ID":"ce007f6c-2de3-4935-89f8-9a3878d4030f","Type":"ContainerDied","Data":"6bead54e2ce61730a0e9b2938b098a660f9adca046229315dca66d2e7e24f724"}
Sep 11 00:00:29.148960 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:29.148855    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bead54e2ce61730a0e9b2938b098a660f9adca046229315dca66d2e7e24f724"
Sep 11 00:00:31.507601 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:31.507560    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:31.571779 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:31.571739    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:31.635528 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:31.635491    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:31.685198 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:31.685158    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w"]
Sep 11 00:00:31.688278 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:31.688248    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8405fd-7nv9w"]
Sep 11 00:00:31.693058 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:31.693028    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:32.358172 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:32.358131    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:33.257894 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:33.257863    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce007f6c-2de3-4935-89f8-9a3878d4030f" path="/var/lib/kubelet/pods/ce007f6c-2de3-4935-89f8-9a3878d4030f/volumes"
Sep 11 00:00:36.660555 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:36.660517    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:00:37.883294 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:37.883256    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:37.955516 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:37.955476    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:38.115914 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:38.115884    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"]
Sep 11 00:00:38.116122 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:38.116095    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy" containerID="cri-o://ae1d4b856cd049f5b21c20d638e26bf1e1a54423f121da620dee29ecc506aa98" gracePeriod=30
Sep 11 00:00:38.140231 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:38.140154    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:41.730212 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:41.730167    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:43.367115 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.367089    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 11 00:00:43.468558 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.468492    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-workload-socket\") pod \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") "
Sep 11 00:00:43.468558 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.468530    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-workload-certs\") pod \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") "
Sep 11 00:00:43.468974 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.468573    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-podinfo\") pod \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") "
Sep 11 00:00:43.468974 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.468590    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwkz5\" (UniqueName: \"kubernetes.io/projected/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-kube-api-access-mwkz5\") pod \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") "
Sep 11 00:00:43.468974 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.468612    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-token\") pod \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") "
Sep 11 00:00:43.468974 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.468630    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-envoy\") pod \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") "
Sep 11 00:00:43.468974 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.468693    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-data\") pod \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") "
Sep 11 00:00:43.468974 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.468769    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istiod-ca-cert\") pod \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") "
Sep 11 00:00:43.468974 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.468796    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-credential-socket\") pod \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\" (UID: \"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d\") "
Sep 11 00:00:43.468974 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.468806    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" (UID: "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:00:43.469341 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.468966    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" (UID: "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:00:43.469341 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.469045    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-data" (OuterVolumeSpecName: "istio-data") pod "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" (UID: "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:00:43.469341 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.469090    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-workload-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:00:43.469341 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.469110    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-workload-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:00:43.469341 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.469210    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" (UID: "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:00:43.469341 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.469232    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" (UID: "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:00:43.470857 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.470831    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" (UID: "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 00:00:43.470958 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.470865    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" (UID: "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:00:43.470958 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.470873    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-token" (OuterVolumeSpecName: "istio-token") pod "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" (UID: "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:00:43.471088 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.471072    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-kube-api-access-mwkz5" (OuterVolumeSpecName: "kube-api-access-mwkz5") pod "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" (UID: "c7df086d-be73-4c6c-8bd9-0dee2b7ec20d"). InnerVolumeSpecName "kube-api-access-mwkz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:00:43.569566 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.569541    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-podinfo\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:00:43.569566 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.569564    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwkz5\" (UniqueName: \"kubernetes.io/projected/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-kube-api-access-mwkz5\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:00:43.569703 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.569573    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-token\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:00:43.569703 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.569581    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-envoy\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:00:43.569703 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.569589    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istio-data\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:00:43.569703 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.569596    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-istiod-ca-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:00:43.569703 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:43.569604    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d-credential-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:00:44.234185 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:44.234148    2574 generic.go:356] "Generic (PLEG): container finished" podID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerID="ae1d4b856cd049f5b21c20d638e26bf1e1a54423f121da620dee29ecc506aa98" exitCode=0
Sep 11 00:00:44.234350 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:44.234195    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"
Sep 11 00:00:44.234350 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:44.234233    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" event={"ID":"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d","Type":"ContainerDied","Data":"ae1d4b856cd049f5b21c20d638e26bf1e1a54423f121da620dee29ecc506aa98"}
Sep 11 00:00:44.234350 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:44.234288    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6" event={"ID":"c7df086d-be73-4c6c-8bd9-0dee2b7ec20d","Type":"ContainerDied","Data":"ad2ccbccabe917352fc80d5e174c4ebbcfe0e7801abf0b8385bafb8588f0bdf0"}
Sep 11 00:00:44.234350 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:44.234312    2574 scope.go:117] "RemoveContainer" containerID="ae1d4b856cd049f5b21c20d638e26bf1e1a54423f121da620dee29ecc506aa98"
Sep 11 00:00:44.244180 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:44.244169    2574 scope.go:117] "RemoveContainer" containerID="9dd82dd214dceb9d887a3ede2d6cd9a7434aa54888fd5d211ed1496a3de43a70"
Sep 11 00:00:44.252364 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:44.252342    2574 scope.go:117] "RemoveContainer" containerID="ae1d4b856cd049f5b21c20d638e26bf1e1a54423f121da620dee29ecc506aa98"
Sep 11 00:00:44.252761 ip-10-0-135-1 kubenswrapper[2574]: E0911 00:00:44.252703    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae1d4b856cd049f5b21c20d638e26bf1e1a54423f121da620dee29ecc506aa98\": container with ID starting with ae1d4b856cd049f5b21c20d638e26bf1e1a54423f121da620dee29ecc506aa98 not found: ID does not exist" containerID="ae1d4b856cd049f5b21c20d638e26bf1e1a54423f121da620dee29ecc506aa98"
Sep 11 00:00:44.252870 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:44.252772    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae1d4b856cd049f5b21c20d638e26bf1e1a54423f121da620dee29ecc506aa98"} err="failed to get container status \"ae1d4b856cd049f5b21c20d638e26bf1e1a54423f121da620dee29ecc506aa98\": rpc error: code = NotFound desc = could not find container \"ae1d4b856cd049f5b21c20d638e26bf1e1a54423f121da620dee29ecc506aa98\": container with ID starting with ae1d4b856cd049f5b21c20d638e26bf1e1a54423f121da620dee29ecc506aa98 not found: ID does not exist"
Sep 11 00:00:44.252870 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:44.252813    2574 scope.go:117] "RemoveContainer" containerID="9dd82dd214dceb9d887a3ede2d6cd9a7434aa54888fd5d211ed1496a3de43a70"
Sep 11 00:00:44.253166 ip-10-0-135-1 kubenswrapper[2574]: E0911 00:00:44.253140    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dd82dd214dceb9d887a3ede2d6cd9a7434aa54888fd5d211ed1496a3de43a70\": container with ID starting with 9dd82dd214dceb9d887a3ede2d6cd9a7434aa54888fd5d211ed1496a3de43a70 not found: ID does not exist" containerID="9dd82dd214dceb9d887a3ede2d6cd9a7434aa54888fd5d211ed1496a3de43a70"
Sep 11 00:00:44.253211 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:44.253176    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd82dd214dceb9d887a3ede2d6cd9a7434aa54888fd5d211ed1496a3de43a70"} err="failed to get container status \"9dd82dd214dceb9d887a3ede2d6cd9a7434aa54888fd5d211ed1496a3de43a70\": rpc error: code = NotFound desc = could not find container \"9dd82dd214dceb9d887a3ede2d6cd9a7434aa54888fd5d211ed1496a3de43a70\": container with ID starting with 9dd82dd214dceb9d887a3ede2d6cd9a7434aa54888fd5d211ed1496a3de43a70 not found: ID does not exist"
Sep 11 00:00:44.255436 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:44.255418    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"]
Sep 11 00:00:44.261178 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:44.261159    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8405fd-openshift-default-68b4d8c566-lnsc6"]
Sep 11 00:00:45.255567 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:45.255534    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" path="/var/lib/kubelet/pods/c7df086d-be73-4c6c-8bd9-0dee2b7ec20d/volumes"
Sep 11 00:00:55.201429 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:55.201394    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:00:57.039575 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:57.039536    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4"]
Sep 11 00:00:57.041784 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:57.041758    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-71c1cb-29818080-nzfv4"]
Sep 11 00:00:57.256432 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:57.256398    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d76978f-9317-437f-be2e-079bbc687802" path="/var/lib/kubelet/pods/3d76978f-9317-437f-be2e-079bbc687802/volumes"
Sep 11 00:00:57.827006 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:57.826968    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:57.880843 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:00:57.880817    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:02.572771 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:02.572726    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"]
Sep 11 00:01:02.668513 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:02.668473    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:07.095884 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:07.095845    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:01:08.923931 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:08.923897    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:17.591637 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.591588    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4" podUID="e1637ea0-2630-4914-95ae-c7fcd9c65292" containerName="main" containerID="cri-o://7729ef7be3ad6bd6cfdbc61b8359a11f887f03a3a32e361fef587f49bb34b437" gracePeriod=45
Sep 11 00:01:17.834545 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.834522    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 11 00:01:17.867438 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.867415    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-home\") pod \"e1637ea0-2630-4914-95ae-c7fcd9c65292\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") "
Sep 11 00:01:17.867601 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.867452    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-dshm\") pod \"e1637ea0-2630-4914-95ae-c7fcd9c65292\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") "
Sep 11 00:01:17.867601 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.867485    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xft9g\" (UniqueName: \"kubernetes.io/projected/e1637ea0-2630-4914-95ae-c7fcd9c65292-kube-api-access-xft9g\") pod \"e1637ea0-2630-4914-95ae-c7fcd9c65292\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") "
Sep 11 00:01:17.867601 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.867513    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-tmp-dir\") pod \"e1637ea0-2630-4914-95ae-c7fcd9c65292\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") "
Sep 11 00:01:17.867601 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.867545    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1637ea0-2630-4914-95ae-c7fcd9c65292-tls-certs\") pod \"e1637ea0-2630-4914-95ae-c7fcd9c65292\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") "
Sep 11 00:01:17.867601 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.867589    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-model-cache\") pod \"e1637ea0-2630-4914-95ae-c7fcd9c65292\" (UID: \"e1637ea0-2630-4914-95ae-c7fcd9c65292\") "
Sep 11 00:01:17.867965 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.867766    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-home" (OuterVolumeSpecName: "home") pod "e1637ea0-2630-4914-95ae-c7fcd9c65292" (UID: "e1637ea0-2630-4914-95ae-c7fcd9c65292"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:17.868022 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.867970    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-model-cache" (OuterVolumeSpecName: "model-cache") pod "e1637ea0-2630-4914-95ae-c7fcd9c65292" (UID: "e1637ea0-2630-4914-95ae-c7fcd9c65292"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:17.868082 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.868017    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-home\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:01:17.868173 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.868144    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e1637ea0-2630-4914-95ae-c7fcd9c65292" (UID: "e1637ea0-2630-4914-95ae-c7fcd9c65292"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:17.870005 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.869979    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-dshm" (OuterVolumeSpecName: "dshm") pod "e1637ea0-2630-4914-95ae-c7fcd9c65292" (UID: "e1637ea0-2630-4914-95ae-c7fcd9c65292"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:17.870103 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.870010    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1637ea0-2630-4914-95ae-c7fcd9c65292-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e1637ea0-2630-4914-95ae-c7fcd9c65292" (UID: "e1637ea0-2630-4914-95ae-c7fcd9c65292"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:01:17.870290 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.870268    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1637ea0-2630-4914-95ae-c7fcd9c65292-kube-api-access-xft9g" (OuterVolumeSpecName: "kube-api-access-xft9g") pod "e1637ea0-2630-4914-95ae-c7fcd9c65292" (UID: "e1637ea0-2630-4914-95ae-c7fcd9c65292"). InnerVolumeSpecName "kube-api-access-xft9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:17.968680 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.968638    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-dshm\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:01:17.968680 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.968678    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xft9g\" (UniqueName: \"kubernetes.io/projected/e1637ea0-2630-4914-95ae-c7fcd9c65292-kube-api-access-xft9g\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:01:17.968920 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.968692    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-tmp-dir\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:01:17.968920 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.968707    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1637ea0-2630-4914-95ae-c7fcd9c65292-tls-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:01:17.968920 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:17.968740    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1637ea0-2630-4914-95ae-c7fcd9c65292-model-cache\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:01:18.421762 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:18.421705    2574 generic.go:356] "Generic (PLEG): container finished" podID="e1637ea0-2630-4914-95ae-c7fcd9c65292" containerID="7729ef7be3ad6bd6cfdbc61b8359a11f887f03a3a32e361fef587f49bb34b437" exitCode=0
Sep 11 00:01:18.421933 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:18.421765    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"
Sep 11 00:01:18.421933 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:18.421815    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4" event={"ID":"e1637ea0-2630-4914-95ae-c7fcd9c65292","Type":"ContainerDied","Data":"7729ef7be3ad6bd6cfdbc61b8359a11f887f03a3a32e361fef587f49bb34b437"}
Sep 11 00:01:18.421933 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:18.421856    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4" event={"ID":"e1637ea0-2630-4914-95ae-c7fcd9c65292","Type":"ContainerDied","Data":"c8f7d2806fc23baee6a259c01abbc548b4e5a5c248625fbe7626cab8684d02b0"}
Sep 11 00:01:18.421933 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:18.421874    2574 scope.go:117] "RemoveContainer" containerID="7729ef7be3ad6bd6cfdbc61b8359a11f887f03a3a32e361fef587f49bb34b437"
Sep 11 00:01:18.431613 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:18.431595    2574 scope.go:117] "RemoveContainer" containerID="7729ef7be3ad6bd6cfdbc61b8359a11f887f03a3a32e361fef587f49bb34b437"
Sep 11 00:01:18.431935 ip-10-0-135-1 kubenswrapper[2574]: E0911 00:01:18.431912    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7729ef7be3ad6bd6cfdbc61b8359a11f887f03a3a32e361fef587f49bb34b437\": container with ID starting with 7729ef7be3ad6bd6cfdbc61b8359a11f887f03a3a32e361fef587f49bb34b437 not found: ID does not exist" containerID="7729ef7be3ad6bd6cfdbc61b8359a11f887f03a3a32e361fef587f49bb34b437"
Sep 11 00:01:18.432031 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:18.431949    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7729ef7be3ad6bd6cfdbc61b8359a11f887f03a3a32e361fef587f49bb34b437"} err="failed to get container status \"7729ef7be3ad6bd6cfdbc61b8359a11f887f03a3a32e361fef587f49bb34b437\": rpc error: code = NotFound desc = could not find container \"7729ef7be3ad6bd6cfdbc61b8359a11f887f03a3a32e361fef587f49bb34b437\": container with ID starting with 7729ef7be3ad6bd6cfdbc61b8359a11f887f03a3a32e361fef587f49bb34b437 not found: ID does not exist"
Sep 11 00:01:18.449257 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:18.449226    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"]
Sep 11 00:01:18.452612 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:18.452588    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-71c1cb/ipp-route-71c1cb-kserve-789fdd5795-59qr4"]
Sep 11 00:01:19.256703 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:19.256659    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1637ea0-2630-4914-95ae-c7fcd9c65292" path="/var/lib/kubelet/pods/e1637ea0-2630-4914-95ae-c7fcd9c65292/volumes"
Sep 11 00:01:36.295412 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:36.295356    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:38.766781 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:38.766744    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:39.663631 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:39.663590    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:45.371580 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:45.371547    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:59.053201 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:59.053166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:59.122182 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:59.122151    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:59.362656 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:59.362619    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:59.898913 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:01:59.898878    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:01.686223 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:01.686183    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:02.394724 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:02.394683    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:02.495932 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:02.495902    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:10.304114 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:10.304064    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl"]
Sep 11 00:02:10.306400 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:10.306372    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-5453e3-29818080-pb5sl"]
Sep 11 00:02:10.313314 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:10.313283    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:10.464348 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:10.464311    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:10.592163 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:10.592082    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:10.665354 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:10.665320    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:10.731301 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:10.731263    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:11.040888 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:11.040859    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:11.256346 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:11.256312    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a862d89a-b2ce-4273-9d3d-98523eb176cb" path="/var/lib/kubelet/pods/a862d89a-b2ce-4273-9d3d-98523eb176cb/volumes"
Sep 11 00:02:13.599664 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:13.599628    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:02:16.691036 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:16.691000    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:16.791686 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:16.791649    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:16.932877 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:16.932845    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"]
Sep 11 00:02:16.933103 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:16.933065    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" podUID="45423275-8693-4802-8396-761ef870de93" containerName="istio-proxy" containerID="cri-o://a582f9efee2061e66e33b91ccd4d912ae62fed27de349b014870075b9d5e1293" gracePeriod=30
Sep 11 00:02:16.957422 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:16.957327    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:17.612838 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:17.612797    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:22.185251 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.185221    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 11 00:02:22.224346 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.224252    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45423275-8693-4802-8396-761ef870de93-istio-token\") pod \"45423275-8693-4802-8396-761ef870de93\" (UID: \"45423275-8693-4802-8396-761ef870de93\") "
Sep 11 00:02:22.224346 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.224295    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45423275-8693-4802-8396-761ef870de93-istiod-ca-cert\") pod \"45423275-8693-4802-8396-761ef870de93\" (UID: \"45423275-8693-4802-8396-761ef870de93\") "
Sep 11 00:02:22.224599 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.224357    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-istio-data\") pod \"45423275-8693-4802-8396-761ef870de93\" (UID: \"45423275-8693-4802-8396-761ef870de93\") "
Sep 11 00:02:22.224599 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.224376    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-istio-envoy\") pod \"45423275-8693-4802-8396-761ef870de93\" (UID: \"45423275-8693-4802-8396-761ef870de93\") "
Sep 11 00:02:22.224599 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.224419    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45423275-8693-4802-8396-761ef870de93-istio-podinfo\") pod \"45423275-8693-4802-8396-761ef870de93\" (UID: \"45423275-8693-4802-8396-761ef870de93\") "
Sep 11 00:02:22.224599 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.224462    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6p2f\" (UniqueName: \"kubernetes.io/projected/45423275-8693-4802-8396-761ef870de93-kube-api-access-w6p2f\") pod \"45423275-8693-4802-8396-761ef870de93\" (UID: \"45423275-8693-4802-8396-761ef870de93\") "
Sep 11 00:02:22.224599 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.224502    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-workload-certs\") pod \"45423275-8693-4802-8396-761ef870de93\" (UID: \"45423275-8693-4802-8396-761ef870de93\") "
Sep 11 00:02:22.224599 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.224557    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-workload-socket\") pod \"45423275-8693-4802-8396-761ef870de93\" (UID: \"45423275-8693-4802-8396-761ef870de93\") "
Sep 11 00:02:22.224599 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.224592    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-credential-socket\") pod \"45423275-8693-4802-8396-761ef870de93\" (UID: \"45423275-8693-4802-8396-761ef870de93\") "
Sep 11 00:02:22.225006 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.224693    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-istio-data" (OuterVolumeSpecName: "istio-data") pod "45423275-8693-4802-8396-761ef870de93" (UID: "45423275-8693-4802-8396-761ef870de93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:22.225006 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.224805    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45423275-8693-4802-8396-761ef870de93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "45423275-8693-4802-8396-761ef870de93" (UID: "45423275-8693-4802-8396-761ef870de93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:02:22.225006 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.224936    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "45423275-8693-4802-8396-761ef870de93" (UID: "45423275-8693-4802-8396-761ef870de93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:22.225165 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.225042    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-credential-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.225165 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.225059    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45423275-8693-4802-8396-761ef870de93-istiod-ca-cert\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.225165 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.225073    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-istio-data\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.225165 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.225087    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "45423275-8693-4802-8396-761ef870de93" (UID: "45423275-8693-4802-8396-761ef870de93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:22.225165 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.225096    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "45423275-8693-4802-8396-761ef870de93" (UID: "45423275-8693-4802-8396-761ef870de93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:22.226542 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.226521    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "45423275-8693-4802-8396-761ef870de93" (UID: "45423275-8693-4802-8396-761ef870de93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:22.226840 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.226820    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45423275-8693-4802-8396-761ef870de93-kube-api-access-w6p2f" (OuterVolumeSpecName: "kube-api-access-w6p2f") pod "45423275-8693-4802-8396-761ef870de93" (UID: "45423275-8693-4802-8396-761ef870de93"). InnerVolumeSpecName "kube-api-access-w6p2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:02:22.227009 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.226991    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/45423275-8693-4802-8396-761ef870de93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "45423275-8693-4802-8396-761ef870de93" (UID: "45423275-8693-4802-8396-761ef870de93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 00:02:22.227059 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.227015    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45423275-8693-4802-8396-761ef870de93-istio-token" (OuterVolumeSpecName: "istio-token") pod "45423275-8693-4802-8396-761ef870de93" (UID: "45423275-8693-4802-8396-761ef870de93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:02:22.326447 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.326401    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-istio-envoy\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.326447 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.326437    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45423275-8693-4802-8396-761ef870de93-istio-podinfo\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.326447 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.326451    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6p2f\" (UniqueName: \"kubernetes.io/projected/45423275-8693-4802-8396-761ef870de93-kube-api-access-w6p2f\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.326704 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.326463    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-workload-certs\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.326704 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.326475    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45423275-8693-4802-8396-761ef870de93-workload-socket\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.326704 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.326487    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45423275-8693-4802-8396-761ef870de93-istio-token\") on node \"ip-10-0-135-1.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.778338 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.778296    2574 generic.go:356] "Generic (PLEG): container finished" podID="45423275-8693-4802-8396-761ef870de93" containerID="a582f9efee2061e66e33b91ccd4d912ae62fed27de349b014870075b9d5e1293" exitCode=0
Sep 11 00:02:22.778511 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.778349    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"
Sep 11 00:02:22.778511 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.778378    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" event={"ID":"45423275-8693-4802-8396-761ef870de93","Type":"ContainerDied","Data":"a582f9efee2061e66e33b91ccd4d912ae62fed27de349b014870075b9d5e1293"}
Sep 11 00:02:22.778511 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.778438    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7" event={"ID":"45423275-8693-4802-8396-761ef870de93","Type":"ContainerDied","Data":"256160ea5a6b4076f3571488e870ce0a7b9ebe43ba012fc888b4631ada85be18"}
Sep 11 00:02:22.778511 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.778460    2574 scope.go:117] "RemoveContainer" containerID="a582f9efee2061e66e33b91ccd4d912ae62fed27de349b014870075b9d5e1293"
Sep 11 00:02:22.788171 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.788145    2574 scope.go:117] "RemoveContainer" containerID="28e0fa17a426a49c46815c26b930363520f89a42d193a09627fd706149178526"
Sep 11 00:02:22.796476 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.796456    2574 scope.go:117] "RemoveContainer" containerID="a582f9efee2061e66e33b91ccd4d912ae62fed27de349b014870075b9d5e1293"
Sep 11 00:02:22.796790 ip-10-0-135-1 kubenswrapper[2574]: E0911 00:02:22.796770    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a582f9efee2061e66e33b91ccd4d912ae62fed27de349b014870075b9d5e1293\": container with ID starting with a582f9efee2061e66e33b91ccd4d912ae62fed27de349b014870075b9d5e1293 not found: ID does not exist" containerID="a582f9efee2061e66e33b91ccd4d912ae62fed27de349b014870075b9d5e1293"
Sep 11 00:02:22.796867 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.796799    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a582f9efee2061e66e33b91ccd4d912ae62fed27de349b014870075b9d5e1293"} err="failed to get container status \"a582f9efee2061e66e33b91ccd4d912ae62fed27de349b014870075b9d5e1293\": rpc error: code = NotFound desc = could not find container \"a582f9efee2061e66e33b91ccd4d912ae62fed27de349b014870075b9d5e1293\": container with ID starting with a582f9efee2061e66e33b91ccd4d912ae62fed27de349b014870075b9d5e1293 not found: ID does not exist"
Sep 11 00:02:22.796867 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.796817    2574 scope.go:117] "RemoveContainer" containerID="28e0fa17a426a49c46815c26b930363520f89a42d193a09627fd706149178526"
Sep 11 00:02:22.797051 ip-10-0-135-1 kubenswrapper[2574]: E0911 00:02:22.797029    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28e0fa17a426a49c46815c26b930363520f89a42d193a09627fd706149178526\": container with ID starting with 28e0fa17a426a49c46815c26b930363520f89a42d193a09627fd706149178526 not found: ID does not exist" containerID="28e0fa17a426a49c46815c26b930363520f89a42d193a09627fd706149178526"
Sep 11 00:02:22.797088 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.797057    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28e0fa17a426a49c46815c26b930363520f89a42d193a09627fd706149178526"} err="failed to get container status \"28e0fa17a426a49c46815c26b930363520f89a42d193a09627fd706149178526\": rpc error: code = NotFound desc = could not find container \"28e0fa17a426a49c46815c26b930363520f89a42d193a09627fd706149178526\": container with ID starting with 28e0fa17a426a49c46815c26b930363520f89a42d193a09627fd706149178526 not found: ID does not exist"
Sep 11 00:02:22.799826 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.799805    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"]
Sep 11 00:02:22.803612 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:22.803589    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-5453e3-openshift-default-54fdbbdf5d-cwgc7"]
Sep 11 00:02:23.256927 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:23.256898    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45423275-8693-4802-8396-761ef870de93" path="/var/lib/kubelet/pods/45423275-8693-4802-8396-761ef870de93/volumes"
Sep 11 00:02:23.616665 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:23.616632    2574 scope.go:117] "RemoveContainer" containerID="b8856b516811ae3f321a5efbcae42517a0ed6f99c831ed7e2bc4c0a1d9e07a94"
Sep 11 00:02:23.625664 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:23.625646    2574 scope.go:117] "RemoveContainer" containerID="c94a915ee1e8357cd2fa08050db079e2a7255b89aa92a2084f5955d8ab006966"
Sep 11 00:02:27.729086 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:27.729048    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl"]
Sep 11 00:02:27.731127 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:27.731105    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-0b637b-29818080-wmzzl"]
Sep 11 00:02:27.732701 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:27.732673    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:28.003284 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:28.003189    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:28.076551 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:28.076522    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:28.144851 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:28.144825    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:28.304686 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:28.304610    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:29.132487 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:29.132457    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:29.195928 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:29.195893    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:29.255921 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:29.255890    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea4af63c-1ffc-42ed-8198-4eb01effb06a" path="/var/lib/kubelet/pods/ea4af63c-1ffc-42ed-8198-4eb01effb06a/volumes"
Sep 11 00:02:30.408273 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:30.408240    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:02:34.440058 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:34.440017    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:34.510570 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:34.510531    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:34.725451 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:34.725365    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:35.228192 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:35.228154    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:45.592245 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:45.592209    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:45.691386 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:45.691351    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:45.847613 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:45.847535    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:46.099505 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:46.099417    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:48.196669 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:48.196637    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:02:52.072001 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:52.071966    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:52.172609 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:52.172580    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:52.318628 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:52.318595    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:56.903952 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:02:56.903919    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:04:15.570883 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:04:15.570841    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:16.625350 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:04:16.625312    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:04:17.234455 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:04:17.234417    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:17.722277 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:04:17.722232    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:44.945614 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:04:44.945577    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:04:51.900487 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:04:51.900397    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:04:59.006602 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:04:59.006563    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:05:06.498449 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:05:06.498409    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:05:15.504954 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:05:15.504914    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:20.805833 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:05:20.805797    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:05:31.002622 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:05:31.002584    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:06:23.676902 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:06:23.676822    2574 scope.go:117] "RemoveContainer" containerID="5262047fafd787733c2316b2a20fbc009b816d78bad6b1596862a91ff7c0de57"
Sep 11 00:06:23.685552 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:06:23.685530    2574 scope.go:117] "RemoveContainer" containerID="d306a01cb6087816b2e725db88c7faa9d8bdeaf85ac86ebc97da71ad19dd5720"
Sep 11 00:06:23.693800 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:06:23.693775    2574 scope.go:117] "RemoveContainer" containerID="a7552f47145f75a331a8dc83f33b385c3da9f807c328327978ec18dd1ec6a313"
Sep 11 00:06:58.000009 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:06:57.999970    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:07:03.797377 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:07:03.797340    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:07:10.991038 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:07:10.991000    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:07:20.950644 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:07:20.950612    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:23.723234 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:07:23.723203    2574 scope.go:117] "RemoveContainer" containerID="cb3c352e0e294ff6aa4c6310c98035d0fd476a0f751642c0ba5172b43a24b460"
Sep 11 00:07:23.799392 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:07:23.799357    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:07:24.814063 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:07:24.814027    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:32.098366 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:07:32.098327    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:07:44.085929 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:07:44.085881    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:45.097226 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:07:45.097193    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:47.127331 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:07:47.127248    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:07:54.204184 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:07:54.204149    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:08:01.602066 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:01.602030    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:08:09.196560 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:09.196526    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:08:15.989944 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:15.989908    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:08:22.192529 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:22.192495    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:08:28.997828 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:28.997792    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qv8kn"]
Sep 11 00:08:37.022702 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:37.022674    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xc6ww_fdcd576f-c48f-4000-93e0-4589decdbffe/server/0.log"
Sep 11 00:08:37.134354 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:37.134325    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-j4xjx_0dc796ac-3294-454e-9e5c-945179171754/manager/0.log"
Sep 11 00:08:37.482740 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:37.482699    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc8465fcf-lglqh_ea932581-a725-4781-b116-1f744f067766/copy-manifests/0.log"
Sep 11 00:08:37.488862 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:37.488839    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc8465fcf-lglqh_ea932581-a725-4781-b116-1f744f067766/manager/0.log"
Sep 11 00:08:39.335079 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:39.335052    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-vv7dl_551edb9a-9e7d-484b-8e5b-f92f784e4cd9/kuadrant-console-plugin/0.log"
Sep 11 00:08:39.557657 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:39.557625    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-qv8kn_c284c4b1-4c47-485f-b62c-005a68d9d4ba/limitador/0.log"
Sep 11 00:08:40.331492 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:40.331463    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb577d9c6-twfq9_a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1/kube-auth-proxy/0.log"
Sep 11 00:08:41.324997 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:41.324964    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-kqtmw_ae77297f-d4ae-4b90-8fe6-637efbe36ed0/main/0.log"
Sep 11 00:08:41.433951 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:41.433926    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-qtnsf_9de3ef46-ed9e-4596-8e2a-e96df9e06146/main/0.log"
Sep 11 00:08:41.545054 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:41.545023    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdkjx8_940de213-71a2-4165-85f4-bcde30429eaf/main/0.log"
Sep 11 00:08:41.655101 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:41.655066    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-2jf4m_f731466e-1433-4cc1-be40-1ecfad97efab/main/0.log"
Sep 11 00:08:41.762701 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:41.762674    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-n4frd_5a4051b4-d43e-4f56-bacd-e3fd476d2451/main/0.log"
Sep 11 00:08:47.342209 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342173    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mzltk/must-gather-4z5gj"]
Sep 11 00:08:47.342629 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342612    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy"
Sep 11 00:08:47.342677 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342631    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy"
Sep 11 00:08:47.342677 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342646    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce007f6c-2de3-4935-89f8-9a3878d4030f" containerName="revoke-keys"
Sep 11 00:08:47.342677 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342653    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce007f6c-2de3-4935-89f8-9a3878d4030f" containerName="revoke-keys"
Sep 11 00:08:47.342677 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342673    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45423275-8693-4802-8396-761ef870de93" containerName="istio-proxy"
Sep 11 00:08:47.342677 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342679    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="45423275-8693-4802-8396-761ef870de93" containerName="istio-proxy"
Sep 11 00:08:47.342871 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342687    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45423275-8693-4802-8396-761ef870de93" containerName="istio-proxy"
Sep 11 00:08:47.342871 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342693    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="45423275-8693-4802-8396-761ef870de93" containerName="istio-proxy"
Sep 11 00:08:47.342871 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342700    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1637ea0-2630-4914-95ae-c7fcd9c65292" containerName="main"
Sep 11 00:08:47.342871 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342706    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1637ea0-2630-4914-95ae-c7fcd9c65292" containerName="main"
Sep 11 00:08:47.342871 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342782    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1637ea0-2630-4914-95ae-c7fcd9c65292" containerName="main"
Sep 11 00:08:47.342871 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342791    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy"
Sep 11 00:08:47.342871 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342797    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce007f6c-2de3-4935-89f8-9a3878d4030f" containerName="revoke-keys"
Sep 11 00:08:47.342871 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342804    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="45423275-8693-4802-8396-761ef870de93" containerName="istio-proxy"
Sep 11 00:08:47.342871 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342811    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="45423275-8693-4802-8396-761ef870de93" containerName="istio-proxy"
Sep 11 00:08:47.343155 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342877    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy"
Sep 11 00:08:47.343155 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342884    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy"
Sep 11 00:08:47.343155 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.342963    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7df086d-be73-4c6c-8bd9-0dee2b7ec20d" containerName="istio-proxy"
Sep 11 00:08:47.346091 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.346069    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzltk/must-gather-4z5gj"
Sep 11 00:08:47.351930 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.351908    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mzltk\"/\"openshift-service-ca.crt\""
Sep 11 00:08:47.352987 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.352940    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mzltk\"/\"default-dockercfg-cvh2v\""
Sep 11 00:08:47.353469 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.352956    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mzltk\"/\"kube-root-ca.crt\""
Sep 11 00:08:47.355568 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.355545    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzltk/must-gather-4z5gj"]
Sep 11 00:08:47.359696 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.359674    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:08:47.449132 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.449105    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd869\" (UniqueName: \"kubernetes.io/projected/fc949d4c-ee34-43d3-b790-c517b89f983a-kube-api-access-qd869\") pod \"must-gather-4z5gj\" (UID: \"fc949d4c-ee34-43d3-b790-c517b89f983a\") " pod="openshift-must-gather-mzltk/must-gather-4z5gj"
Sep 11 00:08:47.449268 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.449213    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc949d4c-ee34-43d3-b790-c517b89f983a-must-gather-output\") pod \"must-gather-4z5gj\" (UID: \"fc949d4c-ee34-43d3-b790-c517b89f983a\") " pod="openshift-must-gather-mzltk/must-gather-4z5gj"
Sep 11 00:08:47.550658 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.550623    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd869\" (UniqueName: \"kubernetes.io/projected/fc949d4c-ee34-43d3-b790-c517b89f983a-kube-api-access-qd869\") pod \"must-gather-4z5gj\" (UID: \"fc949d4c-ee34-43d3-b790-c517b89f983a\") " pod="openshift-must-gather-mzltk/must-gather-4z5gj"
Sep 11 00:08:47.550836 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.550770    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc949d4c-ee34-43d3-b790-c517b89f983a-must-gather-output\") pod \"must-gather-4z5gj\" (UID: \"fc949d4c-ee34-43d3-b790-c517b89f983a\") " pod="openshift-must-gather-mzltk/must-gather-4z5gj"
Sep 11 00:08:47.551106 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.551087    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc949d4c-ee34-43d3-b790-c517b89f983a-must-gather-output\") pod \"must-gather-4z5gj\" (UID: \"fc949d4c-ee34-43d3-b790-c517b89f983a\") " pod="openshift-must-gather-mzltk/must-gather-4z5gj"
Sep 11 00:08:47.559068 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.559043    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd869\" (UniqueName: \"kubernetes.io/projected/fc949d4c-ee34-43d3-b790-c517b89f983a-kube-api-access-qd869\") pod \"must-gather-4z5gj\" (UID: \"fc949d4c-ee34-43d3-b790-c517b89f983a\") " pod="openshift-must-gather-mzltk/must-gather-4z5gj"
Sep 11 00:08:47.655931 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.655909    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzltk/must-gather-4z5gj"
Sep 11 00:08:47.925166 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.925143    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzltk/must-gather-4z5gj"]
Sep 11 00:08:47.927063 ip-10-0-135-1 kubenswrapper[2574]: W0911 00:08:47.927033    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc949d4c_ee34_43d3_b790_c517b89f983a.slice/crio-3553e2505b4b8bf9ad65d4a712182453bddc3913c2309cafe479c7f179591f87 WatchSource:0}: Error finding container 3553e2505b4b8bf9ad65d4a712182453bddc3913c2309cafe479c7f179591f87: Status 404 returned error can't find the container with id 3553e2505b4b8bf9ad65d4a712182453bddc3913c2309cafe479c7f179591f87
Sep 11 00:08:47.929084 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:47.929066    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 00:08:48.002320 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:48.002285    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log" limit=1024
Sep 11 00:08:48.818803 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:48.818774    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzltk/must-gather-4z5gj" event={"ID":"fc949d4c-ee34-43d3-b790-c517b89f983a","Type":"ContainerStarted","Data":"3553e2505b4b8bf9ad65d4a712182453bddc3913c2309cafe479c7f179591f87"}
Sep 11 00:08:49.828826 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:49.828783    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzltk/must-gather-4z5gj" event={"ID":"fc949d4c-ee34-43d3-b790-c517b89f983a","Type":"ContainerStarted","Data":"e0ee27bbf060204df012e8526591991c8892013e5d2248616af4926509e8f4b5"}
Sep 11 00:08:49.829611 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:49.829583    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzltk/must-gather-4z5gj" event={"ID":"fc949d4c-ee34-43d3-b790-c517b89f983a","Type":"ContainerStarted","Data":"294cf534c48822d589694ed5b2befc7865796b4ec1c983334bee15a50dd9ebf9"}
Sep 11 00:08:49.845649 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:49.845595    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mzltk/must-gather-4z5gj" podStartSLOduration=1.903048537 podStartE2EDuration="2.845580708s" totalImagesPullingTime="942.532171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:08:49.842433663 +0000 UTC m=+2127.024591794" watchObservedRunningTime="2026-09-11 00:08:49.845580708 +0000 UTC m=+2127.027738904"
Sep 11 00:08:50.393283 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:50.393251    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w8hxs_e04c068a-47d1-4208-b12f-4b25d729bf33/global-pull-secret-syncer/0.log"
Sep 11 00:08:50.439553 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:50.439523    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2gmzl_28186efb-cfb3-4d1b-9224-e81db5a3ec1b/konnectivity-agent/0.log"
Sep 11 00:08:50.516694 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:50.516661    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-1.ec2.internal_c136d63f0f74198e85586854afa827e1/haproxy/0.log"
Sep 11 00:08:55.209750 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:55.209696    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-vv7dl_551edb9a-9e7d-484b-8e5b-f92f784e4cd9/kuadrant-console-plugin/0.log"
Sep 11 00:08:55.268821 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:55.268792    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-qv8kn_c284c4b1-4c47-485f-b62c-005a68d9d4ba/limitador/0.log"
Sep 11 00:08:57.279291 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.279215    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmg79_5560adfe-08b6-4fdc-a1ae-e538c31b5f6c/node-exporter/0.log"
Sep 11 00:08:57.300275 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.300244    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmg79_5560adfe-08b6-4fdc-a1ae-e538c31b5f6c/kube-rbac-proxy/0.log"
Sep 11 00:08:57.318706 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.318676    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmg79_5560adfe-08b6-4fdc-a1ae-e538c31b5f6c/init-textfile/0.log"
Sep 11 00:08:57.346332 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.346298    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-x89jk_009aa0a7-cee8-4e1b-86dc-026f23b57fa3/kube-rbac-proxy-main/0.log"
Sep 11 00:08:57.367797 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.367723    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-x89jk_009aa0a7-cee8-4e1b-86dc-026f23b57fa3/kube-rbac-proxy-self/0.log"
Sep 11 00:08:57.390894 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.390811    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-x89jk_009aa0a7-cee8-4e1b-86dc-026f23b57fa3/openshift-state-metrics/0.log"
Sep 11 00:08:57.733879 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.733843    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-ltb5f_d949a473-de63-4bca-a901-c58279c185c4/prometheus-operator-admission-webhook/0.log"
Sep 11 00:08:57.768500 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.768446    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bbc5fdcc5-qsrxd_737ef4e4-bb1d-4340-a215-1bc916bd7b16/telemeter-client/0.log"
Sep 11 00:08:57.788149 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.788110    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bbc5fdcc5-qsrxd_737ef4e4-bb1d-4340-a215-1bc916bd7b16/reload/0.log"
Sep 11 00:08:57.815129 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.815097    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bbc5fdcc5-qsrxd_737ef4e4-bb1d-4340-a215-1bc916bd7b16/kube-rbac-proxy/0.log"
Sep 11 00:08:57.856530 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.856498    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65888bdb98-7h6cs_cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7/thanos-query/0.log"
Sep 11 00:08:57.876404 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.876378    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65888bdb98-7h6cs_cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7/kube-rbac-proxy-web/0.log"
Sep 11 00:08:57.902837 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.902808    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65888bdb98-7h6cs_cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7/kube-rbac-proxy/0.log"
Sep 11 00:08:57.929523 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.929390    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65888bdb98-7h6cs_cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7/prom-label-proxy/0.log"
Sep 11 00:08:57.953666 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.953621    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65888bdb98-7h6cs_cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7/kube-rbac-proxy-rules/0.log"
Sep 11 00:08:57.976178 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:08:57.975926    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65888bdb98-7h6cs_cf0c9ddd-83cf-450b-bbaf-682c3eae5dc7/kube-rbac-proxy-metrics/0.log"
Sep 11 00:09:00.576624 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.576588    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67f45b7f9f-t5tjg_71465f0a-72a2-4e7f-8990-0ab31c41ce47/console/0.log"
Sep 11 00:09:00.642657 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.642620    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"]
Sep 11 00:09:00.648171 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.648140    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.652880 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.652847    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"]
Sep 11 00:09:00.683622 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.683581    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d2eff6b-a88c-4530-a9bd-f6014533b911-lib-modules\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.683957 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.683933    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3d2eff6b-a88c-4530-a9bd-f6014533b911-podres\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.684152 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.684124    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d2eff6b-a88c-4530-a9bd-f6014533b911-sys\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.684306 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.684291    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4lbs\" (UniqueName: \"kubernetes.io/projected/3d2eff6b-a88c-4530-a9bd-f6014533b911-kube-api-access-l4lbs\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.684531 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.684516    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3d2eff6b-a88c-4530-a9bd-f6014533b911-proc\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.785824 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.785789    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d2eff6b-a88c-4530-a9bd-f6014533b911-lib-modules\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.786011 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.785844    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3d2eff6b-a88c-4530-a9bd-f6014533b911-podres\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.786011 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.785946    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d2eff6b-a88c-4530-a9bd-f6014533b911-sys\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.786011 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.785960    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d2eff6b-a88c-4530-a9bd-f6014533b911-lib-modules\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.786011 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.785968    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3d2eff6b-a88c-4530-a9bd-f6014533b911-podres\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.786011 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.785987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4lbs\" (UniqueName: \"kubernetes.io/projected/3d2eff6b-a88c-4530-a9bd-f6014533b911-kube-api-access-l4lbs\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.786286 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.786033    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d2eff6b-a88c-4530-a9bd-f6014533b911-sys\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.786286 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.786121    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3d2eff6b-a88c-4530-a9bd-f6014533b911-proc\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.786286 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.786220    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3d2eff6b-a88c-4530-a9bd-f6014533b911-proc\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.793869 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.793835    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4lbs\" (UniqueName: \"kubernetes.io/projected/3d2eff6b-a88c-4530-a9bd-f6014533b911-kube-api-access-l4lbs\") pod \"perf-node-gather-daemonset-hdh5n\" (UID: \"3d2eff6b-a88c-4530-a9bd-f6014533b911\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:00.963080 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:00.963047    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:01.259005 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:01.258972    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"]
Sep 11 00:09:01.260891 ip-10-0-135-1 kubenswrapper[2574]: W0911 00:09:01.260835    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3d2eff6b_a88c_4530_a9bd_f6014533b911.slice/crio-a099dadb075cdd47ad794639af9676b359665abce0470cda29a9de54e5b7a65d WatchSource:0}: Error finding container a099dadb075cdd47ad794639af9676b359665abce0470cda29a9de54e5b7a65d: Status 404 returned error can't find the container with id a099dadb075cdd47ad794639af9676b359665abce0470cda29a9de54e5b7a65d
Sep 11 00:09:01.932300 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:01.932260    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n" event={"ID":"3d2eff6b-a88c-4530-a9bd-f6014533b911","Type":"ContainerStarted","Data":"8e234d1c940681c5287daf0c9f0144e4deb236ccab5f6459f54ccbd47605f34d"}
Sep 11 00:09:01.932833 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:01.932330    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n" event={"ID":"3d2eff6b-a88c-4530-a9bd-f6014533b911","Type":"ContainerStarted","Data":"a099dadb075cdd47ad794639af9676b359665abce0470cda29a9de54e5b7a65d"}
Sep 11 00:09:01.932833 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:01.932481    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:01.947049 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:01.946997    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n" podStartSLOduration=1.94697698 podStartE2EDuration="1.94697698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:09:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:09:01.945602031 +0000 UTC m=+2139.127760160" watchObservedRunningTime="2026-09-11 00:09:01.94697698 +0000 UTC m=+2139.129135108"
Sep 11 00:09:02.487972 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:02.487940    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wdjff_9dffb260-3cf9-42bb-80b7-4a0341b93d03/dns/0.log"
Sep 11 00:09:02.505856 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:02.505831    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wdjff_9dffb260-3cf9-42bb-80b7-4a0341b93d03/kube-rbac-proxy/0.log"
Sep 11 00:09:02.575571 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:02.575471    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hpfc4_ff418d0b-69db-4755-8f64-656dcd13841b/dns-node-resolver/0.log"
Sep 11 00:09:03.114999 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:03.114967    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c6ff5466c-g8fqw_6bb8fc70-f3e9-4626-ad11-046d186198fe/registry/0.log"
Sep 11 00:09:03.177481 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:03.177452    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9zd99_16227dff-3d81-4c11-98a6-7ff11e1d2ca4/node-ca/0.log"
Sep 11 00:09:04.361985 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:04.361951    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb577d9c6-twfq9_a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1/kube-auth-proxy/0.log"
Sep 11 00:09:05.351659 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:05.351633    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gwmnh_5fbcb89f-36da-4cc6-9ae0-0f7afcf17ac3/serve-healthcheck-canary/0.log"
Sep 11 00:09:05.883364 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:05.883332    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c42rs_4a6a7231-4974-483e-afd7-accaf5f92561/kube-rbac-proxy/0.log"
Sep 11 00:09:05.902057 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:05.902032    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c42rs_4a6a7231-4974-483e-afd7-accaf5f92561/exporter/0.log"
Sep 11 00:09:05.921281 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:05.921250    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c42rs_4a6a7231-4974-483e-afd7-accaf5f92561/extractor/0.log"
Sep 11 00:09:07.951090 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:07.951060    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-hdh5n"
Sep 11 00:09:08.225565 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:08.225472    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xc6ww_fdcd576f-c48f-4000-93e0-4589decdbffe/server/0.log"
Sep 11 00:09:08.321346 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:08.321314    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-j4xjx_0dc796ac-3294-454e-9e5c-945179171754/manager/0.log"
Sep 11 00:09:08.479264 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:08.479169    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc8465fcf-lglqh_ea932581-a725-4781-b116-1f744f067766/manager/0.log"
Sep 11 00:09:08.496648 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:08.496620    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc8465fcf-lglqh_ea932581-a725-4781-b116-1f744f067766/copy-manifests/0.log"
Sep 11 00:09:09.835655 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:09.835558    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-bffb6dd48-x7kqr_3e2b7381-2dc3-46f3-9236-8eca519d5c83/manager/0.log"
Sep 11 00:09:11.072423 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:11.072348    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb577d9c6-twfq9_a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1/kube-auth-proxy/0.log"
Sep 11 00:09:12.910287 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:12.910255    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb577d9c6-twfq9_a0ef1b2c-5db2-4c97-97d5-69fbc9e541b1/kube-auth-proxy/0.log"
Sep 11 00:09:16.520469 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:16.520386    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phlkq_03930709-78f9-49ae-bd6f-f9a6481c8e8f/kube-multus-additional-cni-plugins/0.log"
Sep 11 00:09:16.539103 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:16.539079    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phlkq_03930709-78f9-49ae-bd6f-f9a6481c8e8f/egress-router-binary-copy/0.log"
Sep 11 00:09:16.558171 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:16.558150    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phlkq_03930709-78f9-49ae-bd6f-f9a6481c8e8f/cni-plugins/0.log"
Sep 11 00:09:16.577201 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:16.577180    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phlkq_03930709-78f9-49ae-bd6f-f9a6481c8e8f/bond-cni-plugin/0.log"
Sep 11 00:09:16.595930 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:16.595903    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phlkq_03930709-78f9-49ae-bd6f-f9a6481c8e8f/routeoverride-cni/0.log"
Sep 11 00:09:16.615996 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:16.615955    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phlkq_03930709-78f9-49ae-bd6f-f9a6481c8e8f/whereabouts-cni-bincopy/0.log"
Sep 11 00:09:16.634320 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:16.634290    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phlkq_03930709-78f9-49ae-bd6f-f9a6481c8e8f/whereabouts-cni/0.log"
Sep 11 00:09:16.856336 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:16.856261    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jrqbg_4fc47980-023d-4262-b0ce-d1e7e00e555d/kube-multus/0.log"
Sep 11 00:09:16.875257 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:16.875229    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4k2jt_19caec11-5b78-4352-8b17-90d56d69a7de/network-metrics-daemon/0.log"
Sep 11 00:09:16.890689 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:16.890666    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4k2jt_19caec11-5b78-4352-8b17-90d56d69a7de/kube-rbac-proxy/0.log"
Sep 11 00:09:17.930459 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:17.930434    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tzxwx_83dc92c5-fb74-4c28-babb-0259c9c4efd4/ovn-controller/0.log"
Sep 11 00:09:17.945185 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:17.945162    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tzxwx_83dc92c5-fb74-4c28-babb-0259c9c4efd4/ovn-acl-logging/0.log"
Sep 11 00:09:17.965690 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:17.965662    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tzxwx_83dc92c5-fb74-4c28-babb-0259c9c4efd4/kube-rbac-proxy-node/0.log"
Sep 11 00:09:17.984301 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:17.984272    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tzxwx_83dc92c5-fb74-4c28-babb-0259c9c4efd4/kube-rbac-proxy-ovn-metrics/0.log"
Sep 11 00:09:18.002472 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:18.002450    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tzxwx_83dc92c5-fb74-4c28-babb-0259c9c4efd4/northd/0.log"
Sep 11 00:09:18.021339 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:18.021317    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tzxwx_83dc92c5-fb74-4c28-babb-0259c9c4efd4/nbdb/0.log"
Sep 11 00:09:18.039988 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:18.039923    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tzxwx_83dc92c5-fb74-4c28-babb-0259c9c4efd4/sbdb/0.log"
Sep 11 00:09:18.101344 ip-10-0-135-1 kubenswrapper[2574]: I0911 00:09:18.101312    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tzxwx_83dc92c5-fb74-4c28-babb-0259c9c4efd4/ovnkube-controller/0.log"