Sep 08 16:20:45.172641 ip-10-0-139-55 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 16:20:45.172651 ip-10-0-139-55 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 16:20:45.172658 ip-10-0-139-55 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 16:20:45.172808 ip-10-0-139-55 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 16:20:55.208371 ip-10-0-139-55 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 08 16:20:55.208388 ip-10-0-139-55 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 05a38a82d05349b391de96b04906a1b7 --
Sep 08 16:22:36.221698 ip-10-0-139-55 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 16:22:36.635835 ip-10-0-139-55 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 16:22:36.635835 ip-10-0-139-55 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 16:22:36.635835 ip-10-0-139-55 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 16:22:36.635835 ip-10-0-139-55 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 16:22:36.635835 ip-10-0-139-55 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 16:22:36.636542 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.635892    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 16:22:36.643493 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643477    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:22:36.643493 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643491    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:22:36.643493 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643495    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643498    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643503    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643506    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643509    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643512    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643527    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643530    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643533    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643535    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643538    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643541    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643543    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643546    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643549    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643551    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643554    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643557    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643559    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643562    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:22:36.643601 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643564    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643567    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643569    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643572    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643575    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643577    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643580    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643584    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643588    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643591    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643593    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643596    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643599    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643602    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643605    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643608    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643611    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643614    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643616    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643619    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:22:36.644118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643622    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643624    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643628    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643632    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643635    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643638    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643641    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643643    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643646    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643648    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643651    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643653    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643656    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643658    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643662    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643664    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643667    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643670    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643672    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643675    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:22:36.644855 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643678    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643680    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643683    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643685    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643688    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643691    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643693    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643696    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643698    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643701    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643703    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643706    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643709    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643711    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643714    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643716    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643719    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643722    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643725    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643727    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:22:36.645563 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643730    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643732    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643737    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643740    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643744    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643746    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643750    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643753    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643756    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643758    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643761    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643764    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643766    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643768    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643771    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643773    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.643776    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645767    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645779    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:22:36.646060 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645783    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645792    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645796    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645799    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645801    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645804    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645807    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645810    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645813    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645816    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645818    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645821    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645823    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645826    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645829    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645832    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645834    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645837    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645840    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:22:36.646545 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645842    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645845    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645847    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645850    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645852    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645855    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645858    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645860    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645863    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645865    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645874    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645878    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645882    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645885    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645888    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645891    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645894    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645896    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645899    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645901    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:22:36.647045 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645904    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645907    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645911    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645915    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645917    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645920    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645923    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645926    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645929    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645932    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645935    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645937    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645940    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645943    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645945    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645948    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645950    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645953    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645955    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:22:36.647663 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645958    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645960    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645963    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645966    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645968    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645971    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645974    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645977    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645979    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645982    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645984    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645987    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645990    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645992    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645995    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.645998    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646002    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646007    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646010    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646012    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:22:36.648139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646015    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646017    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646020    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646029    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646032    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646034    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646037    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646039    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646042    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646045    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646047    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646050    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646052    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646055    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646058    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646060    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646063    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646066    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646069    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:22:36.648639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646883    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646890    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646893    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646896    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646901    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646905    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646908    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646911    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646914    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646917    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646920    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646922    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646925    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646928    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646930    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646933    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646941    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646944    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646947    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646950    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:22:36.649118 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646952    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646955    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646958    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646960    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646963    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646965    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646967    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646970    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646972    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646975    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646979    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646982    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646985    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646987    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646990    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646993    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646995    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.646998    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647001    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647003    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:22:36.649635 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647006    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647009    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647011    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647014    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647016    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647019    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647021    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647024    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647028    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647033    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647036    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647039    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647042    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647044    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647048    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647051    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647054    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647057    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647059    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647062    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:22:36.650126 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647064    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647068    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647071    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647074    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647076    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647079    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647081    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647084    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647087    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647089    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647092    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647094    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647097    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647099    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647101    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647104    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647106    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647109    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647113    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:22:36.650630 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647116    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647119    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647121    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647124    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647127    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647129    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647132    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647134    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647137    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647140    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647143    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647145    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647148    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647150    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647153    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647156    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647159    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647161    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647163    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647166    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:22:36.651113 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647237    2562 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647272    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647279    2562 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647283    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647287    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647291    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647295    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647299    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647302    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647305    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647309    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647312    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647315    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647318    2562 flags.go:64] FLAG: --cgroup-root=""
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647321    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647324    2562 flags.go:64] FLAG: --client-ca-file=""
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647328    2562 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647331    2562 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647335    2562 flags.go:64] FLAG: --cluster-domain=""
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647338    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647341    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647344    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647348    2562 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647351    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 16:22:36.651627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647354    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647357    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647360    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647364    2562 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647367    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647370    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647373    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647376    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647380    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647383    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647386    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647388    2562 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647405    2562 flags.go:64] FLAG: --enable-server="true"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647408    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647413    2562 flags.go:64] FLAG: --event-burst="100"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647416    2562 flags.go:64] FLAG: --event-qps="50"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647419    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647422    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647425    2562 flags.go:64] FLAG: --eviction-hard=""
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647429    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647432    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647435    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647438    2562 flags.go:64] FLAG: --eviction-soft=""
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647441    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647444    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 16:22:36.652231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647447    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647451    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647454    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647457    2562 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647460    2562 flags.go:64] FLAG: --feature-gates=""
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647464    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647467    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647470    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647473    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647476    2562 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647479    2562 flags.go:64] FLAG: --help="false"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647482    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-139-55.ec2.internal"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647485    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647488    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647491    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647494    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647498    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647501    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647503    2562 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647506    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647509    2562 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647512    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647515    2562 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647518    2562 flags.go:64] FLAG: --kube-reserved=""
Sep 08 16:22:36.652902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647520    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647523    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647526    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647529    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647532    2562 flags.go:64] FLAG: --lock-file=""
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647535    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647538    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647541    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647546    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647549    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647552    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647555    2562 flags.go:64] FLAG: --logging-format="text"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647558    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647561    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647564    2562 flags.go:64] FLAG: --manifest-url=""
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647567    2562 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647571    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647574    2562 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647580    2562 flags.go:64] FLAG: --max-pods="110"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647583    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647586    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647589    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647592    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647595    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647598    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 16:22:36.653509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647601    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647608    2562 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647611    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647615    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647618    2562 flags.go:64] FLAG: --pod-cidr=""
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647621    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647626    2562 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647629    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647632    2562 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647635    2562 flags.go:64] FLAG: --port="10250"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647638    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647641    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-050e3a4a721000cef"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647644    2562 flags.go:64] FLAG: --qos-reserved=""
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647647    2562 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647650    2562 flags.go:64] FLAG: --register-node="true"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647653    2562 flags.go:64] FLAG: --register-with-taints=""
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647657    2562 flags.go:64] FLAG: --registry-burst="10"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647661    2562 flags.go:64] FLAG: --registry-qps="5"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647664    2562 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647667    2562 flags.go:64] FLAG: --reserved-memory=""
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647671    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647674    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647677    2562 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647680    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647683    2562 flags.go:64] FLAG: --runonce="false"
Sep 08 16:22:36.654142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647686    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647692    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647695    2562 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647697    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647700    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647703    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647706    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647709    2562 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647712    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647715    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647718    2562 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647721    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647724    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647727    2562 flags.go:64] FLAG: --system-cgroups=""
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647730    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647735    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647738    2562 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647741    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647744    2562 flags.go:64] FLAG: --tls-min-version=""
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647747    2562 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647750    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647754    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647757    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647760    2562 flags.go:64] FLAG: --v="2"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647764    2562 flags.go:64] FLAG: --version="false"
Sep 08 16:22:36.654865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647768    2562 flags.go:64] FLAG: --vmodule=""
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647772    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.647775    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647884    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647887    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647891    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647894    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647897    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647901    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647904    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647906    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647909    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647912    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647915    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647917    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647920    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647923    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647926    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647928    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647931    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:22:36.655486 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647933    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647936    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647939    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647941    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647944    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647947    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647950    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647952    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647956    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647959    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647961    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647964    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647966    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647970    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647972    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647975    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647977    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647981    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647985    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:22:36.655980 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647988    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647992    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647995    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.647997    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648000    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648003    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648006    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648008    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648011    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648013    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648016    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648019    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648021    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648024    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648027    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648030    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648032    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648035    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648038    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648040    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:22:36.656485 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648043    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648046    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648049    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648052    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648054    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648057    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648059    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648062    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648065    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648068    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648070    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648073    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648075    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648079    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648082    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648084    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648087    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648089    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648092    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:22:36.656981 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648096    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648099    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648102    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648105    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648108    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648111    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648113    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648116    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648119    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648122    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648125    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648127    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648130    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648133    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648137    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648140    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648144    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648147    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648150    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648153    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:22:36.657464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648155    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648158    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648161    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.648164    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.648169    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.655079    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.655093    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.655889    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.655896    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.655960    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.655965    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.655969    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.655973    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.655976    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:22:36.657959 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.655979    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.655982    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.655985    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.655988    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.655991    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.655994    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.655996    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.655999    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656002    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656005    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656007    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656010    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656013    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656015    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656018    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656022    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656026    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656029    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656032    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:22:36.658318 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656036    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656038    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656041    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656043    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656046    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656050    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656053    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656056    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656059    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656062    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656064    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656067    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656070    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656073    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656076    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656078    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656081    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656084    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656086    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656089    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:22:36.658834 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656092    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656094    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656097    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656100    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656102    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656105    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656108    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656110    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656113    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656115    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656118    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656121    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656123    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656127    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656129    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656132    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656135    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656138    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656142    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656144    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:22:36.659315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656147    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656150    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656152    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656155    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656159    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656162    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656165    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656168    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656170    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656173    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656175    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656179    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656182    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656185    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656188    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656191    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656195    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656198    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656201    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:22:36.659852 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656203    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656206    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656208    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656211    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656213    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656216    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656218    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656221    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656224    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656227    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656230    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656233    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656235    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656238    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656241    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:22:36.660316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656243    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.656249    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656389    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656408    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656412    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656415    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656417    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656420    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656423    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656426    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656428    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656431    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656434    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656436    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656439    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:22:36.660687 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656442    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656444    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656447    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656449    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656452    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656454    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656457    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656459    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656462    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656465    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656468    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656471    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656474    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656477    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656479    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656482    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656485    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656488    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656491    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656493    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:22:36.661044 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656496    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656499    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656502    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656504    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656507    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656509    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656512    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656514    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656517    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656520    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656522    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656525    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656527    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656530    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656534    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656537    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656540    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656543    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656546    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656549    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:22:36.661551 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656552    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656554    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656557    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656560    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656563    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656566    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656569    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656572    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656574    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656577    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656580    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656582    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656585    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656588    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656592    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656595    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656598    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656601    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656603    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:22:36.662036 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656606    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656609    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656611    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656614    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656616    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656619    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656621    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656624    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656626    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656629    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656631    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656634    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656636    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656639    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656641    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656644    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656646    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656651    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656655    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:22:36.662508 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656658    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:22:36.662969 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656661    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:22:36.662969 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656663    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:22:36.662969 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656666    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:22:36.662969 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656668    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:22:36.662969 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656671    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:22:36.662969 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656674    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:22:36.662969 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:36.656676    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:22:36.662969 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.656682    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 16:22:36.662969 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.656788    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 16:22:36.662969 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.658687    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 16:22:36.662969 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.659616    2562 server.go:1019] "Starting client certificate rotation"
Sep 08 16:22:36.662969 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.659728    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 16:22:36.662969 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.659762    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 16:22:36.663296 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.661887    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 16:22:36.663699 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.663675    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 16:22:36.673786 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.673761    2562 log.go:25] "Validated CRI v1 runtime API"
Sep 08 16:22:36.678799 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.678782    2562 log.go:25] "Validated CRI v1 image API"
Sep 08 16:22:36.680306 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.680293    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 16:22:36.682633 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.682611    2562 fs.go:135] Filesystem UUIDs: map[3784f99e-6333-4ccf-93c2-ee7dcbfa3027:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a2818837-4d04-43d4-ab7f-9f35ca85ba7e:/dev/nvme0n1p4]
Sep 08 16:22:36.682683 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.682633    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 16:22:36.687863 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.687746    2562 manager.go:216] Machine: {Timestamp:2026-09-08 16:22:36.686376273 +0000 UTC m=+0.346152428 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103052 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec255587b3c03f656a09cde8b453eab2 SystemUUID:ec255587-b3c0-3f65-6a09-cde8b453eab2 BootID:05a38a82-d053-49b3-91de-96b04906a1b7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e8:e2:f2:c4:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e8:e2:f2:c4:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:23:8f:73:de:57 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 16:22:36.687863 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.687860    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 16:22:36.687980 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.687945    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 16:22:36.690602 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.690572    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 16:22:36.690748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.690604    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-55.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 16:22:36.691751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.691740    2562 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 16:22:36.691784 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.691754    2562 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 16:22:36.691784 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.691761    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 16:22:36.692450 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.692440    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 16:22:36.693836 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.693826    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 16:22:36.696576 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.696553    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 16:22:36.697975 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.697962    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 16:22:36.698106 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.698096    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 16:22:36.698147 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.698129    2562 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 16:22:36.698147 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.698139    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 16:22:36.698209 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.698152    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 16:22:36.698209 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.698163    2562 kubelet.go:398] "Adding apiserver pod source"
Sep 08 16:22:36.698209 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.698172    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 16:22:36.698581 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.698568    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 16:22:36.698629 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.698587    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 16:22:36.700938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.700921    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 16:22:36.703040 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.703026    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 16:22:36.703118 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.703056    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 16:22:36.703226 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.703215    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 16:22:36.703283 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.703230    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 16:22:36.703283 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.703239    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 16:22:36.703283 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.703245    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 16:22:36.703283 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.703255    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 16:22:36.703283 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.703262    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 16:22:36.704030 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.704019    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 16:22:36.704030 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.704030    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 16:22:36.704092 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.704037    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 16:22:36.704092 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.704043    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 16:22:36.704092 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.704052    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 16:22:36.704092 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.704062    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 16:22:36.704819 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.704807    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 16:22:36.704819 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.704817    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 16:22:36.708625 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.708610    2562 server.go:1268] "Started kubelet"
Sep 08 16:22:36.708760 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.708737    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 16:22:36.708886 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.708709    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 16:22:36.708943 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.708913    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 16:22:36.709593 ip-10-0-139-55 systemd[1]: Started Kubernetes Kubelet.
Sep 08 16:22:36.710146 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.710022    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-55.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 16:22:36.710146 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.710021    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 16:22:36.710675 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.710169    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 16:22:36.711057 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.711011    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 16:22:36.713494 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.713477    2562 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 16:22:36.714183 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.714157    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 16:22:36.715447 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.715429    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 16:22:36.715954 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.715935    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 16:22:36.716182 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.716157    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-55.ec2.internal\" not found"
Sep 08 16:22:36.716753 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.716520    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 16:22:36.717112 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.716980    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 16:22:36.717194 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.717115    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 16:22:36.717481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.717467    2562 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 16:22:36.717481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.717480    2562 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 16:22:36.717936 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.717920    2562 factory.go:55] Registering systemd factory
Sep 08 16:22:36.718091 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.718079    2562 factory.go:223] Registration of the systemd container factory successfully
Sep 08 16:22:36.718479 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.718459    2562 factory.go:153] Registering CRI-O factory
Sep 08 16:22:36.718575 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.718482    2562 factory.go:223] Registration of the crio container factory successfully
Sep 08 16:22:36.718625 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.718582    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 16:22:36.718625 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.718609    2562 factory.go:103] Registering Raw factory
Sep 08 16:22:36.718713 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.718649    2562 manager.go:1196] Started watching for new ooms in manager
Sep 08 16:22:36.719556 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.719537    2562 manager.go:349] Starting recovery of all containers
Sep 08 16:22:36.719823 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.718055    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-55.ec2.internal.18d36506c2cc15d6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-55.ec2.internal,UID:ip-10-0-139-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-55.ec2.internal,},FirstTimestamp:2026-09-08 16:22:36.70858287 +0000 UTC m=+0.368359025,LastTimestamp:2026-09-08 16:22:36.70858287 +0000 UTC m=+0.368359025,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-55.ec2.internal,}"
Sep 08 16:22:36.725854 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.725488    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 16:22:36.725929 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.725856    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 16:22:36.731476 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.731462    2562 manager.go:354] Recovery completed
Sep 08 16:22:36.736324 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.736310    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:22:36.738075 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.738054    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:22:36.738141 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.738084    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:22:36.738141 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.738095    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:22:36.738639 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.738627    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 16:22:36.738639 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.738639    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 16:22:36.738721 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.738646    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:22:36.738721 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.738657    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 16:22:36.739333 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.739311    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:22:36.739421 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.739345    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:22:36.739421 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.739357    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:22:36.739773 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.739763    2562 policy_none.go:49] "None policy: Start"
Sep 08 16:22:36.739814 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.739779    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 16:22:36.739814 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.739788    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 16:22:36.740663 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.740650    2562 policy_none.go:47] "Start"
Sep 08 16:22:36.740736 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.740616    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-55.ec2.internal.18d36506c48e01d2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-55.ec2.internal,UID:ip-10-0-139-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-55.ec2.internal,},FirstTimestamp:2026-09-08 16:22:36.738068946 +0000 UTC m=+0.397845100,LastTimestamp:2026-09-08 16:22:36.738068946 +0000 UTC m=+0.397845100,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-55.ec2.internal,}"
Sep 08 16:22:36.755824 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.755749    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-55.ec2.internal.18d36506c48e538b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-55.ec2.internal,UID:ip-10-0-139-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-55.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-55.ec2.internal,},FirstTimestamp:2026-09-08 16:22:36.738089867 +0000 UTC m=+0.397866021,LastTimestamp:2026-09-08 16:22:36.738089867 +0000 UTC m=+0.397866021,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-55.ec2.internal,}"
Sep 08 16:22:36.761901 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.761825    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-55.ec2.internal.18d36506c48e75eb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-55.ec2.internal,UID:ip-10-0-139-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-55.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-55.ec2.internal,},FirstTimestamp:2026-09-08 16:22:36.738098667 +0000 UTC m=+0.397874821,LastTimestamp:2026-09-08 16:22:36.738098667 +0000 UTC m=+0.397874821,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-55.ec2.internal,}"
Sep 08 16:22:36.768086 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.768068    2562 manager.go:337] "Starting Device Plugin manager"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.768111    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.768125    2562 server.go:87] "Starting device plugin registration server"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.768440    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.768453    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.768685    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.768834    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.768856    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.769562    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.769618    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-55.ec2.internal\" not found"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.770518    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-55.ec2.internal.18d36506c48e01d2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-55.ec2.internal.18d36506c48e01d2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-55.ec2.internal,UID:ip-10-0-139-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-55.ec2.internal,},FirstTimestamp:2026-09-08 16:22:36.738068946 +0000 UTC m=+0.397845100,LastTimestamp:2026-09-08 16:22:36.739329827 +0000 UTC m=+0.399105980,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-55.ec2.internal,}"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.774344    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-55.ec2.internal.18d36506c48e538b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-55.ec2.internal.18d36506c48e538b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-55.ec2.internal,UID:ip-10-0-139-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-55.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-55.ec2.internal,},FirstTimestamp:2026-09-08 16:22:36.738089867 +0000 UTC m=+0.397866021,LastTimestamp:2026-09-08 16:22:36.739351679 +0000 UTC m=+0.399127833,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-55.ec2.internal,}"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.781324    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l2jf4"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.783720    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-55.ec2.internal.18d36506c48e75eb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-55.ec2.internal.18d36506c48e75eb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-55.ec2.internal,UID:ip-10-0-139-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-55.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-55.ec2.internal,},FirstTimestamp:2026-09-08 16:22:36.738098667 +0000 UTC m=+0.397874821,LastTimestamp:2026-09-08 16:22:36.739360778 +0000 UTC m=+0.399136930,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-55.ec2.internal,}"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.790803    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-55.ec2.internal.18d36506c67c3003  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-55.ec2.internal,UID:ip-10-0-139-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-139-55.ec2.internal,},FirstTimestamp:2026-09-08 16:22:36.770455555 +0000 UTC m=+0.430231696,LastTimestamp:2026-09-08 16:22:36.770455555 +0000 UTC m=+0.430231696,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-55.ec2.internal,}"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.798157    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l2jf4"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.868786    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.869875    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:22:36.884022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.869931    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:22:36.884652 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.869947    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:22:36.884652 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.870022    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-55.ec2.internal"
Sep 08 16:22:36.884652 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.875785    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-55.ec2.internal.18d36506c48e01d2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-55.ec2.internal.18d36506c48e01d2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-55.ec2.internal,UID:ip-10-0-139-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-55.ec2.internal,},FirstTimestamp:2026-09-08 16:22:36.738068946 +0000 UTC m=+0.397845100,LastTimestamp:2026-09-08 16:22:36.86991264 +0000 UTC m=+0.529688801,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-55.ec2.internal,}"
Sep 08 16:22:36.888791 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.888690    2562 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-139-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-139-55.ec2.internal"
Sep 08 16:22:36.922839 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.922813    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 16:22:36.923952 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.923933    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 16:22:36.924007 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.923996    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 16:22:36.924041 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.924020    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 16:22:36.924085 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.924064    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 16:22:36.926389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:36.926369    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:22:36.938849 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:36.938834    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-55.ec2.internal\" not found" node="ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.024170 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.024150    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-55.ec2.internal"]
Sep 08 16:22:37.024238 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.024206    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:22:37.025459 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.025444    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:22:37.025553 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.025476    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:22:37.025553 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.025491    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:22:37.028877 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.028864    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:22:37.028994 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.028980    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.029042 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.029012    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:22:37.029567 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.029552    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:22:37.029629 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.029582    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:22:37.029629 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.029592    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:22:37.029629 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.029599    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:22:37.029629 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.029620    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:22:37.029752 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.029632    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:22:37.030685 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.030667    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.030741 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.030690    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:22:37.031987 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.031969    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:22:37.032043 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.032003    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:22:37.032043 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.032019    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:22:37.063856 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:37.063838    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-55.ec2.internal\" not found" node="ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.068028 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:37.068014    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-55.ec2.internal\" not found" node="ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.089170 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.089155    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:22:37.089846 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.089828    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:22:37.089916 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.089852    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:22:37.089916 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.089866    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:22:37.089916 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.089887    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.096104 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.096091    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.096151 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:37.096108    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-55.ec2.internal\": node \"ip-10-0-139-55.ec2.internal\" not found"
Sep 08 16:22:37.118313 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.118297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/008234ea42b83955bfc68b1ca833ddd0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal\" (UID: \"008234ea42b83955bfc68b1ca833ddd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.118421 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.118318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/008234ea42b83955bfc68b1ca833ddd0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal\" (UID: \"008234ea42b83955bfc68b1ca833ddd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.118421 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.118333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb1873c0b5061ed129a3ea1791cda518-config\") pod \"kube-apiserver-proxy-ip-10-0-139-55.ec2.internal\" (UID: \"eb1873c0b5061ed129a3ea1791cda518\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.118497 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:37.118461    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-55.ec2.internal\" not found"
Sep 08 16:22:37.218880 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:37.218835    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-55.ec2.internal\" not found"
Sep 08 16:22:37.218936 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.218889    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb1873c0b5061ed129a3ea1791cda518-config\") pod \"kube-apiserver-proxy-ip-10-0-139-55.ec2.internal\" (UID: \"eb1873c0b5061ed129a3ea1791cda518\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.218936 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.218914    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb1873c0b5061ed129a3ea1791cda518-config\") pod \"kube-apiserver-proxy-ip-10-0-139-55.ec2.internal\" (UID: \"eb1873c0b5061ed129a3ea1791cda518\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.219000 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.218951    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/008234ea42b83955bfc68b1ca833ddd0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal\" (UID: \"008234ea42b83955bfc68b1ca833ddd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.219000 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.218966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/008234ea42b83955bfc68b1ca833ddd0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal\" (UID: \"008234ea42b83955bfc68b1ca833ddd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.219059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.219000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/008234ea42b83955bfc68b1ca833ddd0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal\" (UID: \"008234ea42b83955bfc68b1ca833ddd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.219059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.219037    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/008234ea42b83955bfc68b1ca833ddd0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal\" (UID: \"008234ea42b83955bfc68b1ca833ddd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.319231 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:37.319204    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-55.ec2.internal\" not found"
Sep 08 16:22:37.366370 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.366349    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:37.371174 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:37.371157    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:38.495362 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:38.495342    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-55.ec2.internal\" not found"
Sep 08 16:22:38.595905 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:38.595852    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-55.ec2.internal\" not found"
Sep 08 16:22:38.696234 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:38.696211    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-55.ec2.internal\" not found"
Sep 08 16:22:38.734390 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:38.734372    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 16:22:38.734744 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:38.734484    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 16:22:38.796447 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:38.796426    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-55.ec2.internal\" not found"
Sep 08 16:22:38.897004 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:38.896951    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-55.ec2.internal\" not found"
Sep 08 16:22:38.940619 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:38.940577    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1873c0b5061ed129a3ea1791cda518.slice/crio-d58886036eb7643877565322effe0513fe36a0bcbac0a686a811c66e51a0f3e3 WatchSource:0}: Error finding container d58886036eb7643877565322effe0513fe36a0bcbac0a686a811c66e51a0f3e3: Status 404 returned error can't find the container with id d58886036eb7643877565322effe0513fe36a0bcbac0a686a811c66e51a0f3e3
Sep 08 16:22:38.946009 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:38.945988    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:22:38.959496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:38.959472    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 16:17:37 +0000 UTC" deadline="2028-06-25 22:29:25.885026272 +0000 UTC"
Sep 08 16:22:38.959496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:38.959496    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15750h6m46.925533849s"
Sep 08 16:22:38.961053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:38.961037    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:22:38.992178 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:38.992149    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:39.002187 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.002146    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-55.ec2.internal" event={"ID":"eb1873c0b5061ed129a3ea1791cda518","Type":"ContainerStarted","Data":"d58886036eb7643877565322effe0513fe36a0bcbac0a686a811c66e51a0f3e3"}
Sep 08 16:22:39.003228 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.003215    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 16:22:39.005187 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.005175    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-55.ec2.internal"
Sep 08 16:22:39.014214 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.014199    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 16:22:39.163244 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:39.163226    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008234ea42b83955bfc68b1ca833ddd0.slice/crio-e1760ab8cdfe5a7f9475d086964faf8f9fc16dfa90b71c0d0c35e6db53ccce02 WatchSource:0}: Error finding container e1760ab8cdfe5a7f9475d086964faf8f9fc16dfa90b71c0d0c35e6db53ccce02: Status 404 returned error can't find the container with id e1760ab8cdfe5a7f9475d086964faf8f9fc16dfa90b71c0d0c35e6db53ccce02
Sep 08 16:22:39.188604 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.188580    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:22:39.371367 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.371340    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:22:39.619722 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.619695    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:22:39.774322 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.774295    2562 apiserver.go:52] "Watching apiserver"
Sep 08 16:22:39.781763 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.781738    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 16:22:39.782294 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.782263    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-55.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm","openshift-cluster-node-tuning-operator/tuned-svhgt","openshift-dns/node-resolver-pddhd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal","openshift-multus/multus-additional-cni-plugins-tz45h","openshift-network-operator/iptables-alerter-2c96k","openshift-ovn-kubernetes/ovnkube-node-gqdcb","kube-system/global-pull-secret-syncer-vff9d","kube-system/konnectivity-agent-bfdd5","openshift-image-registry/node-ca-2svs7","openshift-multus/multus-bqjdh","openshift-multus/network-metrics-daemon-r964j","openshift-network-diagnostics/network-check-target-wgm7n"]
Sep 08 16:22:39.783927 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.783907    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2c96k"
Sep 08 16:22:39.785035 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.785008    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:39.785139 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:39.785082    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:22:39.786176 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.786155    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:22:39.786264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.786159    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 16:22:39.786264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.786222    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vkmxp\""
Sep 08 16:22:39.791669 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.790619    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pddhd"
Sep 08 16:22:39.791669 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.790707    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.791669 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.790888    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 16:22:39.791669 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.791561    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 16:22:39.791934 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.791701    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.791934 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.791720    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:39.792348 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:39.792317    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:22:39.793060 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.793037    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 16:22:39.793188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.793174    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 16:22:39.793248 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.793225    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sprr8\""
Sep 08 16:22:39.793301 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.793288    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:39.793346 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.793225    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 16:22:39.793383 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:39.793342    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:22:39.793463 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.793433    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 16:22:39.793584 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.793569    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9mhs7\""
Sep 08 16:22:39.793715 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.793698    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 16:22:39.793796 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.793777    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 16:22:39.793916 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.793896    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 16:22:39.794451 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.794433    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:39.794543 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.794481    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:22:39.795388 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.795192    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jqfln\""
Sep 08 16:22:39.795536 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.795519    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 16:22:39.795843 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.795824    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bfdd5"
Sep 08 16:22:39.796495 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.796477    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 16:22:39.796582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.796514    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c5cvj\""
Sep 08 16:22:39.796582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.796547    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 16:22:39.796708 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.796694    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 16:22:39.797887 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.797870    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 16:22:39.798230 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.798214    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2svs7"
Sep 08 16:22:39.799706 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.799688    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.801006 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.800986    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.801323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b6329a43-ae93-4025-a44d-c8ac03d2f98d-hosts-file\") pod \"node-resolver-pddhd\" (UID: \"b6329a43-ae93-4025-a44d-c8ac03d2f98d\") " pod="openshift-dns/node-resolver-pddhd"
Sep 08 16:22:39.801323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20d04058-f15b-4578-b75b-3266a87d1c50-cnibin\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.801323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20d04058-f15b-4578-b75b-3266a87d1c50-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.801323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4ckn\" (UniqueName: \"kubernetes.io/projected/20d04058-f15b-4578-b75b-3266a87d1c50-kube-api-access-k4ckn\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.801323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssv7l\" (UniqueName: \"kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l\") pod \"network-check-target-wgm7n\" (UID: \"30cfe4d0-49bf-4870-b9a4-a89b0e1059ae\") " pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:39.801323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dg2j\" (UniqueName: \"kubernetes.io/projected/72712ce3-4956-4800-adfe-f16870f5db9c-kube-api-access-7dg2j\") pod \"network-metrics-daemon-r964j\" (UID: \"72712ce3-4956-4800-adfe-f16870f5db9c\") " pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:39.801323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/77b89410-d802-4589-9a49-f590c6f13099-dbus\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:39.801323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:39.801766 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs\") pod \"network-metrics-daemon-r964j\" (UID: \"72712ce3-4956-4800-adfe-f16870f5db9c\") " pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:39.801766 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801379    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c7w2t\""
Sep 08 16:22:39.801766 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801602    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 16:22:39.801766 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801709    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m9lbc\""
Sep 08 16:22:39.801961 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801942    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 16:22:39.802012 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.801380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-sys\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-var-lib-kubelet\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42zcj\" (UniqueName: \"kubernetes.io/projected/20c1e8c6-dff1-430d-a0fa-4430ad299a64-kube-api-access-42zcj\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802175 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6329a43-ae93-4025-a44d-c8ac03d2f98d-tmp-dir\") pod \"node-resolver-pddhd\" (UID: \"b6329a43-ae93-4025-a44d-c8ac03d2f98d\") " pod="openshift-dns/node-resolver-pddhd"
Sep 08 16:22:39.802175 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802083    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zqmnp\""
Sep 08 16:22:39.802175 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20d04058-f15b-4578-b75b-3266a87d1c50-cni-binary-copy\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.802175 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802110    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-run\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802175 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802130    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 16:22:39.802175 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-lib-modules\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802175 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802164    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-sysctl-conf\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802195    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-modprobe-d\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802232    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-host\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802255    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq2v7\" (UniqueName: \"kubernetes.io/projected/b6329a43-ae93-4025-a44d-c8ac03d2f98d-kube-api-access-nq2v7\") pod \"node-resolver-pddhd\" (UID: \"b6329a43-ae93-4025-a44d-c8ac03d2f98d\") " pod="openshift-dns/node-resolver-pddhd"
Sep 08 16:22:39.802496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20d04058-f15b-4578-b75b-3266a87d1c50-system-cni-dir\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.802496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae7fc160-a147-4e7a-84f0-d92bcb24cbfe-host-slash\") pod \"iptables-alerter-2c96k\" (UID: \"ae7fc160-a147-4e7a-84f0-d92bcb24cbfe\") " pod="openshift-network-operator/iptables-alerter-2c96k"
Sep 08 16:22:39.802496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802323    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-sysctl-d\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802345    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-systemd\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20c1e8c6-dff1-430d-a0fa-4430ad299a64-tmp\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802389    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ae7fc160-a147-4e7a-84f0-d92bcb24cbfe-iptables-alerter-script\") pod \"iptables-alerter-2c96k\" (UID: \"ae7fc160-a147-4e7a-84f0-d92bcb24cbfe\") " pod="openshift-network-operator/iptables-alerter-2c96k"
Sep 08 16:22:39.802496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/77b89410-d802-4589-9a49-f590c6f13099-kubelet-config\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:39.802496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20d04058-f15b-4578-b75b-3266a87d1c50-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.802996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802529    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-kubernetes\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20d04058-f15b-4578-b75b-3266a87d1c50-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.802996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802594    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 16:22:39.802996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqd9b\" (UniqueName: \"kubernetes.io/projected/ae7fc160-a147-4e7a-84f0-d92bcb24cbfe-kube-api-access-dqd9b\") pod \"iptables-alerter-2c96k\" (UID: \"ae7fc160-a147-4e7a-84f0-d92bcb24cbfe\") " pod="openshift-network-operator/iptables-alerter-2c96k"
Sep 08 16:22:39.802996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-sysconfig\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802725    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-tuned\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.802996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802838    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 16:22:39.802996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.802974    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 16:22:39.803629 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.803598    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 16:22:39.803832 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.803817    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bwr7c\""
Sep 08 16:22:39.804159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.804142    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 16:22:39.804424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.804405    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 16:22:39.804829 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.804810    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 16:22:39.805064 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.805045    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 16:22:39.805226 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.805207    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 16:22:39.823362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.823344    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-25gck"
Sep 08 16:22:39.830875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.830818    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-25gck"
Sep 08 16:22:39.892682 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.892620    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 16:22:39.903252 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/64529955-8af7-49d3-b481-503e1bb80e57-ovnkube-config\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.903360 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be110726-9f24-4c17-83ef-400240a0ad4a-konnectivity-ca\") pod \"konnectivity-agent-bfdd5\" (UID: \"be110726-9f24-4c17-83ef-400240a0ad4a\") " pod="kube-system/konnectivity-agent-bfdd5"
Sep 08 16:22:39.903360 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-cni-binary-copy\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.903360 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903316    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-var-lib-kubelet\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.903360 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-multus-conf-dir\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.903585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-modprobe-d\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.903585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903425    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-host\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.903585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20d04058-f15b-4578-b75b-3266a87d1c50-system-cni-dir\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.903585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903479    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-system-cni-dir\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.903585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903502    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-etc-kubernetes\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.903585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-modprobe-d\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.903585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-sysctl-d\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.903585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903552    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-systemd\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.903585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903560    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20d04058-f15b-4578-b75b-3266a87d1c50-system-cni-dir\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.903585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20c1e8c6-dff1-430d-a0fa-4430ad299a64-tmp\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/77b89410-d802-4589-9a49-f590c6f13099-kubelet-config\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk6sb\" (UniqueName: \"kubernetes.io/projected/dec3dc9a-0662-4565-91a4-e464d4883d4e-kube-api-access-hk6sb\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20d04058-f15b-4578-b75b-3266a87d1c50-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-device-dir\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903846    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/64529955-8af7-49d3-b481-503e1bb80e57-ovnkube-script-lib\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f973e0f6-5b4e-4cb8-bbc5-2822d47fc567-host\") pod \"node-ca-2svs7\" (UID: \"f973e0f6-5b4e-4cb8-bbc5-2822d47fc567\") " pod="openshift-image-registry/node-ca-2svs7"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-kubernetes\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903914    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr6t9\" (UniqueName: \"kubernetes.io/projected/f973e0f6-5b4e-4cb8-bbc5-2822d47fc567-kube-api-access-qr6t9\") pod \"node-ca-2svs7\" (UID: \"f973e0f6-5b4e-4cb8-bbc5-2822d47fc567\") " pod="openshift-image-registry/node-ca-2svs7"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903937    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-sysconfig\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20d04058-f15b-4578-b75b-3266a87d1c50-cnibin\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903990    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-var-lib-cni-multus\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dg2j\" (UniqueName: \"kubernetes.io/projected/72712ce3-4956-4800-adfe-f16870f5db9c-kube-api-access-7dg2j\") pod \"network-metrics-daemon-r964j\" (UID: \"72712ce3-4956-4800-adfe-f16870f5db9c\") " pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/77b89410-d802-4589-9a49-f590c6f13099-dbus\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904061    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-registration-dir\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:39.904130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904111    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-run-openvswitch\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-sys\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6329a43-ae93-4025-a44d-c8ac03d2f98d-tmp-dir\") pod \"node-resolver-pddhd\" (UID: \"b6329a43-ae93-4025-a44d-c8ac03d2f98d\") " pod="openshift-dns/node-resolver-pddhd"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904180    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-kubelet\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-node-log\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-run-ovn-kubernetes\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904249    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904276    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-sysconfig\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904291    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20d04058-f15b-4578-b75b-3266a87d1c50-cnibin\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/64529955-8af7-49d3-b481-503e1bb80e57-env-overrides\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq8mm\" (UniqueName: \"kubernetes.io/projected/64529955-8af7-49d3-b481-503e1bb80e57-kube-api-access-pq8mm\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-multus-socket-dir-parent\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-run\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-sysctl-conf\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904454    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-etc-openvswitch\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-run-netns\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904499    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-multus-daemon-config\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.904938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq2v7\" (UniqueName: \"kubernetes.io/projected/b6329a43-ae93-4025-a44d-c8ac03d2f98d-kube-api-access-nq2v7\") pod \"node-resolver-pddhd\" (UID: \"b6329a43-ae93-4025-a44d-c8ac03d2f98d\") " pod="openshift-dns/node-resolver-pddhd"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/77b89410-d802-4589-9a49-f590c6f13099-dbus\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae7fc160-a147-4e7a-84f0-d92bcb24cbfe-host-slash\") pod \"iptables-alerter-2c96k\" (UID: \"ae7fc160-a147-4e7a-84f0-d92bcb24cbfe\") " pod="openshift-network-operator/iptables-alerter-2c96k"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-socket-dir\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-slash\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-run-netns\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:39.904663    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903621    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-host\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903684    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-systemd\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:39.904759    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret podName:77b89410-d802-4589-9a49-f590c6f13099 nodeName:}" failed. No retries permitted until 2026-09-08 16:22:40.404717041 +0000 UTC m=+2.989278657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret") pod "global-pull-secret-syncer-vff9d" (UID: "77b89410-d802-4589-9a49-f590c6f13099") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904810    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-sys\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-cnibin\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904846    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-var-lib-cni-bin\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ae7fc160-a147-4e7a-84f0-d92bcb24cbfe-iptables-alerter-script\") pod \"iptables-alerter-2c96k\" (UID: \"ae7fc160-a147-4e7a-84f0-d92bcb24cbfe\") " pod="openshift-network-operator/iptables-alerter-2c96k"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904898    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6329a43-ae93-4025-a44d-c8ac03d2f98d-tmp-dir\") pod \"node-resolver-pddhd\" (UID: \"b6329a43-ae93-4025-a44d-c8ac03d2f98d\") " pod="openshift-dns/node-resolver-pddhd"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-hostroot\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.905690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-run-systemd\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-run-ovn\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-sysctl-d\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-log-socket\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.903734    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/77b89410-d802-4589-9a49-f590c6f13099-kubelet-config\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.904991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f973e0f6-5b4e-4cb8-bbc5-2822d47fc567-serviceca\") pod \"node-ca-2svs7\" (UID: \"f973e0f6-5b4e-4cb8-bbc5-2822d47fc567\") " pod="openshift-image-registry/node-ca-2svs7"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905250    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20d04058-f15b-4578-b75b-3266a87d1c50-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905288    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-kubernetes\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20d04058-f15b-4578-b75b-3266a87d1c50-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqd9b\" (UniqueName: \"kubernetes.io/projected/ae7fc160-a147-4e7a-84f0-d92bcb24cbfe-kube-api-access-dqd9b\") pod \"iptables-alerter-2c96k\" (UID: \"ae7fc160-a147-4e7a-84f0-d92bcb24cbfe\") " pod="openshift-network-operator/iptables-alerter-2c96k"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905390    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae7fc160-a147-4e7a-84f0-d92bcb24cbfe-host-slash\") pod \"iptables-alerter-2c96k\" (UID: \"ae7fc160-a147-4e7a-84f0-d92bcb24cbfe\") " pod="openshift-network-operator/iptables-alerter-2c96k"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-var-lib-openvswitch\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905479    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-run\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-multus-cni-dir\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905588    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ae7fc160-a147-4e7a-84f0-d92bcb24cbfe-iptables-alerter-script\") pod \"iptables-alerter-2c96k\" (UID: \"ae7fc160-a147-4e7a-84f0-d92bcb24cbfe\") " pod="openshift-network-operator/iptables-alerter-2c96k"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-tuned\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905650    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b6329a43-ae93-4025-a44d-c8ac03d2f98d-hosts-file\") pod \"node-resolver-pddhd\" (UID: \"b6329a43-ae93-4025-a44d-c8ac03d2f98d\") " pod="openshift-dns/node-resolver-pddhd"
Sep 08 16:22:39.906481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905766    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-sysctl-conf\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905806    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b6329a43-ae93-4025-a44d-c8ac03d2f98d-hosts-file\") pod \"node-resolver-pddhd\" (UID: \"b6329a43-ae93-4025-a44d-c8ac03d2f98d\") " pod="openshift-dns/node-resolver-pddhd"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905825    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20d04058-f15b-4578-b75b-3266a87d1c50-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905859    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4ckn\" (UniqueName: \"kubernetes.io/projected/20d04058-f15b-4578-b75b-3266a87d1c50-kube-api-access-k4ckn\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.905972    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssv7l\" (UniqueName: \"kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l\") pod \"network-check-target-wgm7n\" (UID: \"30cfe4d0-49bf-4870-b9a4-a89b0e1059ae\") " pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906020    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20d04058-f15b-4578-b75b-3266a87d1c50-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-sys-fs\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906030    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20d04058-f15b-4578-b75b-3266a87d1c50-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906144    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-cni-bin\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be110726-9f24-4c17-83ef-400240a0ad4a-agent-certs\") pod \"konnectivity-agent-bfdd5\" (UID: \"be110726-9f24-4c17-83ef-400240a0ad4a\") " pod="kube-system/konnectivity-agent-bfdd5"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906214    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/64529955-8af7-49d3-b481-503e1bb80e57-ovn-node-metrics-cert\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-run-multus-certs\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs\") pod \"network-metrics-daemon-r964j\" (UID: \"72712ce3-4956-4800-adfe-f16870f5db9c\") " pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-var-lib-kubelet\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:39.906413    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:22:39.907290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906457    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-var-lib-kubelet\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.907964 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:39.906466    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs podName:72712ce3-4956-4800-adfe-f16870f5db9c nodeName:}" failed. No retries permitted until 2026-09-08 16:22:40.406452023 +0000 UTC m=+2.991013634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs") pod "network-metrics-daemon-r964j" (UID: "72712ce3-4956-4800-adfe-f16870f5db9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:22:39.907964 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906493    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42zcj\" (UniqueName: \"kubernetes.io/projected/20c1e8c6-dff1-430d-a0fa-4430ad299a64-kube-api-access-42zcj\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.907964 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20d04058-f15b-4578-b75b-3266a87d1c50-cni-binary-copy\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.907964 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906546    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-systemd-units\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.907964 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-run-k8s-cni-cncf-io\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.907964 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th8w5\" (UniqueName: \"kubernetes.io/projected/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-kube-api-access-th8w5\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:39.907964 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-lib-modules\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.907964 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-cni-netd\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.907964 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906687    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:39.907964 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.906859    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20c1e8c6-dff1-430d-a0fa-4430ad299a64-lib-modules\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.907964 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.907080    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20d04058-f15b-4578-b75b-3266a87d1c50-cni-binary-copy\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.908771 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.908721    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20c1e8c6-dff1-430d-a0fa-4430ad299a64-tmp\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.908771 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.908731    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20c1e8c6-dff1-430d-a0fa-4430ad299a64-etc-tuned\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:39.916771 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:39.916749    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:22:39.916771 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:39.916774    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:22:39.916966 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:39.916788    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ssv7l for pod openshift-network-diagnostics/network-check-target-wgm7n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:22:39.916966 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:39.916837    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l podName:30cfe4d0-49bf-4870-b9a4-a89b0e1059ae nodeName:}" failed. No retries permitted until 2026-09-08 16:22:40.416822894 +0000 UTC m=+3.001384510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ssv7l" (UniqueName: "kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l") pod "network-check-target-wgm7n" (UID: "30cfe4d0-49bf-4870-b9a4-a89b0e1059ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:22:39.918211 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.918155    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq2v7\" (UniqueName: \"kubernetes.io/projected/b6329a43-ae93-4025-a44d-c8ac03d2f98d-kube-api-access-nq2v7\") pod \"node-resolver-pddhd\" (UID: \"b6329a43-ae93-4025-a44d-c8ac03d2f98d\") " pod="openshift-dns/node-resolver-pddhd"
Sep 08 16:22:39.918470 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.918440    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dg2j\" (UniqueName: \"kubernetes.io/projected/72712ce3-4956-4800-adfe-f16870f5db9c-kube-api-access-7dg2j\") pod \"network-metrics-daemon-r964j\" (UID: \"72712ce3-4956-4800-adfe-f16870f5db9c\") " pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:39.919107 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.919082    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqd9b\" (UniqueName: \"kubernetes.io/projected/ae7fc160-a147-4e7a-84f0-d92bcb24cbfe-kube-api-access-dqd9b\") pod \"iptables-alerter-2c96k\" (UID: \"ae7fc160-a147-4e7a-84f0-d92bcb24cbfe\") " pod="openshift-network-operator/iptables-alerter-2c96k"
Sep 08 16:22:39.919926 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.919899    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4ckn\" (UniqueName: \"kubernetes.io/projected/20d04058-f15b-4578-b75b-3266a87d1c50-kube-api-access-k4ckn\") pod \"multus-additional-cni-plugins-tz45h\" (UID: \"20d04058-f15b-4578-b75b-3266a87d1c50\") " pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:39.920188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:39.920169    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42zcj\" (UniqueName: \"kubernetes.io/projected/20c1e8c6-dff1-430d-a0fa-4430ad299a64-kube-api-access-42zcj\") pod \"tuned-svhgt\" (UID: \"20c1e8c6-dff1-430d-a0fa-4430ad299a64\") " pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:40.004475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.004443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal" event={"ID":"008234ea42b83955bfc68b1ca833ddd0","Type":"ContainerStarted","Data":"e1760ab8cdfe5a7f9475d086964faf8f9fc16dfa90b71c0d0c35e6db53ccce02"}
Sep 08 16:22:40.007765 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.007742    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-etc-openvswitch\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.007890 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.007780    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-run-netns\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.007890 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.007799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-multus-daemon-config\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.007890 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.007824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-socket-dir\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.007890 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.007845    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-slash\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.007890 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.007865    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-run-netns\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.007890 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.007864    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-etc-openvswitch\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.007890 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.007886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-cnibin\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.007940    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-slash\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.007982    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-run-netns\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-socket-dir\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008020    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-run-netns\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-var-lib-cni-bin\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008103    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-var-lib-cni-bin\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008072    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-cnibin\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-hostroot\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008170    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-run-systemd\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008177    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-hostroot\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-run-ovn\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008217    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-log-socket\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008234    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-run-systemd\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008235    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-run-ovn\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.008253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008252    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f973e0f6-5b4e-4cb8-bbc5-2822d47fc567-serviceca\") pod \"node-ca-2svs7\" (UID: \"f973e0f6-5b4e-4cb8-bbc5-2822d47fc567\") " pod="openshift-image-registry/node-ca-2svs7"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008279    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-log-socket\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008281    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-var-lib-openvswitch\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008323    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-var-lib-openvswitch\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008344    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-multus-cni-dir\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008387    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-sys-fs\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008409    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-cni-bin\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008447    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-multus-cni-dir\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008471    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-sys-fs\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008476    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-multus-daemon-config\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008508    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be110726-9f24-4c17-83ef-400240a0ad4a-agent-certs\") pod \"konnectivity-agent-bfdd5\" (UID: \"be110726-9f24-4c17-83ef-400240a0ad4a\") " pod="kube-system/konnectivity-agent-bfdd5"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008529    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-cni-bin\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/64529955-8af7-49d3-b481-503e1bb80e57-ovn-node-metrics-cert\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-run-multus-certs\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008652    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-systemd-units\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.009059 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008697    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-run-multus-certs\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008714    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-run-k8s-cni-cncf-io\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008721    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f973e0f6-5b4e-4cb8-bbc5-2822d47fc567-serviceca\") pod \"node-ca-2svs7\" (UID: \"f973e0f6-5b4e-4cb8-bbc5-2822d47fc567\") " pod="openshift-image-registry/node-ca-2svs7"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th8w5\" (UniqueName: \"kubernetes.io/projected/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-kube-api-access-th8w5\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008748    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-systemd-units\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008763    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-cni-netd\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008776    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-run-k8s-cni-cncf-io\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008819    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-cni-netd\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008849    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/64529955-8af7-49d3-b481-503e1bb80e57-ovnkube-config\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008872    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be110726-9f24-4c17-83ef-400240a0ad4a-konnectivity-ca\") pod \"konnectivity-agent-bfdd5\" (UID: \"be110726-9f24-4c17-83ef-400240a0ad4a\") " pod="kube-system/konnectivity-agent-bfdd5"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008887    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-cni-binary-copy\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-var-lib-kubelet\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.008985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-multus-conf-dir\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-system-cni-dir\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-etc-kubernetes\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.009865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk6sb\" (UniqueName: \"kubernetes.io/projected/dec3dc9a-0662-4565-91a4-e464d4883d4e-kube-api-access-hk6sb\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-device-dir\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009120    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/64529955-8af7-49d3-b481-503e1bb80e57-ovnkube-script-lib\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f973e0f6-5b4e-4cb8-bbc5-2822d47fc567-host\") pod \"node-ca-2svs7\" (UID: \"f973e0f6-5b4e-4cb8-bbc5-2822d47fc567\") " pod="openshift-image-registry/node-ca-2svs7"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009167    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr6t9\" (UniqueName: \"kubernetes.io/projected/f973e0f6-5b4e-4cb8-bbc5-2822d47fc567-kube-api-access-qr6t9\") pod \"node-ca-2svs7\" (UID: \"f973e0f6-5b4e-4cb8-bbc5-2822d47fc567\") " pod="openshift-image-registry/node-ca-2svs7"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-var-lib-cni-multus\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009232    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-registration-dir\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009256    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-run-openvswitch\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009282    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-kubelet\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-node-log\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-run-ovn-kubernetes\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009364    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/64529955-8af7-49d3-b481-503e1bb80e57-env-overrides\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009384    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-cni-binary-copy\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009416    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/64529955-8af7-49d3-b481-503e1bb80e57-ovnkube-config\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009438    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-device-dir\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009470    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-etc-kubernetes\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009484    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-var-lib-kubelet\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.010680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009489    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-system-cni-dir\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq8mm\" (UniqueName: \"kubernetes.io/projected/64529955-8af7-49d3-b481-503e1bb80e57-kube-api-access-pq8mm\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009520    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be110726-9f24-4c17-83ef-400240a0ad4a-konnectivity-ca\") pod \"konnectivity-agent-bfdd5\" (UID: \"be110726-9f24-4c17-83ef-400240a0ad4a\") " pod="kube-system/konnectivity-agent-bfdd5"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009533    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dec3dc9a-0662-4565-91a4-e464d4883d4e-registration-dir\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009552    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-multus-socket-dir-parent\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009577    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-multus-conf-dir\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009578    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-run-openvswitch\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009633    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-host-var-lib-cni-multus\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009642    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-kubelet\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009657    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-multus-socket-dir-parent\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009659    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f973e0f6-5b4e-4cb8-bbc5-2822d47fc567-host\") pod \"node-ca-2svs7\" (UID: \"f973e0f6-5b4e-4cb8-bbc5-2822d47fc567\") " pod="openshift-image-registry/node-ca-2svs7"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009659    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-node-log\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009674    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64529955-8af7-49d3-b481-503e1bb80e57-host-run-ovn-kubernetes\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.009989    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/64529955-8af7-49d3-b481-503e1bb80e57-env-overrides\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.011426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.010234    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/64529955-8af7-49d3-b481-503e1bb80e57-ovnkube-script-lib\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.012124 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.011575    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be110726-9f24-4c17-83ef-400240a0ad4a-agent-certs\") pod \"konnectivity-agent-bfdd5\" (UID: \"be110726-9f24-4c17-83ef-400240a0ad4a\") " pod="kube-system/konnectivity-agent-bfdd5"
Sep 08 16:22:40.012527 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.012507    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/64529955-8af7-49d3-b481-503e1bb80e57-ovn-node-metrics-cert\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.020423 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.020399    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq8mm\" (UniqueName: \"kubernetes.io/projected/64529955-8af7-49d3-b481-503e1bb80e57-kube-api-access-pq8mm\") pod \"ovnkube-node-gqdcb\" (UID: \"64529955-8af7-49d3-b481-503e1bb80e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.020852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.020831    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk6sb\" (UniqueName: \"kubernetes.io/projected/dec3dc9a-0662-4565-91a4-e464d4883d4e-kube-api-access-hk6sb\") pod \"aws-ebs-csi-driver-node-4rrtm\" (UID: \"dec3dc9a-0662-4565-91a4-e464d4883d4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.021504 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.021481    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr6t9\" (UniqueName: \"kubernetes.io/projected/f973e0f6-5b4e-4cb8-bbc5-2822d47fc567-kube-api-access-qr6t9\") pod \"node-ca-2svs7\" (UID: \"f973e0f6-5b4e-4cb8-bbc5-2822d47fc567\") " pod="openshift-image-registry/node-ca-2svs7"
Sep 08 16:22:40.022213 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.022194    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th8w5\" (UniqueName: \"kubernetes.io/projected/f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9-kube-api-access-th8w5\") pod \"multus-bqjdh\" (UID: \"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9\") " pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.102273 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.102201    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2c96k"
Sep 08 16:22:40.110006 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.109985    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pddhd"
Sep 08 16:22:40.119674 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.119652    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tz45h"
Sep 08 16:22:40.126297 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.126280    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-svhgt"
Sep 08 16:22:40.134901 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.134885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm"
Sep 08 16:22:40.142739 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.142691    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bfdd5"
Sep 08 16:22:40.149206 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.149190    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2svs7"
Sep 08 16:22:40.156767 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.156751    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bqjdh"
Sep 08 16:22:40.162238 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.162219    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:22:40.413016 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.412929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:40.413016 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.413011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs\") pod \"network-metrics-daemon-r964j\" (UID: \"72712ce3-4956-4800-adfe-f16870f5db9c\") " pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:40.413229 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:40.413088    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:22:40.413229 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:40.413110    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:22:40.413229 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:40.413154    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret podName:77b89410-d802-4589-9a49-f590c6f13099 nodeName:}" failed. No retries permitted until 2026-09-08 16:22:41.413140746 +0000 UTC m=+3.997702488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret") pod "global-pull-secret-syncer-vff9d" (UID: "77b89410-d802-4589-9a49-f590c6f13099") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:22:40.413229 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:40.413174    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs podName:72712ce3-4956-4800-adfe-f16870f5db9c nodeName:}" failed. No retries permitted until 2026-09-08 16:22:41.413164186 +0000 UTC m=+3.997725784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs") pod "network-metrics-daemon-r964j" (UID: "72712ce3-4956-4800-adfe-f16870f5db9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:22:40.513554 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.513525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssv7l\" (UniqueName: \"kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l\") pod \"network-check-target-wgm7n\" (UID: \"30cfe4d0-49bf-4870-b9a4-a89b0e1059ae\") " pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:40.513757 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:40.513736    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:22:40.513831 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:40.513764    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:22:40.513831 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:40.513776    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ssv7l for pod openshift-network-diagnostics/network-check-target-wgm7n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:22:40.513930 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:40.513851    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l podName:30cfe4d0-49bf-4870-b9a4-a89b0e1059ae nodeName:}" failed. No retries permitted until 2026-09-08 16:22:41.513831956 +0000 UTC m=+4.098393574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ssv7l" (UniqueName: "kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l") pod "network-check-target-wgm7n" (UID: "30cfe4d0-49bf-4870-b9a4-a89b0e1059ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:22:40.833315 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.833261    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 16:17:39 +0000 UTC" deadline="2028-06-21 12:31:06.976790614 +0000 UTC"
Sep 08 16:22:40.833315 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:40.833308    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15644h8m26.143485915s"
Sep 08 16:22:40.868897 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:40.868863    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d04058_f15b_4578_b75b_3266a87d1c50.slice/crio-383beabab7c2f1905c05c5657f97406ee6e806184bbecd70dd127067fa8e3bcd WatchSource:0}: Error finding container 383beabab7c2f1905c05c5657f97406ee6e806184bbecd70dd127067fa8e3bcd: Status 404 returned error can't find the container with id 383beabab7c2f1905c05c5657f97406ee6e806184bbecd70dd127067fa8e3bcd
Sep 08 16:22:40.871020 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:40.870998    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7fc160_a147_4e7a_84f0_d92bcb24cbfe.slice/crio-ec1adca9b24b255512d073a66c78712e2bec04c34dd1d6efddc22f3112e99d24 WatchSource:0}: Error finding container ec1adca9b24b255512d073a66c78712e2bec04c34dd1d6efddc22f3112e99d24: Status 404 returned error can't find the container with id ec1adca9b24b255512d073a66c78712e2bec04c34dd1d6efddc22f3112e99d24
Sep 08 16:22:40.874639 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:40.874596    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c1e8c6_dff1_430d_a0fa_4430ad299a64.slice/crio-905f1d1b69795540dcf15e5d4dae70d3eaee918498b351eeb9c756128f8339cd WatchSource:0}: Error finding container 905f1d1b69795540dcf15e5d4dae70d3eaee918498b351eeb9c756128f8339cd: Status 404 returned error can't find the container with id 905f1d1b69795540dcf15e5d4dae70d3eaee918498b351eeb9c756128f8339cd
Sep 08 16:22:40.875339 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:40.875318    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec3dc9a_0662_4565_91a4_e464d4883d4e.slice/crio-ad62bc86516d9c748fb360d40d8d65a306cde1f4b965d4e1cac2035c1c205b4c WatchSource:0}: Error finding container ad62bc86516d9c748fb360d40d8d65a306cde1f4b965d4e1cac2035c1c205b4c: Status 404 returned error can't find the container with id ad62bc86516d9c748fb360d40d8d65a306cde1f4b965d4e1cac2035c1c205b4c
Sep 08 16:22:40.876817 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:40.876795    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf973e0f6_5b4e_4cb8_bbc5_2822d47fc567.slice/crio-24f940384cbdceb53bff17c721ef7b35361305a5d7be73e2fd38adfad4d2a62e WatchSource:0}: Error finding container 24f940384cbdceb53bff17c721ef7b35361305a5d7be73e2fd38adfad4d2a62e: Status 404 returned error can't find the container with id 24f940384cbdceb53bff17c721ef7b35361305a5d7be73e2fd38adfad4d2a62e
Sep 08 16:22:40.877495 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:40.877404    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe110726_9f24_4c17_83ef_400240a0ad4a.slice/crio-7468d817f09ae6df95c552fd657661d38690dabb6868a7dada4b09feb33116a4 WatchSource:0}: Error finding container 7468d817f09ae6df95c552fd657661d38690dabb6868a7dada4b09feb33116a4: Status 404 returned error can't find the container with id 7468d817f09ae6df95c552fd657661d38690dabb6868a7dada4b09feb33116a4
Sep 08 16:22:40.878788 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:40.878765    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64529955_8af7_49d3_b481_503e1bb80e57.slice/crio-d159e275876798b4aff8163cda74b3e003414cf5c06a7f3cb84f1f8bf1528063 WatchSource:0}: Error finding container d159e275876798b4aff8163cda74b3e003414cf5c06a7f3cb84f1f8bf1528063: Status 404 returned error can't find the container with id d159e275876798b4aff8163cda74b3e003414cf5c06a7f3cb84f1f8bf1528063
Sep 08 16:22:40.880095 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:40.880070    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6329a43_ae93_4025_a44d_c8ac03d2f98d.slice/crio-e43fcb902020af08b74411ec24e413f3cd983e0e48ef06ea46e82835550ca908 WatchSource:0}: Error finding container e43fcb902020af08b74411ec24e413f3cd983e0e48ef06ea46e82835550ca908: Status 404 returned error can't find the container with id e43fcb902020af08b74411ec24e413f3cd983e0e48ef06ea46e82835550ca908
Sep 08 16:22:40.881943 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:22:40.881858    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f1ede7_bcaf_469b_a9f0_b388f35c0cf9.slice/crio-91939079679b96647736fb3e319da59a0bd58ce55db150891b92749590c5ecb7 WatchSource:0}: Error finding container 91939079679b96647736fb3e319da59a0bd58ce55db150891b92749590c5ecb7: Status 404 returned error can't find the container with id 91939079679b96647736fb3e319da59a0bd58ce55db150891b92749590c5ecb7
Sep 08 16:22:41.011030 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.011000    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pddhd" event={"ID":"b6329a43-ae93-4025-a44d-c8ac03d2f98d","Type":"ContainerStarted","Data":"e43fcb902020af08b74411ec24e413f3cd983e0e48ef06ea46e82835550ca908"}
Sep 08 16:22:41.012313 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.012279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bfdd5" event={"ID":"be110726-9f24-4c17-83ef-400240a0ad4a","Type":"ContainerStarted","Data":"7468d817f09ae6df95c552fd657661d38690dabb6868a7dada4b09feb33116a4"}
Sep 08 16:22:41.013285 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.013263    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm" event={"ID":"dec3dc9a-0662-4565-91a4-e464d4883d4e","Type":"ContainerStarted","Data":"ad62bc86516d9c748fb360d40d8d65a306cde1f4b965d4e1cac2035c1c205b4c"}
Sep 08 16:22:41.015822 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.015798    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2c96k" event={"ID":"ae7fc160-a147-4e7a-84f0-d92bcb24cbfe","Type":"ContainerStarted","Data":"ec1adca9b24b255512d073a66c78712e2bec04c34dd1d6efddc22f3112e99d24"}
Sep 08 16:22:41.017678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.017654    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tz45h" event={"ID":"20d04058-f15b-4578-b75b-3266a87d1c50","Type":"ContainerStarted","Data":"383beabab7c2f1905c05c5657f97406ee6e806184bbecd70dd127067fa8e3bcd"}
Sep 08 16:22:41.020703 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.020683    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-55.ec2.internal" event={"ID":"eb1873c0b5061ed129a3ea1791cda518","Type":"ContainerStarted","Data":"1ab8dabdd0b6b839fe41eab5b1c5773b938a01ec10709bc9fd1570c2d9bc2c3e"}
Sep 08 16:22:41.021898 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.021876    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bqjdh" event={"ID":"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9","Type":"ContainerStarted","Data":"91939079679b96647736fb3e319da59a0bd58ce55db150891b92749590c5ecb7"}
Sep 08 16:22:41.023064 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.023044    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb" event={"ID":"64529955-8af7-49d3-b481-503e1bb80e57","Type":"ContainerStarted","Data":"d159e275876798b4aff8163cda74b3e003414cf5c06a7f3cb84f1f8bf1528063"}
Sep 08 16:22:41.024190 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.024170    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2svs7" event={"ID":"f973e0f6-5b4e-4cb8-bbc5-2822d47fc567","Type":"ContainerStarted","Data":"24f940384cbdceb53bff17c721ef7b35361305a5d7be73e2fd38adfad4d2a62e"}
Sep 08 16:22:41.025190 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.025174    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-svhgt" event={"ID":"20c1e8c6-dff1-430d-a0fa-4430ad299a64","Type":"ContainerStarted","Data":"905f1d1b69795540dcf15e5d4dae70d3eaee918498b351eeb9c756128f8339cd"}
Sep 08 16:22:41.419664 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.419575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs\") pod \"network-metrics-daemon-r964j\" (UID: \"72712ce3-4956-4800-adfe-f16870f5db9c\") " pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:41.419664 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.419658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:41.419875 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:41.419833    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:22:41.419932 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:41.419893    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret podName:77b89410-d802-4589-9a49-f590c6f13099 nodeName:}" failed. No retries permitted until 2026-09-08 16:22:43.419875396 +0000 UTC m=+6.004436998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret") pod "global-pull-secret-syncer-vff9d" (UID: "77b89410-d802-4589-9a49-f590c6f13099") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:22:41.420337 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:41.420314    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:22:41.420437 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:41.420369    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs podName:72712ce3-4956-4800-adfe-f16870f5db9c nodeName:}" failed. No retries permitted until 2026-09-08 16:22:43.42035446 +0000 UTC m=+6.004916064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs") pod "network-metrics-daemon-r964j" (UID: "72712ce3-4956-4800-adfe-f16870f5db9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:22:41.521241 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.521203    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssv7l\" (UniqueName: \"kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l\") pod \"network-check-target-wgm7n\" (UID: \"30cfe4d0-49bf-4870-b9a4-a89b0e1059ae\") " pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:41.521894 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:41.521443    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:22:41.521894 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:41.521466    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:22:41.521894 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:41.521480    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ssv7l for pod openshift-network-diagnostics/network-check-target-wgm7n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:22:41.521894 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:41.521536    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l podName:30cfe4d0-49bf-4870-b9a4-a89b0e1059ae nodeName:}" failed. No retries permitted until 2026-09-08 16:22:43.521518455 +0000 UTC m=+6.106080067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ssv7l" (UniqueName: "kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l") pod "network-check-target-wgm7n" (UID: "30cfe4d0-49bf-4870-b9a4-a89b0e1059ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:22:41.834271 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.834231    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 16:17:39 +0000 UTC" deadline="2028-06-13 11:12:41.759405686 +0000 UTC"
Sep 08 16:22:41.834271 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:41.834268    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15450h49m59.92514187s"
Sep 08 16:22:42.001094 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:42.000560    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:42.001094 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:42.000713    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:22:42.001094 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:42.000728    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:42.001094 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:42.000836    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:22:42.001094 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:42.000923    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:42.001094 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:42.001009    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:22:42.048654 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:42.039748    2562 generic.go:356] "Generic (PLEG): container finished" podID="008234ea42b83955bfc68b1ca833ddd0" containerID="4a43dd95fdffab729d9e2fbe535f8e2d5f185c3b5726fc9a3a0333f854c2002f" exitCode=0
Sep 08 16:22:42.048654 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:42.040454    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal" event={"ID":"008234ea42b83955bfc68b1ca833ddd0","Type":"ContainerDied","Data":"4a43dd95fdffab729d9e2fbe535f8e2d5f185c3b5726fc9a3a0333f854c2002f"}
Sep 08 16:22:42.063448 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:42.063402    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-55.ec2.internal" podStartSLOduration=3.063383106 podStartE2EDuration="3.063383106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:22:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:22:41.034079289 +0000 UTC m=+3.618640910" watchObservedRunningTime="2026-09-08 16:22:42.063383106 +0000 UTC m=+4.647944726"
Sep 08 16:22:43.081547 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:43.081219    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal" event={"ID":"008234ea42b83955bfc68b1ca833ddd0","Type":"ContainerStarted","Data":"ba1a49ce7089b1273b1aae56eee7e6eb05a5feb2081c116524259793cc17d06e"}
Sep 08 16:22:43.101626 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:43.101560    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-55.ec2.internal" podStartSLOduration=5.101541112 podStartE2EDuration="5.101541112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:22:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:22:43.10106633 +0000 UTC m=+5.685627951" watchObservedRunningTime="2026-09-08 16:22:43.101541112 +0000 UTC m=+5.686102733"
Sep 08 16:22:43.440308 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:43.439469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs\") pod \"network-metrics-daemon-r964j\" (UID: \"72712ce3-4956-4800-adfe-f16870f5db9c\") " pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:43.440308 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:43.439532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:43.440308 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:43.439687    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:22:43.440308 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:43.439759    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret podName:77b89410-d802-4589-9a49-f590c6f13099 nodeName:}" failed. No retries permitted until 2026-09-08 16:22:47.43973155 +0000 UTC m=+10.024293155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret") pod "global-pull-secret-syncer-vff9d" (UID: "77b89410-d802-4589-9a49-f590c6f13099") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:22:43.440308 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:43.440151    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:22:43.440308 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:43.440198    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs podName:72712ce3-4956-4800-adfe-f16870f5db9c nodeName:}" failed. No retries permitted until 2026-09-08 16:22:47.440183665 +0000 UTC m=+10.024745265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs") pod "network-metrics-daemon-r964j" (UID: "72712ce3-4956-4800-adfe-f16870f5db9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:22:43.540000 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:43.539963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssv7l\" (UniqueName: \"kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l\") pod \"network-check-target-wgm7n\" (UID: \"30cfe4d0-49bf-4870-b9a4-a89b0e1059ae\") " pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:43.540163 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:43.540144    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:22:43.540247 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:43.540168    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:22:43.540247 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:43.540182    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ssv7l for pod openshift-network-diagnostics/network-check-target-wgm7n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:22:43.540346 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:43.540246    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l podName:30cfe4d0-49bf-4870-b9a4-a89b0e1059ae nodeName:}" failed. No retries permitted until 2026-09-08 16:22:47.540221528 +0000 UTC m=+10.124783140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ssv7l" (UniqueName: "kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l") pod "network-check-target-wgm7n" (UID: "30cfe4d0-49bf-4870-b9a4-a89b0e1059ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:22:44.000731 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:44.000703    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:44.000901 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:44.000831    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:22:44.000901 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:44.000883    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:44.001058 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:44.001000    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:22:44.001058 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:44.000709    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:44.001168 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:44.001126    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:22:45.999585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:45.999553    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:46.000045 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:45.999553    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:46.000045 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:45.999553    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:46.000045 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:45.999706    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:22:46.000045 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:45.999764    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:22:46.000045 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:45.999838    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:22:47.470972 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:47.470941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:47.471421 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:47.471018    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs\") pod \"network-metrics-daemon-r964j\" (UID: \"72712ce3-4956-4800-adfe-f16870f5db9c\") " pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:47.471421 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:47.471091    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:22:47.471421 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:47.471113    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:22:47.471421 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:47.471152    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret podName:77b89410-d802-4589-9a49-f590c6f13099 nodeName:}" failed. No retries permitted until 2026-09-08 16:22:55.47113292 +0000 UTC m=+18.055694534 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret") pod "global-pull-secret-syncer-vff9d" (UID: "77b89410-d802-4589-9a49-f590c6f13099") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:22:47.471421 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:47.471171    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs podName:72712ce3-4956-4800-adfe-f16870f5db9c nodeName:}" failed. No retries permitted until 2026-09-08 16:22:55.471160865 +0000 UTC m=+18.055722462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs") pod "network-metrics-daemon-r964j" (UID: "72712ce3-4956-4800-adfe-f16870f5db9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:22:47.571945 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:47.571865    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssv7l\" (UniqueName: \"kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l\") pod \"network-check-target-wgm7n\" (UID: \"30cfe4d0-49bf-4870-b9a4-a89b0e1059ae\") " pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:47.572112 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:47.571999    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:22:47.572112 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:47.572023    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:22:47.572112 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:47.572036    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ssv7l for pod openshift-network-diagnostics/network-check-target-wgm7n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:22:47.572112 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:47.572100    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l podName:30cfe4d0-49bf-4870-b9a4-a89b0e1059ae nodeName:}" failed. No retries permitted until 2026-09-08 16:22:55.572081074 +0000 UTC m=+18.156642677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ssv7l" (UniqueName: "kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l") pod "network-check-target-wgm7n" (UID: "30cfe4d0-49bf-4870-b9a4-a89b0e1059ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:22:48.001456 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:48.000680    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:48.001456 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:48.000804    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:22:48.001456 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:48.001209    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:48.001456 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:48.001302    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:22:48.001456 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:48.001356    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:48.001456 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:48.001420    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:22:50.000013 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:49.999950    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:50.000013 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:49.999991    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:50.000626 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:49.999950    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:50.000626 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:50.000086    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:22:50.000626 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:50.000137    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:22:50.000626 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:50.000219    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:22:52.000277 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:52.000247    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:52.000751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:52.000252    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:52.000751 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:52.000353    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:22:52.000751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:52.000250    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:52.000751 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:52.000451    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:22:52.000751 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:52.000550    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:22:53.999414 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:53.999384    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:53.999414 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:53.999399    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:53.999887 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:53.999385    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:53.999887 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:53.999492    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:22:53.999887 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:53.999622    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:22:53.999887 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:53.999715    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:22:55.535914 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:55.535881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:55.536386 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:55.535953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs\") pod \"network-metrics-daemon-r964j\" (UID: \"72712ce3-4956-4800-adfe-f16870f5db9c\") " pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:55.536386 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:55.536057    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:22:55.536386 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:55.536132    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret podName:77b89410-d802-4589-9a49-f590c6f13099 nodeName:}" failed. No retries permitted until 2026-09-08 16:23:11.536112125 +0000 UTC m=+34.120673736 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret") pod "global-pull-secret-syncer-vff9d" (UID: "77b89410-d802-4589-9a49-f590c6f13099") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:22:55.536386 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:55.536065    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:22:55.536386 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:55.536219    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs podName:72712ce3-4956-4800-adfe-f16870f5db9c nodeName:}" failed. No retries permitted until 2026-09-08 16:23:11.536201515 +0000 UTC m=+34.120763114 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs") pod "network-metrics-daemon-r964j" (UID: "72712ce3-4956-4800-adfe-f16870f5db9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:22:55.636500 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:55.636461    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssv7l\" (UniqueName: \"kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l\") pod \"network-check-target-wgm7n\" (UID: \"30cfe4d0-49bf-4870-b9a4-a89b0e1059ae\") " pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:55.636680 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:55.636641    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:22:55.636680 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:55.636668    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:22:55.636797 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:55.636685    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ssv7l for pod openshift-network-diagnostics/network-check-target-wgm7n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:22:55.636797 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:55.636750    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l podName:30cfe4d0-49bf-4870-b9a4-a89b0e1059ae nodeName:}" failed. No retries permitted until 2026-09-08 16:23:11.636731128 +0000 UTC m=+34.221292728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ssv7l" (UniqueName: "kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l") pod "network-check-target-wgm7n" (UID: "30cfe4d0-49bf-4870-b9a4-a89b0e1059ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:22:56.000493 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:56.000026    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:56.000493 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:56.000051    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:56.000493 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:56.000160    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:22:56.000493 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:56.000270    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:22:56.001381 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:56.001064    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:56.001381 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:56.001239    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:22:58.001063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:58.001027    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:58.001063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:58.001054    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:58.001582 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:58.001136    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:22:58.001582 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:58.001260    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:22:58.001582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:58.001280    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:58.001582 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:58.001365    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:22:59.117941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.117725    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pddhd" event={"ID":"b6329a43-ae93-4025-a44d-c8ac03d2f98d","Type":"ContainerStarted","Data":"7110c3f5fb8da388d6e36b7d4b0343e99512b1bcbe039bf77da68dc0cd4bb6f5"}
Sep 08 16:22:59.119344 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.119176    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bfdd5" event={"ID":"be110726-9f24-4c17-83ef-400240a0ad4a","Type":"ContainerStarted","Data":"be4d335418b48f1cc5018d44c02dda98ca3c49f4347546c50f50892d32ee6bd3"}
Sep 08 16:22:59.120579 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.120557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm" event={"ID":"dec3dc9a-0662-4565-91a4-e464d4883d4e","Type":"ContainerStarted","Data":"868d5b16295891632bbc1f207ef5d1c02455b239f68805b7ad2ba9ffae6ffdd3"}
Sep 08 16:22:59.121966 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.121947    2562 generic.go:356] "Generic (PLEG): container finished" podID="20d04058-f15b-4578-b75b-3266a87d1c50" containerID="0d6b66a716513b8961357903de3ea8f391d83e8c246079a35c20c5809ae157cd" exitCode=0
Sep 08 16:22:59.122065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.122022    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tz45h" event={"ID":"20d04058-f15b-4578-b75b-3266a87d1c50","Type":"ContainerDied","Data":"0d6b66a716513b8961357903de3ea8f391d83e8c246079a35c20c5809ae157cd"}
Sep 08 16:22:59.123470 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.123452    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bqjdh" event={"ID":"f5f1ede7-bcaf-469b-a9f0-b388f35c0cf9","Type":"ContainerStarted","Data":"25ba4e1b4f9177a7c93b9caf80f14ebd7d534617283a029f22c47a7847fbdf47"}
Sep 08 16:22:59.126590 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.126572    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb" event={"ID":"64529955-8af7-49d3-b481-503e1bb80e57","Type":"ContainerStarted","Data":"3fe9183e78810c0a4846cea467b7d21346814ce85016d7032f6a5f1a6c15ef0b"}
Sep 08 16:22:59.126721 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.126663    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb" event={"ID":"64529955-8af7-49d3-b481-503e1bb80e57","Type":"ContainerStarted","Data":"12ddc4d800b463c81fe71465430177c86db54aa6b9c800cf06e6654812ae231b"}
Sep 08 16:22:59.126721 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.126713    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb" event={"ID":"64529955-8af7-49d3-b481-503e1bb80e57","Type":"ContainerStarted","Data":"bd0b7c382a597187aa3b45c2c71f97f61b80da17094167390b4537c877099392"}
Sep 08 16:22:59.126837 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.126762    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb" event={"ID":"64529955-8af7-49d3-b481-503e1bb80e57","Type":"ContainerStarted","Data":"6a2ae9ade6a4a126faa81ed56511a4442ba4d5f6b62aa94f8ba6983fb45de471"}
Sep 08 16:22:59.126837 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.126810    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb" event={"ID":"64529955-8af7-49d3-b481-503e1bb80e57","Type":"ContainerStarted","Data":"7e4a52fb4a60b1a3c3fee29431f8b04a435674a8748237d351b78bcecf7e5a85"}
Sep 08 16:22:59.126926 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.126858    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb" event={"ID":"64529955-8af7-49d3-b481-503e1bb80e57","Type":"ContainerStarted","Data":"bcffd680a1a88fcef50ca43c6681613c23849931cfd178db7b96c58f993395f7"}
Sep 08 16:22:59.128008 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.127986    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2svs7" event={"ID":"f973e0f6-5b4e-4cb8-bbc5-2822d47fc567","Type":"ContainerStarted","Data":"e43eb13e648dfedcce211abb16a2bcd5fc9f5a7a50fa9fe9a4dccde23e9ca20f"}
Sep 08 16:22:59.129316 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.129299    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-svhgt" event={"ID":"20c1e8c6-dff1-430d-a0fa-4430ad299a64","Type":"ContainerStarted","Data":"d54fbd9102349b73865e2c5476ca02606a0f5da90259bf4e7590fd483bbc94d0"}
Sep 08 16:22:59.135781 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.135746    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pddhd" podStartSLOduration=3.599384927 podStartE2EDuration="21.135735699s" totalImagesPullingTime="17.536350772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:22:59.135713845 +0000 UTC m=+21.720275462" watchObservedRunningTime="2026-09-08 16:22:59.135735699 +0000 UTC m=+21.720297316"
Sep 08 16:22:59.154036 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.153999    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bfdd5" podStartSLOduration=3.615203914 podStartE2EDuration="21.153988464s" totalImagesPullingTime="17.53878455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:22:59.153757653 +0000 UTC m=+21.738319281" watchObservedRunningTime="2026-09-08 16:22:59.153988464 +0000 UTC m=+21.738550082"
Sep 08 16:22:59.178373 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.178297    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bqjdh" podStartSLOduration=3.586573083 podStartE2EDuration="21.178281119s" totalImagesPullingTime="17.591708036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:22:59.177981413 +0000 UTC m=+21.762543031" watchObservedRunningTime="2026-09-08 16:22:59.178281119 +0000 UTC m=+21.762842738"
Sep 08 16:22:59.224191 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.224154    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-svhgt" podStartSLOduration=3.679408886 podStartE2EDuration="21.224139169s" totalImagesPullingTime="17.544730283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:22:59.223868841 +0000 UTC m=+21.808430458" watchObservedRunningTime="2026-09-08 16:22:59.224139169 +0000 UTC m=+21.808700788"
Sep 08 16:22:59.252838 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.252793    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2svs7" podStartSLOduration=3.708800162 podStartE2EDuration="21.252777503s" totalImagesPullingTime="17.543977341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:22:59.252331323 +0000 UTC m=+21.836892944" watchObservedRunningTime="2026-09-08 16:22:59.252777503 +0000 UTC m=+21.837339123"
Sep 08 16:22:59.990045 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.989999    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 16:22:59.999718 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.999701    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:22:59.999805 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.999702    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:22:59.999855 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:59.999810    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:22:59.999905 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:22:59.999702    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:22:59.999905 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:59.999871    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:22:59.999995 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:22:59.999954    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:23:00.132916 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:00.132841    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm" event={"ID":"dec3dc9a-0662-4565-91a4-e464d4883d4e","Type":"ContainerStarted","Data":"2d62d4f0c623a87323377e5ffc17a281d5a7556705c3df46a1586d554c7c93ab"}
Sep 08 16:23:00.134243 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:00.134208    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2c96k" event={"ID":"ae7fc160-a147-4e7a-84f0-d92bcb24cbfe","Type":"ContainerStarted","Data":"408c306e59753cea5ebd1b238d479b948e568345fb38226b4c6b4e0fd68e94ea"}
Sep 08 16:23:00.152013 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:00.151975    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2c96k" podStartSLOduration=4.597685803 podStartE2EDuration="22.151962762s" totalImagesPullingTime="17.554276959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:00.151746963 +0000 UTC m=+22.736308580" watchObservedRunningTime="2026-09-08 16:23:00.151962762 +0000 UTC m=+22.736524379"
Sep 08 16:23:00.857112 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:00.857008    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T16:22:59.990016378Z","UUID":"029e061c-949c-4296-8975-0574e9bc2406","Handler":null,"Name":"","Endpoint":""}
Sep 08 16:23:00.858656 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:00.858633    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 16:23:00.858778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:00.858668    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 16:23:01.139167 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:01.139134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm" event={"ID":"dec3dc9a-0662-4565-91a4-e464d4883d4e","Type":"ContainerStarted","Data":"4438c7442a5da823bb3b4a71df83c582350de645b8e3cfa666c6e173cd8c7952"}
Sep 08 16:23:01.146877 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:01.146841    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb" event={"ID":"64529955-8af7-49d3-b481-503e1bb80e57","Type":"ContainerStarted","Data":"5cee81ff9ceb23358938930e66bcabdd1875564b688a1c5c7197be286fd88aba"}
Sep 08 16:23:01.159484 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:01.159434    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rrtm" podStartSLOduration=3.462567478 podStartE2EDuration="23.159414289s" totalImagesPullingTime="19.696846811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:22:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:01.158974663 +0000 UTC m=+23.743536282" watchObservedRunningTime="2026-09-08 16:23:01.159414289 +0000 UTC m=+23.743975911"
Sep 08 16:23:02.002379 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:02.002350    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:23:02.002699 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:02.002435    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:23:02.002699 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:02.002440    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:23:02.002699 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:02.002459    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:23:02.002699 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:02.002521    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:23:02.002699 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:02.002582    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:23:03.208790 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:03.208763    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bfdd5"
Sep 08 16:23:03.209501 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:03.209479    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bfdd5"
Sep 08 16:23:04.000261 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:04.000003    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:23:04.000440 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:04.000005    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:23:04.000440 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:04.000371    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:23:04.000574 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:04.000449    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:23:04.000574 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:04.000045    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:23:04.000574 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:04.000563    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:23:04.153308 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:04.153276    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bfdd5"
Sep 08 16:23:04.153850 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:04.153823    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bfdd5"
Sep 08 16:23:05.160430 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:05.160397    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb" event={"ID":"64529955-8af7-49d3-b481-503e1bb80e57","Type":"ContainerStarted","Data":"4bc1c889c58a780162f858b0bdadb16bb63bcff4eecd4f7448f886d384aed8eb"}
Sep 08 16:23:05.161264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:05.160780    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:23:05.161264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:05.160841    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:23:05.162975 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:05.162944    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tz45h" event={"ID":"20d04058-f15b-4578-b75b-3266a87d1c50","Type":"ContainerStarted","Data":"a2f730bb7753c1b917b5a249fac13c4646bb58aa52196d0a4b7f54667e8df6d4"}
Sep 08 16:23:05.175597 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:05.175546    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:23:05.175688 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:05.175659    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:23:05.189306 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:05.189266    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb" podStartSLOduration=9.574229732 podStartE2EDuration="27.189253472s" totalImagesPullingTime="17.61502374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:05.188224511 +0000 UTC m=+27.772786129" watchObservedRunningTime="2026-09-08 16:23:05.189253472 +0000 UTC m=+27.773815092"
Sep 08 16:23:06.000387 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.000357    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:23:06.000540 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.000357    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:23:06.000540 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:06.000474    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:23:06.000635 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:06.000538    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:23:06.000635 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.000356    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:23:06.000710 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:06.000637    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:23:06.097263 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.097227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:06.167188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.167159    2562 generic.go:356] "Generic (PLEG): container finished" podID="20d04058-f15b-4578-b75b-3266a87d1c50" containerID="a2f730bb7753c1b917b5a249fac13c4646bb58aa52196d0a4b7f54667e8df6d4" exitCode=0
Sep 08 16:23:06.167556 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.167228    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tz45h" event={"ID":"20d04058-f15b-4578-b75b-3266a87d1c50","Type":"ContainerDied","Data":"a2f730bb7753c1b917b5a249fac13c4646bb58aa52196d0a4b7f54667e8df6d4"}
Sep 08 16:23:06.167556 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.167505    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:23:06.192804 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.192781    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:06.641771 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.641474    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wgm7n"]
Sep 08 16:23:06.641932 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.641835    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:23:06.641977 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:06.641953    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:23:06.642401 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.642384    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r964j"]
Sep 08 16:23:06.642505 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.642487    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:23:06.642634 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:06.642589    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:23:06.643152 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.643128    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vff9d"]
Sep 08 16:23:06.643245 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:06.643224    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:23:06.643306 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:06.643291    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:23:07.800280 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:07.800169    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:07.864170 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:07.864133    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:08.002482 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:08.002455    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:23:08.002625 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:08.002541    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:23:08.002775 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:08.002634    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:23:08.002775 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:08.002713    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:23:08.174321 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:08.174244    2562 generic.go:356] "Generic (PLEG): container finished" podID="20d04058-f15b-4578-b75b-3266a87d1c50" containerID="995ef9f9a45c49fcf75ccadfb909fa04c5724decf2417629c6257fbf41324599" exitCode=0
Sep 08 16:23:08.174321 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:08.174305    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tz45h" event={"ID":"20d04058-f15b-4578-b75b-3266a87d1c50","Type":"ContainerDied","Data":"995ef9f9a45c49fcf75ccadfb909fa04c5724decf2417629c6257fbf41324599"}
Sep 08 16:23:08.999713 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:08.999684    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:23:09.000101 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:08.999784    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:23:10.003046 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:10.003022    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:23:10.003303 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:10.003060    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:23:10.003303 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:10.003134    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:23:10.003303 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:10.003242    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:23:10.180980 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:10.180911    2562 generic.go:356] "Generic (PLEG): container finished" podID="20d04058-f15b-4578-b75b-3266a87d1c50" containerID="5ed6c6762d9da834b912f6e959accfba8b39bbbc6bed6cd730f5ca718877efaf" exitCode=0
Sep 08 16:23:10.180980 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:10.180974    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tz45h" event={"ID":"20d04058-f15b-4578-b75b-3266a87d1c50","Type":"ContainerDied","Data":"5ed6c6762d9da834b912f6e959accfba8b39bbbc6bed6cd730f5ca718877efaf"}
Sep 08 16:23:11.000043 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:10.999859    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:23:11.000276 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:11.000124    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vff9d" podUID="77b89410-d802-4589-9a49-f590c6f13099"
Sep 08 16:23:11.411122 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:11.411084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:11.460920 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:11.460889    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:11.560990 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:11.560916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs\") pod \"network-metrics-daemon-r964j\" (UID: \"72712ce3-4956-4800-adfe-f16870f5db9c\") " pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:23:11.560990 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:11.560980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:23:11.561172 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:11.561039    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:23:11.561172 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:11.561076    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:23:11.561172 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:11.561094    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs podName:72712ce3-4956-4800-adfe-f16870f5db9c nodeName:}" failed. No retries permitted until 2026-09-08 16:23:43.561080839 +0000 UTC m=+66.145642460 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs") pod "network-metrics-daemon-r964j" (UID: "72712ce3-4956-4800-adfe-f16870f5db9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:23:11.561172 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:11.561126    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret podName:77b89410-d802-4589-9a49-f590c6f13099 nodeName:}" failed. No retries permitted until 2026-09-08 16:23:43.561109987 +0000 UTC m=+66.145671600 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret") pod "global-pull-secret-syncer-vff9d" (UID: "77b89410-d802-4589-9a49-f590c6f13099") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:23:11.662196 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:11.662161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssv7l\" (UniqueName: \"kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l\") pod \"network-check-target-wgm7n\" (UID: \"30cfe4d0-49bf-4870-b9a4-a89b0e1059ae\") " pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:23:11.662355 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:11.662275    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:23:11.662355 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:11.662289    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:23:11.662355 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:11.662298    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ssv7l for pod openshift-network-diagnostics/network-check-target-wgm7n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:23:11.662355 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:11.662351    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l podName:30cfe4d0-49bf-4870-b9a4-a89b0e1059ae nodeName:}" failed. No retries permitted until 2026-09-08 16:23:43.662333854 +0000 UTC m=+66.246895450 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ssv7l" (UniqueName: "kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l") pod "network-check-target-wgm7n" (UID: "30cfe4d0-49bf-4870-b9a4-a89b0e1059ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:23:12.003011 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.002991    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:23:12.003135 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:12.003101    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r964j" podUID="72712ce3-4956-4800-adfe-f16870f5db9c"
Sep 08 16:23:12.003196 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.003177    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:23:12.003310 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:12.003285    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wgm7n" podUID="30cfe4d0-49bf-4870-b9a4-a89b0e1059ae"
Sep 08 16:23:12.158643 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.158597    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-55.ec2.internal" event="NodeReady"
Sep 08 16:23:12.158809 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.158747    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 16:23:12.196428 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.196342    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5984bb4f69-cd7mx"]
Sep 08 16:23:12.211344 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.211318    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-87bwf"]
Sep 08 16:23:12.211667 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.211641    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.214406 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.214374    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 16:23:12.214406 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.214399    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 16:23:12.214655 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.214401    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 16:23:12.214655 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.214428    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l8pfc\""
Sep 08 16:23:12.222845 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.222826    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 16:23:12.229430 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.229408    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ghw5g"]
Sep 08 16:23:12.229588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.229572    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:12.231921 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.231898    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gm7zs\""
Sep 08 16:23:12.232019 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.231922    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 16:23:12.232019 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.231903    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 16:23:12.245598 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.245573    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5984bb4f69-cd7mx"]
Sep 08 16:23:12.245827 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.245803    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghw5g"]
Sep 08 16:23:12.245897 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.245833    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-87bwf"]
Sep 08 16:23:12.245947 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.245937    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghw5g"
Sep 08 16:23:12.248843 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.248323    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 16:23:12.248843 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.248352    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 16:23:12.248843 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.248401    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 16:23:12.248843 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.248680    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4mdpt\""
Sep 08 16:23:12.325252 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.325222    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:12.367985 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.367957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0935a016-aff7-432d-84ab-22e3f583963d-image-registry-private-configuration\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.368154 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.367998    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6k9b\" (UniqueName: \"kubernetes.io/projected/958b9f92-be92-477b-864a-a110e557012d-kube-api-access-r6k9b\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:12.368154 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.368099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q24wb\" (UniqueName: \"kubernetes.io/projected/a06ce30b-c168-43a7-85f9-df2ac83553dd-kube-api-access-q24wb\") pod \"ingress-canary-ghw5g\" (UID: \"a06ce30b-c168-43a7-85f9-df2ac83553dd\") " pod="openshift-ingress-canary/ingress-canary-ghw5g"
Sep 08 16:23:12.368154 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.368134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/958b9f92-be92-477b-864a-a110e557012d-config-volume\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:12.368367 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.368153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/958b9f92-be92-477b-864a-a110e557012d-tmp-dir\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:12.368367 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.368179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0935a016-aff7-432d-84ab-22e3f583963d-installation-pull-secrets\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.368367 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.368209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0935a016-aff7-432d-84ab-22e3f583963d-ca-trust-extracted\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.368367 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.368239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0935a016-aff7-432d-84ab-22e3f583963d-registry-certificates\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.368367 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.368276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.368367 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.368290    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0935a016-aff7-432d-84ab-22e3f583963d-trusted-ca\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.368367 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.368320    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:12.368781 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.368394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-bound-sa-token\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.368781 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.368482    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctss2\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-kube-api-access-ctss2\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.368781 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.368538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a06ce30b-c168-43a7-85f9-df2ac83553dd-cert\") pod \"ingress-canary-ghw5g\" (UID: \"a06ce30b-c168-43a7-85f9-df2ac83553dd\") " pod="openshift-ingress-canary/ingress-canary-ghw5g"
Sep 08 16:23:12.425812 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.425765    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:12.469641 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469557    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-bound-sa-token\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.469641 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctss2\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-kube-api-access-ctss2\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.469641 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469634    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a06ce30b-c168-43a7-85f9-df2ac83553dd-cert\") pod \"ingress-canary-ghw5g\" (UID: \"a06ce30b-c168-43a7-85f9-df2ac83553dd\") " pod="openshift-ingress-canary/ingress-canary-ghw5g"
Sep 08 16:23:12.469854 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0935a016-aff7-432d-84ab-22e3f583963d-image-registry-private-configuration\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.469854 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469688    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6k9b\" (UniqueName: \"kubernetes.io/projected/958b9f92-be92-477b-864a-a110e557012d-kube-api-access-r6k9b\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:12.469854 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469736    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q24wb\" (UniqueName: \"kubernetes.io/projected/a06ce30b-c168-43a7-85f9-df2ac83553dd-kube-api-access-q24wb\") pod \"ingress-canary-ghw5g\" (UID: \"a06ce30b-c168-43a7-85f9-df2ac83553dd\") " pod="openshift-ingress-canary/ingress-canary-ghw5g"
Sep 08 16:23:12.469854 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/958b9f92-be92-477b-864a-a110e557012d-config-volume\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:12.469854 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/958b9f92-be92-477b-864a-a110e557012d-tmp-dir\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:12.469854 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0935a016-aff7-432d-84ab-22e3f583963d-installation-pull-secrets\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.469854 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0935a016-aff7-432d-84ab-22e3f583963d-ca-trust-extracted\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.469854 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0935a016-aff7-432d-84ab-22e3f583963d-registry-certificates\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.470131 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.470131 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0935a016-aff7-432d-84ab-22e3f583963d-trusted-ca\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.470131 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.469900    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:12.470131 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:12.470016    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 16:23:12.470131 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:12.470070    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls podName:958b9f92-be92-477b-864a-a110e557012d nodeName:}" failed. No retries permitted until 2026-09-08 16:23:12.970057596 +0000 UTC m=+35.554619205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls") pod "dns-default-87bwf" (UID: "958b9f92-be92-477b-864a-a110e557012d") : secret "dns-default-metrics-tls" not found
Sep 08 16:23:12.471109 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:12.470675    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 16:23:12.471109 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:12.470700    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5984bb4f69-cd7mx: secret "image-registry-tls" not found
Sep 08 16:23:12.471109 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:12.470750    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls podName:0935a016-aff7-432d-84ab-22e3f583963d nodeName:}" failed. No retries permitted until 2026-09-08 16:23:12.97073258 +0000 UTC m=+35.555294188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls") pod "image-registry-5984bb4f69-cd7mx" (UID: "0935a016-aff7-432d-84ab-22e3f583963d") : secret "image-registry-tls" not found
Sep 08 16:23:12.471109 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.470759    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/958b9f92-be92-477b-864a-a110e557012d-config-volume\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:12.471109 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.471043    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0935a016-aff7-432d-84ab-22e3f583963d-registry-certificates\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.471109 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.471062    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/958b9f92-be92-477b-864a-a110e557012d-tmp-dir\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:12.471489 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.471205    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0935a016-aff7-432d-84ab-22e3f583963d-ca-trust-extracted\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.471770 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.471752    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0935a016-aff7-432d-84ab-22e3f583963d-trusted-ca\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.474728 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.474708    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0935a016-aff7-432d-84ab-22e3f583963d-image-registry-private-configuration\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.474808 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.474766    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a06ce30b-c168-43a7-85f9-df2ac83553dd-cert\") pod \"ingress-canary-ghw5g\" (UID: \"a06ce30b-c168-43a7-85f9-df2ac83553dd\") " pod="openshift-ingress-canary/ingress-canary-ghw5g"
Sep 08 16:23:12.475168 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.475150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0935a016-aff7-432d-84ab-22e3f583963d-installation-pull-secrets\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.478060 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.478039    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-bound-sa-token\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.478330 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.478307    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q24wb\" (UniqueName: \"kubernetes.io/projected/a06ce30b-c168-43a7-85f9-df2ac83553dd-kube-api-access-q24wb\") pod \"ingress-canary-ghw5g\" (UID: \"a06ce30b-c168-43a7-85f9-df2ac83553dd\") " pod="openshift-ingress-canary/ingress-canary-ghw5g"
Sep 08 16:23:12.478920 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.478901    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctss2\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-kube-api-access-ctss2\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.479443 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.479426    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6k9b\" (UniqueName: \"kubernetes.io/projected/958b9f92-be92-477b-864a-a110e557012d-kube-api-access-r6k9b\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:12.555008 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.554971    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghw5g"
Sep 08 16:23:12.880692 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.880623    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghw5g"]
Sep 08 16:23:12.883951 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:23:12.883922    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda06ce30b_c168_43a7_85f9_df2ac83553dd.slice/crio-5817085a1974cf7a51ac1bae0743501f28ef6bed0d491963cc060dc38c0fa78e WatchSource:0}: Error finding container 5817085a1974cf7a51ac1bae0743501f28ef6bed0d491963cc060dc38c0fa78e: Status 404 returned error can't find the container with id 5817085a1974cf7a51ac1bae0743501f28ef6bed0d491963cc060dc38c0fa78e
Sep 08 16:23:12.973790 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.973760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:12.973945 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:12.973805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:12.973945 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:12.973909    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 16:23:12.973945 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:12.973926    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5984bb4f69-cd7mx: secret "image-registry-tls" not found
Sep 08 16:23:12.974081 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:12.973982    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls podName:0935a016-aff7-432d-84ab-22e3f583963d nodeName:}" failed. No retries permitted until 2026-09-08 16:23:13.97396738 +0000 UTC m=+36.558528996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls") pod "image-registry-5984bb4f69-cd7mx" (UID: "0935a016-aff7-432d-84ab-22e3f583963d") : secret "image-registry-tls" not found
Sep 08 16:23:12.974081 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:12.973982    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 16:23:12.974081 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:12.974036    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls podName:958b9f92-be92-477b-864a-a110e557012d nodeName:}" failed. No retries permitted until 2026-09-08 16:23:13.974017754 +0000 UTC m=+36.558579350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls") pod "dns-default-87bwf" (UID: "958b9f92-be92-477b-864a-a110e557012d") : secret "dns-default-metrics-tls" not found
Sep 08 16:23:13.000355 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:13.000322    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:23:13.002924 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:13.002895    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 16:23:13.034525 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:13.034495    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:13.099317 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:13.099284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:13.188815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:13.188738    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghw5g" event={"ID":"a06ce30b-c168-43a7-85f9-df2ac83553dd","Type":"ContainerStarted","Data":"5817085a1974cf7a51ac1bae0743501f28ef6bed0d491963cc060dc38c0fa78e"}
Sep 08 16:23:13.982214 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:13.982170    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:13.983031 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:13.982230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:13.983031 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:13.982344    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 16:23:13.983031 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:13.982348    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 16:23:13.983031 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:13.982365    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5984bb4f69-cd7mx: secret "image-registry-tls" not found
Sep 08 16:23:13.983031 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:13.982414    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls podName:958b9f92-be92-477b-864a-a110e557012d nodeName:}" failed. No retries permitted until 2026-09-08 16:23:15.982395478 +0000 UTC m=+38.566957091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls") pod "dns-default-87bwf" (UID: "958b9f92-be92-477b-864a-a110e557012d") : secret "dns-default-metrics-tls" not found
Sep 08 16:23:13.983031 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:13.982433    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls podName:0935a016-aff7-432d-84ab-22e3f583963d nodeName:}" failed. No retries permitted until 2026-09-08 16:23:15.982423678 +0000 UTC m=+38.566985277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls") pod "image-registry-5984bb4f69-cd7mx" (UID: "0935a016-aff7-432d-84ab-22e3f583963d") : secret "image-registry-tls" not found
Sep 08 16:23:14.003267 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:14.003242    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:23:14.003432 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:14.003411    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:23:14.006729 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:14.006707    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 16:23:14.006862 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:14.006795    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 16:23:14.006965 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:14.006944    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7dt42\""
Sep 08 16:23:14.007075 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:14.007010    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cvc8x\""
Sep 08 16:23:14.007136 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:14.007121    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 16:23:15.197696 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:15.197480    2562 generic.go:356] "Generic (PLEG): container finished" podID="20d04058-f15b-4578-b75b-3266a87d1c50" containerID="9e00501c64237e417764fa644aece451a2aa96ba6631857e238cd6275e89fc54" exitCode=0
Sep 08 16:23:15.198142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:15.197558    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tz45h" event={"ID":"20d04058-f15b-4578-b75b-3266a87d1c50","Type":"ContainerDied","Data":"9e00501c64237e417764fa644aece451a2aa96ba6631857e238cd6275e89fc54"}
Sep 08 16:23:15.998287 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:15.998248    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:15.998470 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:15.998298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:15.998470 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:15.998393    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 16:23:15.998470 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:15.998415    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 16:23:15.998642 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:15.998475    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls podName:958b9f92-be92-477b-864a-a110e557012d nodeName:}" failed. No retries permitted until 2026-09-08 16:23:19.998456885 +0000 UTC m=+42.583018495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls") pod "dns-default-87bwf" (UID: "958b9f92-be92-477b-864a-a110e557012d") : secret "dns-default-metrics-tls" not found
Sep 08 16:23:15.998642 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:15.998417    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5984bb4f69-cd7mx: secret "image-registry-tls" not found
Sep 08 16:23:15.998642 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:15.998539    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls podName:0935a016-aff7-432d-84ab-22e3f583963d nodeName:}" failed. No retries permitted until 2026-09-08 16:23:19.998526508 +0000 UTC m=+42.583088104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls") pod "image-registry-5984bb4f69-cd7mx" (UID: "0935a016-aff7-432d-84ab-22e3f583963d") : secret "image-registry-tls" not found
Sep 08 16:23:16.011151 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.011121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:16.111932 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.111897    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:16.203837 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.203808    2562 generic.go:356] "Generic (PLEG): container finished" podID="20d04058-f15b-4578-b75b-3266a87d1c50" containerID="54547be0d76caadf4493d361f31d2c0f2b9f845c3b359fb4dccba6d8fc805b5f" exitCode=0
Sep 08 16:23:16.203837 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.203848    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tz45h" event={"ID":"20d04058-f15b-4578-b75b-3266a87d1c50","Type":"ContainerDied","Data":"54547be0d76caadf4493d361f31d2c0f2b9f845c3b359fb4dccba6d8fc805b5f"}
Sep 08 16:23:16.305999 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.305888    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:16.368398 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.368333    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:16.419182 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.419151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:16.632814 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.632785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:16.694684 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.694657    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:16.809484 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.809457    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:16.845884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.845827    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c7f99"]
Sep 08 16:23:16.864841 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.864815    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c7f99"]
Sep 08 16:23:16.864972 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.864917    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c7f99"
Sep 08 16:23:16.867993 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.867971    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zsw2x\""
Sep 08 16:23:16.868121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.867997    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 08 16:23:16.868121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.868064    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 08 16:23:16.906090 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.906055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh5ss\" (UniqueName: \"kubernetes.io/projected/a15269f6-add4-4a59-81f3-82c82936a275-kube-api-access-nh5ss\") pod \"migrator-fdbb8fdff-c7f99\" (UID: \"a15269f6-add4-4a59-81f3-82c82936a275\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c7f99"
Sep 08 16:23:16.908798 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.908764    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:16.977549 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:16.977510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:17.007018 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.006989    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh5ss\" (UniqueName: \"kubernetes.io/projected/a15269f6-add4-4a59-81f3-82c82936a275-kube-api-access-nh5ss\") pod \"migrator-fdbb8fdff-c7f99\" (UID: \"a15269f6-add4-4a59-81f3-82c82936a275\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c7f99"
Sep 08 16:23:17.017283 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.017259    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh5ss\" (UniqueName: \"kubernetes.io/projected/a15269f6-add4-4a59-81f3-82c82936a275-kube-api-access-nh5ss\") pod \"migrator-fdbb8fdff-c7f99\" (UID: \"a15269f6-add4-4a59-81f3-82c82936a275\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c7f99"
Sep 08 16:23:17.063466 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.063440    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:17.134196 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.134128    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:17.137732 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.137712    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jbqd8"]
Sep 08 16:23:17.155564 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.155541    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jbqd8"]
Sep 08 16:23:17.155701 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.155664    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.157998 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.157974    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 16:23:17.158174 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.158065    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 16:23:17.158174 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.158079    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qgrb7\""
Sep 08 16:23:17.158174 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.158121    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 16:23:17.158431 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.158380    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 16:23:17.174517 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.174495    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c7f99"
Sep 08 16:23:17.194347 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.194326    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:17.207701 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.207676    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghw5g" event={"ID":"a06ce30b-c168-43a7-85f9-df2ac83553dd","Type":"ContainerStarted","Data":"92a16de167d75201fbbcc20ede2d0b5a0150166dc8981b6c85951b7791bf0e44"}
Sep 08 16:23:17.208064 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.208043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a4d362b-aedd-4fb1-aa25-946674ca2075-crio-socket\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.208175 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.208156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.208249 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.208195    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btz8b\" (UniqueName: \"kubernetes.io/projected/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-api-access-btz8b\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.208298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.208270    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a4d362b-aedd-4fb1-aa25-946674ca2075-data-volume\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.208351 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.208296    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.211282 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.211263    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tz45h" event={"ID":"20d04058-f15b-4578-b75b-3266a87d1c50","Type":"ContainerStarted","Data":"b5e4e91bc10a74f751c04a3d0fbc159779f48c0c805ccdd88027da26367648f9"}
Sep 08 16:23:17.226768 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.226714    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ghw5g" podStartSLOduration=1.396138515 podStartE2EDuration="5.226697191s" totalImagesPullingTime="3.830558676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:23:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:17.22652994 +0000 UTC m=+39.811091560" watchObservedRunningTime="2026-09-08 16:23:17.226697191 +0000 UTC m=+39.811258807"
Sep 08 16:23:17.245412 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.245360    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tz45h" podStartSLOduration=8.535059 podStartE2EDuration="39.24534452s" totalImagesPullingTime="30.71028552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:22:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:17.244436996 +0000 UTC m=+39.828998617" watchObservedRunningTime="2026-09-08 16:23:17.24534452 +0000 UTC m=+39.829906138"
Sep 08 16:23:17.309291 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.309263    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.309446 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.309297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btz8b\" (UniqueName: \"kubernetes.io/projected/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-api-access-btz8b\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.309446 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.309358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a4d362b-aedd-4fb1-aa25-946674ca2075-data-volume\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.309446 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.309383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.309446 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:17.309421    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 16:23:17.309446 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.309436    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a4d362b-aedd-4fb1-aa25-946674ca2075-crio-socket\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.309731 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:17.309480    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls podName:8a4d362b-aedd-4fb1-aa25-946674ca2075 nodeName:}" failed. No retries permitted until 2026-09-08 16:23:17.809463776 +0000 UTC m=+40.394025389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbqd8" (UID: "8a4d362b-aedd-4fb1-aa25-946674ca2075") : secret "insights-runtime-extractor-tls" not found
Sep 08 16:23:17.309731 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:17.309707    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 16:23:17.309842 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.309730    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a4d362b-aedd-4fb1-aa25-946674ca2075-data-volume\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.309842 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:17.309761    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm podName:8a4d362b-aedd-4fb1-aa25-946674ca2075 nodeName:}" failed. No retries permitted until 2026-09-08 16:23:17.809744432 +0000 UTC m=+40.394306033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jbqd8" (UID: "8a4d362b-aedd-4fb1-aa25-946674ca2075") : configmap "kube-rbac-proxy" not found
Sep 08 16:23:17.309961 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.309941    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a4d362b-aedd-4fb1-aa25-946674ca2075-crio-socket\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.324582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.324556    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btz8b\" (UniqueName: \"kubernetes.io/projected/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-api-access-btz8b\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.410256 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.410194    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:17.463552 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.463528    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c7f99"]
Sep 08 16:23:17.466452 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:23:17.466431    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda15269f6_add4_4a59_81f3_82c82936a275.slice/crio-b2a128d068fb297bab564fc9308efefccf99a3eb171ba66c94ae0b35802a4cd8 WatchSource:0}: Error finding container b2a128d068fb297bab564fc9308efefccf99a3eb171ba66c94ae0b35802a4cd8: Status 404 returned error can't find the container with id b2a128d068fb297bab564fc9308efefccf99a3eb171ba66c94ae0b35802a4cd8
Sep 08 16:23:17.469678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.469653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:17.522907 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.522871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:17.685750 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.685675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:17.785437 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.785406    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:17.812918 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.812895    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.813044 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:17.812944    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:17.813044 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:17.813017    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 16:23:17.813154 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:17.813055    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 16:23:17.813154 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:17.813074    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm podName:8a4d362b-aedd-4fb1-aa25-946674ca2075 nodeName:}" failed. No retries permitted until 2026-09-08 16:23:18.81305759 +0000 UTC m=+41.397619188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jbqd8" (UID: "8a4d362b-aedd-4fb1-aa25-946674ca2075") : configmap "kube-rbac-proxy" not found
Sep 08 16:23:17.813154 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:17.813111    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls podName:8a4d362b-aedd-4fb1-aa25-946674ca2075 nodeName:}" failed. No retries permitted until 2026-09-08 16:23:18.813094484 +0000 UTC m=+41.397656097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbqd8" (UID: "8a4d362b-aedd-4fb1-aa25-946674ca2075") : secret "insights-runtime-extractor-tls" not found
Sep 08 16:23:18.214645 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:18.214586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c7f99" event={"ID":"a15269f6-add4-4a59-81f3-82c82936a275","Type":"ContainerStarted","Data":"b2a128d068fb297bab564fc9308efefccf99a3eb171ba66c94ae0b35802a4cd8"}
Sep 08 16:23:18.821460 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:18.821424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:18.821639 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:18.821497    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:18.821639 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:18.821567    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 16:23:18.821639 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:18.821584    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 16:23:18.821782 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:18.821643    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm podName:8a4d362b-aedd-4fb1-aa25-946674ca2075 nodeName:}" failed. No retries permitted until 2026-09-08 16:23:20.821624025 +0000 UTC m=+43.406185638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jbqd8" (UID: "8a4d362b-aedd-4fb1-aa25-946674ca2075") : configmap "kube-rbac-proxy" not found
Sep 08 16:23:18.821782 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:18.821662    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls podName:8a4d362b-aedd-4fb1-aa25-946674ca2075 nodeName:}" failed. No retries permitted until 2026-09-08 16:23:20.821652048 +0000 UTC m=+43.406213650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbqd8" (UID: "8a4d362b-aedd-4fb1-aa25-946674ca2075") : secret "insights-runtime-extractor-tls" not found
Sep 08 16:23:18.931949 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:18.931918    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-l6qqs"]
Sep 08 16:23:18.952778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:18.952752    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-l6qqs"]
Sep 08 16:23:18.952924 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:18.952861    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-l6qqs"
Sep 08 16:23:18.955216 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:18.955194    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 08 16:23:18.955362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:18.955334    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 08 16:23:18.955362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:18.955335    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 08 16:23:18.956146 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:18.956107    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 08 16:23:18.956285 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:18.956262    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gcnxn\""
Sep 08 16:23:19.023658 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.023631    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/826133ea-f68e-4153-addf-12958e05a994-signing-key\") pod \"service-ca-75d99c484-l6qqs\" (UID: \"826133ea-f68e-4153-addf-12958e05a994\") " pod="openshift-service-ca/service-ca-75d99c484-l6qqs"
Sep 08 16:23:19.023792 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.023713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/826133ea-f68e-4153-addf-12958e05a994-signing-cabundle\") pod \"service-ca-75d99c484-l6qqs\" (UID: \"826133ea-f68e-4153-addf-12958e05a994\") " pod="openshift-service-ca/service-ca-75d99c484-l6qqs"
Sep 08 16:23:19.023792 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.023743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqd9m\" (UniqueName: \"kubernetes.io/projected/826133ea-f68e-4153-addf-12958e05a994-kube-api-access-nqd9m\") pod \"service-ca-75d99c484-l6qqs\" (UID: \"826133ea-f68e-4153-addf-12958e05a994\") " pod="openshift-service-ca/service-ca-75d99c484-l6qqs"
Sep 08 16:23:19.124630 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.124540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/826133ea-f68e-4153-addf-12958e05a994-signing-key\") pod \"service-ca-75d99c484-l6qqs\" (UID: \"826133ea-f68e-4153-addf-12958e05a994\") " pod="openshift-service-ca/service-ca-75d99c484-l6qqs"
Sep 08 16:23:19.124630 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.124592    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/826133ea-f68e-4153-addf-12958e05a994-signing-cabundle\") pod \"service-ca-75d99c484-l6qqs\" (UID: \"826133ea-f68e-4153-addf-12958e05a994\") " pod="openshift-service-ca/service-ca-75d99c484-l6qqs"
Sep 08 16:23:19.124831 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.124633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqd9m\" (UniqueName: \"kubernetes.io/projected/826133ea-f68e-4153-addf-12958e05a994-kube-api-access-nqd9m\") pod \"service-ca-75d99c484-l6qqs\" (UID: \"826133ea-f68e-4153-addf-12958e05a994\") " pod="openshift-service-ca/service-ca-75d99c484-l6qqs"
Sep 08 16:23:19.125437 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.125417    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/826133ea-f68e-4153-addf-12958e05a994-signing-cabundle\") pod \"service-ca-75d99c484-l6qqs\" (UID: \"826133ea-f68e-4153-addf-12958e05a994\") " pod="openshift-service-ca/service-ca-75d99c484-l6qqs"
Sep 08 16:23:19.126801 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.126786    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/826133ea-f68e-4153-addf-12958e05a994-signing-key\") pod \"service-ca-75d99c484-l6qqs\" (UID: \"826133ea-f68e-4153-addf-12958e05a994\") " pod="openshift-service-ca/service-ca-75d99c484-l6qqs"
Sep 08 16:23:19.132207 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.132183    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqd9m\" (UniqueName: \"kubernetes.io/projected/826133ea-f68e-4153-addf-12958e05a994-kube-api-access-nqd9m\") pod \"service-ca-75d99c484-l6qqs\" (UID: \"826133ea-f68e-4153-addf-12958e05a994\") " pod="openshift-service-ca/service-ca-75d99c484-l6qqs"
Sep 08 16:23:19.262832 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.262792    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-l6qqs"
Sep 08 16:23:19.458623 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.458563    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:19.518355 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.518319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:19.684451 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.684347    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-l6qqs"]
Sep 08 16:23:19.702902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.702877    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pddhd_b6329a43-ae93-4025-a44d-c8ac03d2f98d/dns-node-resolver/0.log"
Sep 08 16:23:19.737047 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:23:19.737015    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826133ea_f68e_4153_addf_12958e05a994.slice/crio-2ac3668adb4d10bf3339404f29f69f5d16fde0ac4fa9613f5c9c0d84a540d81b WatchSource:0}: Error finding container 2ac3668adb4d10bf3339404f29f69f5d16fde0ac4fa9613f5c9c0d84a540d81b: Status 404 returned error can't find the container with id 2ac3668adb4d10bf3339404f29f69f5d16fde0ac4fa9613f5c9c0d84a540d81b
Sep 08 16:23:19.796458 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:19.796412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:20.031032 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:20.030997    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:20.031032 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:20.031039    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:20.031249 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:20.031139    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 16:23:20.031249 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:20.031183    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls podName:958b9f92-be92-477b-864a-a110e557012d nodeName:}" failed. No retries permitted until 2026-09-08 16:23:28.031170822 +0000 UTC m=+50.615732433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls") pod "dns-default-87bwf" (UID: "958b9f92-be92-477b-864a-a110e557012d") : secret "dns-default-metrics-tls" not found
Sep 08 16:23:20.031249 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:20.031140    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 16:23:20.031249 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:20.031226    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5984bb4f69-cd7mx: secret "image-registry-tls" not found
Sep 08 16:23:20.031381 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:20.031269    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls podName:0935a016-aff7-432d-84ab-22e3f583963d nodeName:}" failed. No retries permitted until 2026-09-08 16:23:28.031256156 +0000 UTC m=+50.615817752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls") pod "image-registry-5984bb4f69-cd7mx" (UID: "0935a016-aff7-432d-84ab-22e3f583963d") : secret "image-registry-tls" not found
Sep 08 16:23:20.221467 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:20.221381    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c7f99" event={"ID":"a15269f6-add4-4a59-81f3-82c82936a275","Type":"ContainerStarted","Data":"93b416cb3708a3594db459e30bbd92986b069d47e4977671139937e44348e67b"}
Sep 08 16:23:20.221467 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:20.221435    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c7f99" event={"ID":"a15269f6-add4-4a59-81f3-82c82936a275","Type":"ContainerStarted","Data":"23f805bb44a36588b3480da77d005985777a0c2498694927208adc3142a43ad7"}
Sep 08 16:23:20.222626 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:20.222589    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-l6qqs" event={"ID":"826133ea-f68e-4153-addf-12958e05a994","Type":"ContainerStarted","Data":"2ac3668adb4d10bf3339404f29f69f5d16fde0ac4fa9613f5c9c0d84a540d81b"}
Sep 08 16:23:20.237681 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:20.237638    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c7f99" podStartSLOduration=1.936607148 podStartE2EDuration="4.237620979s" totalImagesPullingTime="2.301013831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:20.237344653 +0000 UTC m=+42.821906271" watchObservedRunningTime="2026-09-08 16:23:20.237620979 +0000 UTC m=+42.822182589"
Sep 08 16:23:20.303855 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:20.303823    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2svs7_f973e0f6-5b4e-4cb8-bbc5-2822d47fc567/node-ca/0.log"
Sep 08 16:23:20.836394 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:20.836356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:20.836569 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:20.836511    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 16:23:20.836569 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:20.836527    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:20.836716 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:20.836580    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls podName:8a4d362b-aedd-4fb1-aa25-946674ca2075 nodeName:}" failed. No retries permitted until 2026-09-08 16:23:24.836560949 +0000 UTC m=+47.421122566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbqd8" (UID: "8a4d362b-aedd-4fb1-aa25-946674ca2075") : secret "insights-runtime-extractor-tls" not found
Sep 08 16:23:20.836716 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:20.836603    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 16:23:20.836716 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:20.836663    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm podName:8a4d362b-aedd-4fb1-aa25-946674ca2075 nodeName:}" failed. No retries permitted until 2026-09-08 16:23:24.836651885 +0000 UTC m=+47.421213481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jbqd8" (UID: "8a4d362b-aedd-4fb1-aa25-946674ca2075") : configmap "kube-rbac-proxy" not found
Sep 08 16:23:21.303355 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:21.303306    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghw5g_a06ce30b-c168-43a7-85f9-df2ac83553dd/serve-healthcheck-canary/0.log"
Sep 08 16:23:21.503912 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:21.503881    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-c7f99_a15269f6-add4-4a59-81f3-82c82936a275/migrator/0.log"
Sep 08 16:23:21.702058 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:21.702031    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-c7f99_a15269f6-add4-4a59-81f3-82c82936a275/graceful-termination/0.log"
Sep 08 16:23:22.511288 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:22.511238    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:22.571381 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:22.571345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:22.804874 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:22.804799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:22.864516 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:22.864485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:23.230771 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:23.230741    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-l6qqs" event={"ID":"826133ea-f68e-4153-addf-12958e05a994","Type":"ContainerStarted","Data":"78ea9e5c7225f2cb44ec15f431e9b2132247f26028e15d414a026c540eff56d5"}
Sep 08 16:23:23.245138 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:23.245089    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-l6qqs" podStartSLOduration=1.9491765239999999 podStartE2EDuration="5.245076854s" totalImagesPullingTime="3.29590033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:23.244480081 +0000 UTC m=+45.829041701" watchObservedRunningTime="2026-09-08 16:23:23.245076854 +0000 UTC m=+45.829638473"
Sep 08 16:23:24.429646 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:24.429586    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:24.869627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:24.869580    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:24.869994 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:24.869971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:24.870283 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:24.870190    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 16:23:24.870392 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:24.870372    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a4d362b-aedd-4fb1-aa25-946674ca2075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:24.870509 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:24.870497    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls podName:8a4d362b-aedd-4fb1-aa25-946674ca2075 nodeName:}" failed. No retries permitted until 2026-09-08 16:23:32.870475421 +0000 UTC m=+55.455037031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jbqd8" (UID: "8a4d362b-aedd-4fb1-aa25-946674ca2075") : secret "insights-runtime-extractor-tls" not found
Sep 08 16:23:24.982868 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:24.982821    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:25.085506 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:25.085420    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:25.265741 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:25.265708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:25.906256 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:25.906214    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:26.006440 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:26.006411    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:26.333523 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:26.333488    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:26.524178 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:26.524134    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:26.925022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:26.924985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:27.521335 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:27.521288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:27.932063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:27.931985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:28.099373 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.099341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:28.099373 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.099377    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:28.101714 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.101685    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls\") pod \"image-registry-5984bb4f69-cd7mx\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") " pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:28.101826 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.101750    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958b9f92-be92-477b-864a-a110e557012d-metrics-tls\") pod \"dns-default-87bwf\" (UID: \"958b9f92-be92-477b-864a-a110e557012d\") " pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:28.124520 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.124501    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:28.137818 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.137796    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:28.139343 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.139325    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:28.242755 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.242720    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:28.343344 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.343307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:28.399193 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.399165    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5984bb4f69-cd7mx"]
Sep 08 16:23:28.415528 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.415506    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-87bwf"]
Sep 08 16:23:28.432690 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:23:28.432662    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958b9f92_be92_477b_864a_a110e557012d.slice/crio-5f297810324eb4dda9ea6701063098171d9008430fc4aed51d5830efeeb9c87a WatchSource:0}: Error finding container 5f297810324eb4dda9ea6701063098171d9008430fc4aed51d5830efeeb9c87a: Status 404 returned error can't find the container with id 5f297810324eb4dda9ea6701063098171d9008430fc4aed51d5830efeeb9c87a
Sep 08 16:23:28.527602 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.527561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:28.928457 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.928373    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:28.992798 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:28.992763    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:29.246437 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:29.246398    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87bwf" event={"ID":"958b9f92-be92-477b-864a-a110e557012d","Type":"ContainerStarted","Data":"5f297810324eb4dda9ea6701063098171d9008430fc4aed51d5830efeeb9c87a"}
Sep 08 16:23:29.248195 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:29.248168    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx" event={"ID":"0935a016-aff7-432d-84ab-22e3f583963d","Type":"ContainerStarted","Data":"02ae122373a0a08ac2a227c5171f159962ca4acbc77493e9e50fffbd8c352ab6"}
Sep 08 16:23:29.248345 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:29.248222    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx" event={"ID":"0935a016-aff7-432d-84ab-22e3f583963d","Type":"ContainerStarted","Data":"45dc6f39e4cc66f5399f90403bbb6ae6e89779e7bffb365242c88f4970902ea2"}
Sep 08 16:23:29.248345 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:29.248271    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:29.269105 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:29.269057    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx" podStartSLOduration=41.269042604 podStartE2EDuration="41.269042604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:29.268803074 +0000 UTC m=+51.853364698" watchObservedRunningTime="2026-09-08 16:23:29.269042604 +0000 UTC m=+51.853604224"
Sep 08 16:23:29.319167 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:29.319131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:29.923038 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:29.922910    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:30.023249 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:30.023171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:30.076168 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:30.076136    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:30.339824 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:30.339790    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:30.527313 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:30.527288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:30.650407 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:30.650307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:30.810696 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:30.810661    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:31.259067 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:31.259035    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87bwf" event={"ID":"958b9f92-be92-477b-864a-a110e557012d","Type":"ContainerStarted","Data":"cbfcc060ab73d6dc9da1267e59c9ec9b100ad675c5cf63d91d6df864f305b71f"}
Sep 08 16:23:31.259520 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:31.259119    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87bwf" event={"ID":"958b9f92-be92-477b-864a-a110e557012d","Type":"ContainerStarted","Data":"f464ed8aedb564810f0b6c9b7135e685b87b7e0514b23d875002376cb2172a18"}
Sep 08 16:23:31.259520 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:31.259166    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:31.275219 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:31.275154    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-87bwf" podStartSLOduration=17.361009095 podStartE2EDuration="19.275134856s" totalImagesPullingTime="1.914125761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:23:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:31.274560067 +0000 UTC m=+53.859121685" watchObservedRunningTime="2026-09-08 16:23:31.275134856 +0000 UTC m=+53.859696546"
Sep 08 16:23:31.521797 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:31.521715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:31.922182 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:31.922099    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:32.406445 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:32.406415    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:32.724682 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:32.724648    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:32.937433 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:32.937398    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:32.939665 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:32.939635    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a4d362b-aedd-4fb1-aa25-946674ca2075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jbqd8\" (UID: \"8a4d362b-aedd-4fb1-aa25-946674ca2075\") " pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:33.064647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:33.064554    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jbqd8"
Sep 08 16:23:33.128431 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:33.128301    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:33.323583 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:33.323497    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:33.331008 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:33.330843    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jbqd8"]
Sep 08 16:23:33.333484 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:23:33.333458    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a4d362b_aedd_4fb1_aa25_946674ca2075.slice/crio-7631d4433cda98b84ca2fa0fba79a61eb10632bad36b7a9b988c22a846bdf9d6 WatchSource:0}: Error finding container 7631d4433cda98b84ca2fa0fba79a61eb10632bad36b7a9b988c22a846bdf9d6: Status 404 returned error can't find the container with id 7631d4433cda98b84ca2fa0fba79a61eb10632bad36b7a9b988c22a846bdf9d6
Sep 08 16:23:33.722728 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:33.722698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:34.132480 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:34.132337    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:34.268542 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:34.268516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jbqd8" event={"ID":"8a4d362b-aedd-4fb1-aa25-946674ca2075","Type":"ContainerStarted","Data":"83fde8bd557f6a10dd78105757c291f7ce8c38e196d99d9b1952a693011e7e36"}
Sep 08 16:23:34.268670 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:34.268578    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jbqd8" event={"ID":"8a4d362b-aedd-4fb1-aa25-946674ca2075","Type":"ContainerStarted","Data":"7631d4433cda98b84ca2fa0fba79a61eb10632bad36b7a9b988c22a846bdf9d6"}
Sep 08 16:23:34.720441 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:34.720396    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:34.924818 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:34.924786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:35.122006 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:35.121914    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:35.273875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:35.273832    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jbqd8" event={"ID":"8a4d362b-aedd-4fb1-aa25-946674ca2075","Type":"ContainerStarted","Data":"fce6cf23378918c5731eb638f7ffb5c8ba298bf1f3510f1ad5a306c72beb843c"}
Sep 08 16:23:36.279708 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:36.279603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jbqd8" event={"ID":"8a4d362b-aedd-4fb1-aa25-946674ca2075","Type":"ContainerStarted","Data":"3597b730a91b6a61be96b843d9bbfe2dfb1aa0b55ee4f77bd94b6fb8410c8ab1"}
Sep 08 16:23:36.297071 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:36.297021    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jbqd8" podStartSLOduration=16.764888238 podStartE2EDuration="19.297006675s" totalImagesPullingTime="2.532118437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:23:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:36.296038209 +0000 UTC m=+58.880599827" watchObservedRunningTime="2026-09-08 16:23:36.297006675 +0000 UTC m=+58.881568294"
Sep 08 16:23:37.180049 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:37.180021    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gqdcb"
Sep 08 16:23:37.789975 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:37.789937    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:38.281672 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:38.281639    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:41.264120 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.264085    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-87bwf"
Sep 08 16:23:41.739573 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.739524    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"]
Sep 08 16:23:41.742231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.742210    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b"]
Sep 08 16:23:41.742373 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.742352    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"
Sep 08 16:23:41.744192 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.744172    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5984bb4f69-cd7mx"]
Sep 08 16:23:41.744338 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.744320    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b"
Sep 08 16:23:41.745713 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.745687    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 16:23:41.745713 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.745702    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 16:23:41.745888 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.745772    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 08 16:23:41.745888 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.745838    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 16:23:41.746679 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.746661    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-n9lzv\""
Sep 08 16:23:41.748323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.748307    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 08 16:23:41.756292 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.756274    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b"]
Sep 08 16:23:41.757134 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.757113    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"]
Sep 08 16:23:41.804587 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.804551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk8tr\" (UniqueName: \"kubernetes.io/projected/9139f30d-1547-40d6-855e-c298a8c805ec-kube-api-access-xk8tr\") pod \"klusterlet-addon-workmgr-5ffd4565cd-ndd24\" (UID: \"9139f30d-1547-40d6-855e-c298a8c805ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"
Sep 08 16:23:41.804770 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.804595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db6e0a3e-46e0-4eed-8fb3-72d710404e05-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-855f9c5c96-qcj7b\" (UID: \"db6e0a3e-46e0-4eed-8fb3-72d710404e05\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b"
Sep 08 16:23:41.804770 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.804718    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn9vf\" (UniqueName: \"kubernetes.io/projected/db6e0a3e-46e0-4eed-8fb3-72d710404e05-kube-api-access-vn9vf\") pod \"managed-serviceaccount-addon-agent-855f9c5c96-qcj7b\" (UID: \"db6e0a3e-46e0-4eed-8fb3-72d710404e05\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b"
Sep 08 16:23:41.804875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.804784    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9139f30d-1547-40d6-855e-c298a8c805ec-tmp\") pod \"klusterlet-addon-workmgr-5ffd4565cd-ndd24\" (UID: \"9139f30d-1547-40d6-855e-c298a8c805ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"
Sep 08 16:23:41.804875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.804827    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9139f30d-1547-40d6-855e-c298a8c805ec-klusterlet-config\") pod \"klusterlet-addon-workmgr-5ffd4565cd-ndd24\" (UID: \"9139f30d-1547-40d6-855e-c298a8c805ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"
Sep 08 16:23:41.845257 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.845231    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85c8dfddd-2zb9s"]
Sep 08 16:23:41.847095 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.847080    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:41.864012 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.863990    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85c8dfddd-2zb9s"]
Sep 08 16:23:41.875792 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.875769    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:41.906029 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec6d58ed-1fb5-479a-aa31-327be47f48f3-registry-tls\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:41.906155 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ec6d58ed-1fb5-479a-aa31-327be47f48f3-installation-pull-secrets\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:41.906155 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9139f30d-1547-40d6-855e-c298a8c805ec-tmp\") pod \"klusterlet-addon-workmgr-5ffd4565cd-ndd24\" (UID: \"9139f30d-1547-40d6-855e-c298a8c805ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"
Sep 08 16:23:41.906155 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ec6d58ed-1fb5-479a-aa31-327be47f48f3-image-registry-private-configuration\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:41.906317 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9139f30d-1547-40d6-855e-c298a8c805ec-klusterlet-config\") pod \"klusterlet-addon-workmgr-5ffd4565cd-ndd24\" (UID: \"9139f30d-1547-40d6-855e-c298a8c805ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"
Sep 08 16:23:41.906317 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk8tr\" (UniqueName: \"kubernetes.io/projected/9139f30d-1547-40d6-855e-c298a8c805ec-kube-api-access-xk8tr\") pod \"klusterlet-addon-workmgr-5ffd4565cd-ndd24\" (UID: \"9139f30d-1547-40d6-855e-c298a8c805ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"
Sep 08 16:23:41.906317 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db6e0a3e-46e0-4eed-8fb3-72d710404e05-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-855f9c5c96-qcj7b\" (UID: \"db6e0a3e-46e0-4eed-8fb3-72d710404e05\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b"
Sep 08 16:23:41.906317 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn9vf\" (UniqueName: \"kubernetes.io/projected/db6e0a3e-46e0-4eed-8fb3-72d710404e05-kube-api-access-vn9vf\") pod \"managed-serviceaccount-addon-agent-855f9c5c96-qcj7b\" (UID: \"db6e0a3e-46e0-4eed-8fb3-72d710404e05\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b"
Sep 08 16:23:41.906513 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec6d58ed-1fb5-479a-aa31-327be47f48f3-trusted-ca\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:41.906513 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ec6d58ed-1fb5-479a-aa31-327be47f48f3-ca-trust-extracted\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:41.906513 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec6d58ed-1fb5-479a-aa31-327be47f48f3-bound-sa-token\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:41.906513 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906449    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9139f30d-1547-40d6-855e-c298a8c805ec-tmp\") pod \"klusterlet-addon-workmgr-5ffd4565cd-ndd24\" (UID: \"9139f30d-1547-40d6-855e-c298a8c805ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"
Sep 08 16:23:41.906513 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906446    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6xzz\" (UniqueName: \"kubernetes.io/projected/ec6d58ed-1fb5-479a-aa31-327be47f48f3-kube-api-access-x6xzz\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:41.906513 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.906488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ec6d58ed-1fb5-479a-aa31-327be47f48f3-registry-certificates\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:41.908778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.908758    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9139f30d-1547-40d6-855e-c298a8c805ec-klusterlet-config\") pod \"klusterlet-addon-workmgr-5ffd4565cd-ndd24\" (UID: \"9139f30d-1547-40d6-855e-c298a8c805ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"
Sep 08 16:23:41.908857 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.908798    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db6e0a3e-46e0-4eed-8fb3-72d710404e05-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-855f9c5c96-qcj7b\" (UID: \"db6e0a3e-46e0-4eed-8fb3-72d710404e05\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b"
Sep 08 16:23:41.916075 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.916052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk8tr\" (UniqueName: \"kubernetes.io/projected/9139f30d-1547-40d6-855e-c298a8c805ec-kube-api-access-xk8tr\") pod \"klusterlet-addon-workmgr-5ffd4565cd-ndd24\" (UID: \"9139f30d-1547-40d6-855e-c298a8c805ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"
Sep 08 16:23:41.916882 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.916865    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn9vf\" (UniqueName: \"kubernetes.io/projected/db6e0a3e-46e0-4eed-8fb3-72d710404e05-kube-api-access-vn9vf\") pod \"managed-serviceaccount-addon-agent-855f9c5c96-qcj7b\" (UID: \"db6e0a3e-46e0-4eed-8fb3-72d710404e05\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b"
Sep 08 16:23:41.963240 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:41.963207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:42.006968 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.006891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6xzz\" (UniqueName: \"kubernetes.io/projected/ec6d58ed-1fb5-479a-aa31-327be47f48f3-kube-api-access-x6xzz\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.006968 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.006924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ec6d58ed-1fb5-479a-aa31-327be47f48f3-registry-certificates\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.007167 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.006975    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec6d58ed-1fb5-479a-aa31-327be47f48f3-registry-tls\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.007167 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.006993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ec6d58ed-1fb5-479a-aa31-327be47f48f3-installation-pull-secrets\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.007167 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.007028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ec6d58ed-1fb5-479a-aa31-327be47f48f3-image-registry-private-configuration\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.007167 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.007068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec6d58ed-1fb5-479a-aa31-327be47f48f3-trusted-ca\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.007344 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.007195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ec6d58ed-1fb5-479a-aa31-327be47f48f3-ca-trust-extracted\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.007344 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.007270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec6d58ed-1fb5-479a-aa31-327be47f48f3-bound-sa-token\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.007675 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.007648    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ec6d58ed-1fb5-479a-aa31-327be47f48f3-ca-trust-extracted\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.007935 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.007914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ec6d58ed-1fb5-479a-aa31-327be47f48f3-registry-certificates\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.008291 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.008265    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec6d58ed-1fb5-479a-aa31-327be47f48f3-trusted-ca\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.009623 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.009590    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec6d58ed-1fb5-479a-aa31-327be47f48f3-registry-tls\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.009708 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.009602    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ec6d58ed-1fb5-479a-aa31-327be47f48f3-image-registry-private-configuration\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.009708 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.009696    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ec6d58ed-1fb5-479a-aa31-327be47f48f3-installation-pull-secrets\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.016879 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.016857    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec6d58ed-1fb5-479a-aa31-327be47f48f3-bound-sa-token\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.017125 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.017105    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6xzz\" (UniqueName: \"kubernetes.io/projected/ec6d58ed-1fb5-479a-aa31-327be47f48f3-kube-api-access-x6xzz\") pod \"image-registry-85c8dfddd-2zb9s\" (UID: \"ec6d58ed-1fb5-479a-aa31-327be47f48f3\") " pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.053071 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.053045    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"
Sep 08 16:23:42.063230 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.063198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:42.067058 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.067037    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b"
Sep 08 16:23:42.155053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.155019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:42.164362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.164329    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:42.323086 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.323065    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"]
Sep 08 16:23:42.325269 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:23:42.325245    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9139f30d_1547_40d6_855e_c298a8c805ec.slice/crio-ba0a370834038e5bb771886f41ba1cc4dfa54101e8a8de10cad93521aabc7078 WatchSource:0}: Error finding container ba0a370834038e5bb771886f41ba1cc4dfa54101e8a8de10cad93521aabc7078: Status 404 returned error can't find the container with id ba0a370834038e5bb771886f41ba1cc4dfa54101e8a8de10cad93521aabc7078
Sep 08 16:23:42.346486 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.346390    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b"]
Sep 08 16:23:42.348813 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:23:42.348787    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb6e0a3e_46e0_4eed_8fb3_72d710404e05.slice/crio-fa28c7aaefacc6251ac168c5ca64c57791c3fbb2ee8a0500d6ae2dc75e4baedb WatchSource:0}: Error finding container fa28c7aaefacc6251ac168c5ca64c57791c3fbb2ee8a0500d6ae2dc75e4baedb: Status 404 returned error can't find the container with id fa28c7aaefacc6251ac168c5ca64c57791c3fbb2ee8a0500d6ae2dc75e4baedb
Sep 08 16:23:42.422980 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:42.422950    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85c8dfddd-2zb9s"]
Sep 08 16:23:42.426003 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:23:42.425973    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6d58ed_1fb5_479a_aa31_327be47f48f3.slice/crio-9b49156d849b400282c7214d038f14aed18e2c5e92ba637e0aeb410dbc02c0b8 WatchSource:0}: Error finding container 9b49156d849b400282c7214d038f14aed18e2c5e92ba637e0aeb410dbc02c0b8: Status 404 returned error can't find the container with id 9b49156d849b400282c7214d038f14aed18e2c5e92ba637e0aeb410dbc02c0b8
Sep 08 16:23:43.195931 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.195891    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:43.294173 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.294133    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:43.302506 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.302478    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24" event={"ID":"9139f30d-1547-40d6-855e-c298a8c805ec","Type":"ContainerStarted","Data":"ba0a370834038e5bb771886f41ba1cc4dfa54101e8a8de10cad93521aabc7078"}
Sep 08 16:23:43.303968 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.303946    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s" event={"ID":"ec6d58ed-1fb5-479a-aa31-327be47f48f3","Type":"ContainerStarted","Data":"b290b24a05af6e63a36937ca521fc47101c9f8597e3b004860fd1e80e67e4bd0"}
Sep 08 16:23:43.304041 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.303986    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s" event={"ID":"ec6d58ed-1fb5-479a-aa31-327be47f48f3","Type":"ContainerStarted","Data":"9b49156d849b400282c7214d038f14aed18e2c5e92ba637e0aeb410dbc02c0b8"}
Sep 08 16:23:43.304041 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.304010    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:23:43.305031 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.305012    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b" event={"ID":"db6e0a3e-46e0-4eed-8fb3-72d710404e05","Type":"ContainerStarted","Data":"fa28c7aaefacc6251ac168c5ca64c57791c3fbb2ee8a0500d6ae2dc75e4baedb"}
Sep 08 16:23:43.323380 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.323340    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s" podStartSLOduration=2.323327898 podStartE2EDuration="2.323327898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:23:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:43.321594698 +0000 UTC m=+65.906156342" watchObservedRunningTime="2026-09-08 16:23:43.323327898 +0000 UTC m=+65.907889510"
Sep 08 16:23:43.621159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.621063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:23:43.621320 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.621158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs\") pod \"network-metrics-daemon-r964j\" (UID: \"72712ce3-4956-4800-adfe-f16870f5db9c\") " pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:23:43.623745 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.623532    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 16:23:43.623745 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.623693    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 16:23:43.639797 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.639743    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77b89410-d802-4589-9a49-f590c6f13099-original-pull-secret\") pod \"global-pull-secret-syncer-vff9d\" (UID: \"77b89410-d802-4589-9a49-f590c6f13099\") " pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:23:43.639927 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.639901    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72712ce3-4956-4800-adfe-f16870f5db9c-metrics-certs\") pod \"network-metrics-daemon-r964j\" (UID: \"72712ce3-4956-4800-adfe-f16870f5db9c\") " pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:23:43.717849 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.717630    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7dt42\""
Sep 08 16:23:43.721885 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.721834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssv7l\" (UniqueName: \"kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l\") pod \"network-check-target-wgm7n\" (UID: \"30cfe4d0-49bf-4870-b9a4-a89b0e1059ae\") " pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:23:43.723909 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.723886    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 16:23:43.726672 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.726652    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r964j"
Sep 08 16:23:43.734506 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.734486    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 16:23:43.749265 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.749211    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssv7l\" (UniqueName: \"kubernetes.io/projected/30cfe4d0-49bf-4870-b9a4-a89b0e1059ae-kube-api-access-ssv7l\") pod \"network-check-target-wgm7n\" (UID: \"30cfe4d0-49bf-4870-b9a4-a89b0e1059ae\") " pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:23:43.879865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.879713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:43.910559 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.910494    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vff9d"
Sep 08 16:23:43.978061 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:43.978004    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:44.023833 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.023804    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cvc8x\""
Sep 08 16:23:44.031124 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.031052    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r964j"]
Sep 08 16:23:44.032460 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.032240    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:23:44.038790 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.037724    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8"]
Sep 08 16:23:44.039681 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:23:44.039647    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72712ce3_4956_4800_adfe_f16870f5db9c.slice/crio-f9cf44c216c34cbeb1ed869f40bb743de94a12c4539774410d35734d7b4f135a WatchSource:0}: Error finding container f9cf44c216c34cbeb1ed869f40bb743de94a12c4539774410d35734d7b4f135a: Status 404 returned error can't find the container with id f9cf44c216c34cbeb1ed869f40bb743de94a12c4539774410d35734d7b4f135a
Sep 08 16:23:44.041311 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.040656    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8"
Sep 08 16:23:44.043066 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.043045    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 08 16:23:44.043294 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.043276    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-58rpk\""
Sep 08 16:23:44.054210 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.050202    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8"]
Sep 08 16:23:44.057117 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.056942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:44.128162 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.128120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9f897b44-64f0-4a80-a0b6-8c11022c0ed0-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-v8dj8\" (UID: \"9f897b44-64f0-4a80-a0b6-8c11022c0ed0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8"
Sep 08 16:23:44.200416 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.200351    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:44.209366 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.209338    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vff9d"]
Sep 08 16:23:44.216169 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:23:44.216137    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b89410_d802_4589_9a49_f590c6f13099.slice/crio-858b4795b4cfe760df20d9ffc46d730d12f62ff1d623dc727cb8e9219357fdf0 WatchSource:0}: Error finding container 858b4795b4cfe760df20d9ffc46d730d12f62ff1d623dc727cb8e9219357fdf0: Status 404 returned error can't find the container with id 858b4795b4cfe760df20d9ffc46d730d12f62ff1d623dc727cb8e9219357fdf0
Sep 08 16:23:44.230859 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.229373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9f897b44-64f0-4a80-a0b6-8c11022c0ed0-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-v8dj8\" (UID: \"9f897b44-64f0-4a80-a0b6-8c11022c0ed0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8"
Sep 08 16:23:44.230859 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:44.229505    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 16:23:44.230859 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:23:44.229561    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f897b44-64f0-4a80-a0b6-8c11022c0ed0-tls-certificates podName:9f897b44-64f0-4a80-a0b6-8c11022c0ed0 nodeName:}" failed. No retries permitted until 2026-09-08 16:23:44.72954253 +0000 UTC m=+67.314104130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/9f897b44-64f0-4a80-a0b6-8c11022c0ed0-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-v8dj8" (UID: "9f897b44-64f0-4a80-a0b6-8c11022c0ed0") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 16:23:44.313091 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.313058    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vff9d" event={"ID":"77b89410-d802-4589-9a49-f590c6f13099","Type":"ContainerStarted","Data":"858b4795b4cfe760df20d9ffc46d730d12f62ff1d623dc727cb8e9219357fdf0"}
Sep 08 16:23:44.315481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.315457    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r964j" event={"ID":"72712ce3-4956-4800-adfe-f16870f5db9c","Type":"ContainerStarted","Data":"f9cf44c216c34cbeb1ed869f40bb743de94a12c4539774410d35734d7b4f135a"}
Sep 08 16:23:44.366298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.366099    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wgm7n"]
Sep 08 16:23:44.370496 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:23:44.370425    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30cfe4d0_49bf_4870_b9a4_a89b0e1059ae.slice/crio-0add9e7e3751af9a80d108ab284fb5faf665289241e062133c3373b820f4de4c WatchSource:0}: Error finding container 0add9e7e3751af9a80d108ab284fb5faf665289241e062133c3373b820f4de4c: Status 404 returned error can't find the container with id 0add9e7e3751af9a80d108ab284fb5faf665289241e062133c3373b820f4de4c
Sep 08 16:23:44.387451 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.387353    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:44.440545 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.440507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:44.732651 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.732590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9f897b44-64f0-4a80-a0b6-8c11022c0ed0-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-v8dj8\" (UID: \"9f897b44-64f0-4a80-a0b6-8c11022c0ed0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8"
Sep 08 16:23:44.735327 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.735300    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9f897b44-64f0-4a80-a0b6-8c11022c0ed0-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-v8dj8\" (UID: \"9f897b44-64f0-4a80-a0b6-8c11022c0ed0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8"
Sep 08 16:23:44.976275 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:44.976064    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8"
Sep 08 16:23:45.204687 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:45.204651    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:45.349761 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:45.349691    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wgm7n" event={"ID":"30cfe4d0-49bf-4870-b9a4-a89b0e1059ae","Type":"ContainerStarted","Data":"0add9e7e3751af9a80d108ab284fb5faf665289241e062133c3373b820f4de4c"}
Sep 08 16:23:45.620212 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:45.620129    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:45.670545 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:45.670470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:46.948010 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:46.947971    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:47.011202 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:47.011159    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:48.465530 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:48.465496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:48.521245 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:48.521216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:48.735101 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:48.735043    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8"]
Sep 08 16:23:50.504182 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:50.504145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:50.605573 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:50.605533    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:50.780121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:50.780024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:50.875501 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:50.875462    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:50.975557 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:50.975515    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:51.015156 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:23:51.015126    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f897b44_64f0_4a80_a0b6_8c11022c0ed0.slice/crio-c7947ea241d336b28e04f280507f2f274bd8061536ad996d9d64343e0bab2201 WatchSource:0}: Error finding container c7947ea241d336b28e04f280507f2f274bd8061536ad996d9d64343e0bab2201: Status 404 returned error can't find the container with id c7947ea241d336b28e04f280507f2f274bd8061536ad996d9d64343e0bab2201
Sep 08 16:23:51.076449 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.076423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:51.177331 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.177270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:51.282494 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.282454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:51.374169 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.374070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24" event={"ID":"9139f30d-1547-40d6-855e-c298a8c805ec","Type":"ContainerStarted","Data":"a7a7d17fa4944d746d7381e6fb62989460a548ba2eb116eb070ca7e7432cccff"}
Sep 08 16:23:51.374169 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.374167    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"
Sep 08 16:23:51.375719 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.375684    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vff9d" event={"ID":"77b89410-d802-4589-9a49-f590c6f13099","Type":"ContainerStarted","Data":"0576dacee6279741149ee43756e13b45bbbdd1c506fe2b6664724ca4e4fc1c7e"}
Sep 08 16:23:51.376385 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.376359    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24"
Sep 08 16:23:51.377317 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.377295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wgm7n" event={"ID":"30cfe4d0-49bf-4870-b9a4-a89b0e1059ae","Type":"ContainerStarted","Data":"db4f91ea14e7a969438b476e0c340f362533cad4c71eebb0b0637736be8930fa"}
Sep 08 16:23:51.377379 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.377349    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:23:51.378462 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.378441    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8" event={"ID":"9f897b44-64f0-4a80-a0b6-8c11022c0ed0","Type":"ContainerStarted","Data":"c7947ea241d336b28e04f280507f2f274bd8061536ad996d9d64343e0bab2201"}
Sep 08 16:23:51.379800 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.379781    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b" event={"ID":"db6e0a3e-46e0-4eed-8fb3-72d710404e05","Type":"ContainerStarted","Data":"d8751f1f970550963f7126ab818ceb17b3567282b7e6dd4eaa2fc4bc20dfca2c"}
Sep 08 16:23:51.384562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.384540    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r964j" event={"ID":"72712ce3-4956-4800-adfe-f16870f5db9c","Type":"ContainerStarted","Data":"87a66db4aa7f5c824cd6ac6f0444e90a48e4bd33fe6b5028dcb913fb3e213edf"}
Sep 08 16:23:51.384682 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.384582    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r964j" event={"ID":"72712ce3-4956-4800-adfe-f16870f5db9c","Type":"ContainerStarted","Data":"2e02ffe30713477f93a09f45c2b8c9e98f501446adb044f0acd8d4728dce947c"}
Sep 08 16:23:51.395590 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.395322    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffd4565cd-ndd24" podStartSLOduration=1.6821788629999999 podStartE2EDuration="10.395309275s" totalImagesPullingTime="8.713130412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:23:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:51.395141041 +0000 UTC m=+73.979702661" watchObservedRunningTime="2026-09-08 16:23:51.395309275 +0000 UTC m=+73.979870897"
Sep 08 16:23:51.430802 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.430762    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r964j" podStartSLOduration=66.432757725 podStartE2EDuration="1m13.430748912s" totalImagesPullingTime="6.997991187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:51.430019628 +0000 UTC m=+74.014581271" watchObservedRunningTime="2026-09-08 16:23:51.430748912 +0000 UTC m=+74.015310571"
Sep 08 16:23:51.445336 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.445291    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-855f9c5c96-qcj7b" podStartSLOduration=3.155699428 podStartE2EDuration="10.44527978s" totalImagesPullingTime="7.289580352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:23:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:51.445038176 +0000 UTC m=+74.029599796" watchObservedRunningTime="2026-09-08 16:23:51.44527978 +0000 UTC m=+74.029841400"
Sep 08 16:23:51.450755 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.450734    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:51.465468 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.465431    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wgm7n" podStartSLOduration=66.781880463 podStartE2EDuration="1m13.465419145s" totalImagesPullingTime="6.683538682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:51.465177796 +0000 UTC m=+74.049739416" watchObservedRunningTime="2026-09-08 16:23:51.465419145 +0000 UTC m=+74.049980764"
Sep 08 16:23:51.490021 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.489979    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vff9d" podStartSLOduration=66.64629272 podStartE2EDuration="1m13.489963303s" totalImagesPullingTime="6.843670583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:51.489198921 +0000 UTC m=+74.073760555" watchObservedRunningTime="2026-09-08 16:23:51.489963303 +0000 UTC m=+74.074524922"
Sep 08 16:23:51.549713 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.549681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:51.656388 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.656302    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:51.749416 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.749389    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:23:51.841993 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.841957    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:51.946783 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:51.946751    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:52.249579 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:52.249491    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:52.660071 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:52.659991    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:52.800848 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:52.800806    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:52.901918 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:52.901891    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:53.026973 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:53.026940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:53.394206 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:53.394125    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8" event={"ID":"9f897b44-64f0-4a80-a0b6-8c11022c0ed0","Type":"ContainerStarted","Data":"ef017558a2c353c7cd1b31f358c75bee15f347242bde68fef3b738d4deea019d"}
Sep 08 16:23:53.404506 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:53.404473    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:53.412254 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:53.412193    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8" podStartSLOduration=7.663207182 podStartE2EDuration="9.41217725s" totalImagesPullingTime="1.748970068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:23:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:23:53.411389296 +0000 UTC m=+75.995950917" watchObservedRunningTime="2026-09-08 16:23:53.41217725 +0000 UTC m=+75.996738870"
Sep 08 16:23:53.505370 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:53.505337    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:53.605713 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:53.605652    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:53.711361 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:53.711329    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:54.397864 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:54.397833    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8"
Sep 08 16:23:54.402531 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:54.402507    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v8dj8"
Sep 08 16:23:55.128939 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:55.128899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:55.228970 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:55.228943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:55.477279 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:55.477251    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:56.037998 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:56.037964    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:56.139215 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:56.139188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:23:58.218430 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:23:58.218394    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:00.325346 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.325221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:00.422675 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.422632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:00.527388 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.527348    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:00.603463 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.603385    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8vj2d"]
Sep 08 16:24:00.606529 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.606512    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.608902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.608878    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 16:24:00.609015 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.608878    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 16:24:00.609015 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.608878    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 16:24:00.609751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.609603    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vt2q9\""
Sep 08 16:24:00.609751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.609627    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 16:24:00.609751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.609648    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 16:24:00.609751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.609679    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 16:24:00.623952 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.623926    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:00.732129 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.732104    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:00.754281 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.754256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-root\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.754419 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.754300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-wtmp\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.754419 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.754341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.754419 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.754374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-tls\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.754419 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.754402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-textfile\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.754640 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.754456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-sys\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.754640 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.754486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-metrics-client-ca\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.754640 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.754540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-accelerators-collector-config\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.754640 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.754570    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6gcp\" (UniqueName: \"kubernetes.io/projected/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-kube-api-access-z6gcp\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.833578 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.833544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:00.855475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.855402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-accelerators-collector-config\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.855475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.855433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6gcp\" (UniqueName: \"kubernetes.io/projected/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-kube-api-access-z6gcp\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.855475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.855471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-root\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.855729 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.855505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-wtmp\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.855729 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.855535    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.855729 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.855569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-tls\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.855729 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.855595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-textfile\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.855729 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.855601    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-root\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.855729 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.855641    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-sys\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.855729 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.855673    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-metrics-client-ca\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.855729 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:24:00.855714    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 08 16:24:00.856121 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:24:00.855799    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-tls podName:c65b5292-6d36-4eab-ac48-4598e1bf9ee1 nodeName:}" failed. No retries permitted until 2026-09-08 16:24:01.355767809 +0000 UTC m=+83.940329425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-tls") pod "node-exporter-8vj2d" (UID: "c65b5292-6d36-4eab-ac48-4598e1bf9ee1") : secret "node-exporter-tls" not found
Sep 08 16:24:00.856121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.856046    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-sys\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.856121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.856058    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-textfile\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.856121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.856108    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-accelerators-collector-config\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.856336 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.856151    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-wtmp\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.856336 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.856194    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-metrics-client-ca\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.858043 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.858024    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.867487 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.867457    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6gcp\" (UniqueName: \"kubernetes.io/projected/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-kube-api-access-z6gcp\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:00.934294 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:00.934247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:01.034758 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:01.034723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:01.136731 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:01.136651    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:01.230086 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:01.230049    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:01.359602 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:01.359565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-tls\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:01.361884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:01.361860    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c65b5292-6d36-4eab-ac48-4598e1bf9ee1-node-exporter-tls\") pod \"node-exporter-8vj2d\" (UID: \"c65b5292-6d36-4eab-ac48-4598e1bf9ee1\") " pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:01.517822 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:01.517788    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8vj2d"
Sep 08 16:24:01.531027 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:24:01.530981    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65b5292_6d36_4eab_ac48_4598e1bf9ee1.slice/crio-7d9c3d336d9691c97b752f4a8a418244f4fa00ffa359c9a1960edb49fcf8303e WatchSource:0}: Error finding container 7d9c3d336d9691c97b752f4a8a418244f4fa00ffa359c9a1960edb49fcf8303e: Status 404 returned error can't find the container with id 7d9c3d336d9691c97b752f4a8a418244f4fa00ffa359c9a1960edb49fcf8303e
Sep 08 16:24:01.572241 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:01.572211    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:01.647329 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:01.647294    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:02.192897 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:02.192855    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:02.427085 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:02.427046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vj2d" event={"ID":"c65b5292-6d36-4eab-ac48-4598e1bf9ee1","Type":"ContainerStarted","Data":"7d9c3d336d9691c97b752f4a8a418244f4fa00ffa359c9a1960edb49fcf8303e"}
Sep 08 16:24:03.228720 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:03.228684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:03.329959 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:03.329931    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:03.432301 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:03.432260    2562 generic.go:356] "Generic (PLEG): container finished" podID="c65b5292-6d36-4eab-ac48-4598e1bf9ee1" containerID="78f28aa6f78422972cc4aa8b2a7e02988347bfe87b0826e458a875eebbf5f08f" exitCode=0
Sep 08 16:24:03.432689 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:03.432318    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vj2d" event={"ID":"c65b5292-6d36-4eab-ac48-4598e1bf9ee1","Type":"ContainerDied","Data":"78f28aa6f78422972cc4aa8b2a7e02988347bfe87b0826e458a875eebbf5f08f"}
Sep 08 16:24:03.492174 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:03.492137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:03.564551 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:03.564518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:03.747156 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:03.747061    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:03.808064 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:03.808029    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:04.319539 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:04.319509    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85c8dfddd-2zb9s"
Sep 08 16:24:04.438400 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:04.438369    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vj2d" event={"ID":"c65b5292-6d36-4eab-ac48-4598e1bf9ee1","Type":"ContainerStarted","Data":"cb37c2832bd7abc5c24f3533d5d86abb96a23912266faa3685f5c9ad0566ab55"}
Sep 08 16:24:04.438806 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:04.438421    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vj2d" event={"ID":"c65b5292-6d36-4eab-ac48-4598e1bf9ee1","Type":"ContainerStarted","Data":"3ae1d3c6c48ef2f3f932388bc176b2490c95fef1f6c9af9864ea4c92c4f76373"}
Sep 08 16:24:04.445140 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:04.445112    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:04.457913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:04.457870    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8vj2d" podStartSLOduration=3.187910311 podStartE2EDuration="4.457856391s" totalImagesPullingTime="1.20826666s" totalInitContainerRuntime="61.67942ms" isStatefulPod=true podCreationTimestamp="2026-09-08 16:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:24:04.457393385 +0000 UTC m=+87.041955016" watchObservedRunningTime="2026-09-08 16:24:04.457856391 +0000 UTC m=+87.042418010"
Sep 08 16:24:04.559073 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:04.559044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:04.659526 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:04.659445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:05.333893 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:05.333862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:05.397846 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:05.397814    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:05.843023 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:05.842990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:06.765310 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:06.765274    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx" podUID="0935a016-aff7-432d-84ab-22e3f583963d" containerName="registry" containerID="cri-o://02ae122373a0a08ac2a227c5171f159962ca4acbc77493e9e50fffbd8c352ab6" gracePeriod=30
Sep 08 16:24:06.816978 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:06.816946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:07.012014 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.011986    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:24:07.205645 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.205588    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0935a016-aff7-432d-84ab-22e3f583963d-image-registry-private-configuration\") pod \"0935a016-aff7-432d-84ab-22e3f583963d\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") "
Sep 08 16:24:07.205825 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.205656    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0935a016-aff7-432d-84ab-22e3f583963d-trusted-ca\") pod \"0935a016-aff7-432d-84ab-22e3f583963d\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") "
Sep 08 16:24:07.205825 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.205684    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-bound-sa-token\") pod \"0935a016-aff7-432d-84ab-22e3f583963d\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") "
Sep 08 16:24:07.205825 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.205716    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0935a016-aff7-432d-84ab-22e3f583963d-registry-certificates\") pod \"0935a016-aff7-432d-84ab-22e3f583963d\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") "
Sep 08 16:24:07.205825 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.205739    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0935a016-aff7-432d-84ab-22e3f583963d-installation-pull-secrets\") pod \"0935a016-aff7-432d-84ab-22e3f583963d\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") "
Sep 08 16:24:07.205825 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.205774    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0935a016-aff7-432d-84ab-22e3f583963d-ca-trust-extracted\") pod \"0935a016-aff7-432d-84ab-22e3f583963d\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") "
Sep 08 16:24:07.206075 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.205846    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctss2\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-kube-api-access-ctss2\") pod \"0935a016-aff7-432d-84ab-22e3f583963d\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") "
Sep 08 16:24:07.206075 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.205887    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls\") pod \"0935a016-aff7-432d-84ab-22e3f583963d\" (UID: \"0935a016-aff7-432d-84ab-22e3f583963d\") "
Sep 08 16:24:07.206251 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.206212    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0935a016-aff7-432d-84ab-22e3f583963d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0935a016-aff7-432d-84ab-22e3f583963d" (UID: "0935a016-aff7-432d-84ab-22e3f583963d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:24:07.206333 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.206248    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0935a016-aff7-432d-84ab-22e3f583963d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0935a016-aff7-432d-84ab-22e3f583963d" (UID: "0935a016-aff7-432d-84ab-22e3f583963d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:24:07.208228 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.208196    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0935a016-aff7-432d-84ab-22e3f583963d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0935a016-aff7-432d-84ab-22e3f583963d" (UID: "0935a016-aff7-432d-84ab-22e3f583963d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:24:07.208511 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.208486    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0935a016-aff7-432d-84ab-22e3f583963d" (UID: "0935a016-aff7-432d-84ab-22e3f583963d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:24:07.208628 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.208525    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0935a016-aff7-432d-84ab-22e3f583963d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0935a016-aff7-432d-84ab-22e3f583963d" (UID: "0935a016-aff7-432d-84ab-22e3f583963d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:24:07.208628 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.208581    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-kube-api-access-ctss2" (OuterVolumeSpecName: "kube-api-access-ctss2") pod "0935a016-aff7-432d-84ab-22e3f583963d" (UID: "0935a016-aff7-432d-84ab-22e3f583963d"). InnerVolumeSpecName "kube-api-access-ctss2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:24:07.208748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.208640    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0935a016-aff7-432d-84ab-22e3f583963d" (UID: "0935a016-aff7-432d-84ab-22e3f583963d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:24:07.214156 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.214124    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0935a016-aff7-432d-84ab-22e3f583963d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0935a016-aff7-432d-84ab-22e3f583963d" (UID: "0935a016-aff7-432d-84ab-22e3f583963d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:24:07.307359 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.307315    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0935a016-aff7-432d-84ab-22e3f583963d-ca-trust-extracted\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:24:07.307359 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.307349    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctss2\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-kube-api-access-ctss2\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:24:07.307359 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.307358    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-registry-tls\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:24:07.307359 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.307369    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0935a016-aff7-432d-84ab-22e3f583963d-image-registry-private-configuration\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:24:07.307636 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.307378    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0935a016-aff7-432d-84ab-22e3f583963d-trusted-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:24:07.307636 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.307388    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0935a016-aff7-432d-84ab-22e3f583963d-bound-sa-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:24:07.307636 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.307396    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0935a016-aff7-432d-84ab-22e3f583963d-registry-certificates\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:24:07.307636 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.307404    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0935a016-aff7-432d-84ab-22e3f583963d-installation-pull-secrets\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:24:07.450074 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.450045    2562 generic.go:356] "Generic (PLEG): container finished" podID="0935a016-aff7-432d-84ab-22e3f583963d" containerID="02ae122373a0a08ac2a227c5171f159962ca4acbc77493e9e50fffbd8c352ab6" exitCode=0
Sep 08 16:24:07.450211 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.450086    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx" event={"ID":"0935a016-aff7-432d-84ab-22e3f583963d","Type":"ContainerDied","Data":"02ae122373a0a08ac2a227c5171f159962ca4acbc77493e9e50fffbd8c352ab6"}
Sep 08 16:24:07.450211 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.450090    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx"
Sep 08 16:24:07.450211 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.450126    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5984bb4f69-cd7mx" event={"ID":"0935a016-aff7-432d-84ab-22e3f583963d","Type":"ContainerDied","Data":"45dc6f39e4cc66f5399f90403bbb6ae6e89779e7bffb365242c88f4970902ea2"}
Sep 08 16:24:07.450211 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.450146    2562 scope.go:117] "RemoveContainer" containerID="02ae122373a0a08ac2a227c5171f159962ca4acbc77493e9e50fffbd8c352ab6"
Sep 08 16:24:07.458813 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.458790    2562 scope.go:117] "RemoveContainer" containerID="02ae122373a0a08ac2a227c5171f159962ca4acbc77493e9e50fffbd8c352ab6"
Sep 08 16:24:07.459122 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:24:07.459103    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02ae122373a0a08ac2a227c5171f159962ca4acbc77493e9e50fffbd8c352ab6\": container with ID starting with 02ae122373a0a08ac2a227c5171f159962ca4acbc77493e9e50fffbd8c352ab6 not found: ID does not exist" containerID="02ae122373a0a08ac2a227c5171f159962ca4acbc77493e9e50fffbd8c352ab6"
Sep 08 16:24:07.459168 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.459130    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02ae122373a0a08ac2a227c5171f159962ca4acbc77493e9e50fffbd8c352ab6"} err="failed to get container status \"02ae122373a0a08ac2a227c5171f159962ca4acbc77493e9e50fffbd8c352ab6\": rpc error: code = NotFound desc = could not find container \"02ae122373a0a08ac2a227c5171f159962ca4acbc77493e9e50fffbd8c352ab6\": container with ID starting with 02ae122373a0a08ac2a227c5171f159962ca4acbc77493e9e50fffbd8c352ab6 not found: ID does not exist"
Sep 08 16:24:07.475563 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.475529    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5984bb4f69-cd7mx"]
Sep 08 16:24:07.482699 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.482675    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5984bb4f69-cd7mx"]
Sep 08 16:24:07.806120 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.806026    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:07.888008 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:07.887970    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:08.004543 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:08.004507    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0935a016-aff7-432d-84ab-22e3f583963d" path="/var/lib/kubelet/pods/0935a016-aff7-432d-84ab-22e3f583963d/volumes"
Sep 08 16:24:08.115562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:08.115478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:08.214126 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:08.214087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:10.118393 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:10.118359    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:10.219149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:10.219114    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:11.469032 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.469002    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-677544f6c8-g99cv"]
Sep 08 16:24:11.469379 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.469252    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0935a016-aff7-432d-84ab-22e3f583963d" containerName="registry"
Sep 08 16:24:11.469379 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.469265    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0935a016-aff7-432d-84ab-22e3f583963d" containerName="registry"
Sep 08 16:24:11.469379 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.469313    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0935a016-aff7-432d-84ab-22e3f583963d" containerName="registry"
Sep 08 16:24:11.472369 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.472347    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.477160 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.477141    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 16:24:11.477284 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.477172    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 16:24:11.478185 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.478165    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p2kn4\""
Sep 08 16:24:11.478284 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.478173    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 16:24:11.479109 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.479089    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 16:24:11.479206 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.479143    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 16:24:11.479695 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.479676    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 16:24:11.479695 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.479686    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 16:24:11.483632 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.483594    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 16:24:11.489960 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.489941    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677544f6c8-g99cv"]
Sep 08 16:24:11.537177 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.537150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-oauth-config\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.537277 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.537199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-serving-cert\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.537277 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.537228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-config\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.537388 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.537283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-oauth-serving-cert\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.537388 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.537315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-trusted-ca-bundle\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.537388 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.537340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-service-ca\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.537483 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.537394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5hp4\" (UniqueName: \"kubernetes.io/projected/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-kube-api-access-m5hp4\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.637694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.637658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-oauth-config\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.637807 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.637707    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-serving-cert\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.637807 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.637725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-config\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.637807 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.637752    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-oauth-serving-cert\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.637807 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.637771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-trusted-ca-bundle\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.637807 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.637786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-service-ca\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.638039 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.637837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5hp4\" (UniqueName: \"kubernetes.io/projected/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-kube-api-access-m5hp4\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.638560 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.638534    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-oauth-serving-cert\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.638668 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.638534    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-service-ca\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.638668 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.638587    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-config\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.638778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.638724    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-trusted-ca-bundle\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.640215 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.640197    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-oauth-config\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.640267 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.640214    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-serving-cert\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.645580 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.645562    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5hp4\" (UniqueName: \"kubernetes.io/projected/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-kube-api-access-m5hp4\") pod \"console-677544f6c8-g99cv\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") " pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:11.781786 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:11.781737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:12.048647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:12.048558    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677544f6c8-g99cv"]
Sep 08 16:24:12.051241 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:24:12.051216    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0779fa7_b3dc_4c70_b9fa_0e87051199cc.slice/crio-996f3a2c9fd2413044d717cf38772c4ac366b393b93f7ff0f0eaf7ebfac535dc WatchSource:0}: Error finding container 996f3a2c9fd2413044d717cf38772c4ac366b393b93f7ff0f0eaf7ebfac535dc: Status 404 returned error can't find the container with id 996f3a2c9fd2413044d717cf38772c4ac366b393b93f7ff0f0eaf7ebfac535dc
Sep 08 16:24:12.469015 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:12.468982    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677544f6c8-g99cv" event={"ID":"e0779fa7-b3dc-4c70-b9fa-0e87051199cc","Type":"ContainerStarted","Data":"996f3a2c9fd2413044d717cf38772c4ac366b393b93f7ff0f0eaf7ebfac535dc"}
Sep 08 16:24:12.815701 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:12.815602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:12.908162 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:12.908122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:15.482862 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:15.482828    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677544f6c8-g99cv" event={"ID":"e0779fa7-b3dc-4c70-b9fa-0e87051199cc","Type":"ContainerStarted","Data":"87fe8f038c8f14fddc0d027063d8c403af7cbce0905de1797a91a32436e187d7"}
Sep 08 16:24:15.501751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:15.501704    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-677544f6c8-g99cv" podStartSLOduration=1.654817924 podStartE2EDuration="4.501689883s" totalImagesPullingTime="2.846871959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:24:15.500366329 +0000 UTC m=+98.084927926" watchObservedRunningTime="2026-09-08 16:24:15.501689883 +0000 UTC m=+98.086251580"
Sep 08 16:24:20.535710 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:20.535674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:21.263761 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:21.263710    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:21.782090 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:21.782058    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:21.782500 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:21.782135    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:21.786719 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:21.786698    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:22.391540 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:22.391508    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wgm7n"
Sep 08 16:24:22.510283 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:22.510259    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:24:22.801744 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:22.801700    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:22.893714 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:22.893661    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:26.086963 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:26.086927    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:26.168049 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:26.168014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:26.893415 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:26.893375    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:27.889908 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:27.889871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:27.990005 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:27.989973    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:31.374795 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:31.374762    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vj2d_c65b5292-6d36-4eab-ac48-4598e1bf9ee1/init-textfile/0.log"
Sep 08 16:24:31.575845 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:31.575818    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vj2d_c65b5292-6d36-4eab-ac48-4598e1bf9ee1/node-exporter/0.log"
Sep 08 16:24:31.774034 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:31.774008    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vj2d_c65b5292-6d36-4eab-ac48-4598e1bf9ee1/kube-rbac-proxy/0.log"
Sep 08 16:24:34.986283 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:34.986258    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-v8dj8_9f897b44-64f0-4a80-a0b6-8c11022c0ed0/prometheus-operator-admission-webhook/0.log"
Sep 08 16:24:35.178625 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:35.178583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:35.247173 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:35.247101    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:37.578530 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:37.578501    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-677544f6c8-g99cv_e0779fa7-b3dc-4c70-b9fa-0e87051199cc/console/0.log"
Sep 08 16:24:37.781055 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:37.781025    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677544f6c8-g99cv"]
Sep 08 16:24:37.828506 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:37.828474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:37.933209 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:37.933136    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:38.029472 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:38.029439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:38.110179 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:38.110157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:38.774686 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:38.774659    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghw5g_a06ce30b-c168-43a7-85f9-df2ac83553dd/serve-healthcheck-canary/0.log"
Sep 08 16:24:45.286415 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:45.286362    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:45.407979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:45.407921    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:45.515684 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:45.515653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:51.632324 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:51.632283    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:52.799574 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:52.799531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:52.867569 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:52.867529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:24:56.611169 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:24:56.611124    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:25:02.801711 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:02.801660    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-677544f6c8-g99cv" podUID="e0779fa7-b3dc-4c70-b9fa-0e87051199cc" containerName="console" containerID="cri-o://87fe8f038c8f14fddc0d027063d8c403af7cbce0905de1797a91a32436e187d7" gracePeriod=15
Sep 08 16:25:03.034532 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.034508    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:25:03.106912 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.106834    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-config\") pod \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") "
Sep 08 16:25:03.106912 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.106873    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-serving-cert\") pod \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") "
Sep 08 16:25:03.106912 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.106892    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5hp4\" (UniqueName: \"kubernetes.io/projected/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-kube-api-access-m5hp4\") pod \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") "
Sep 08 16:25:03.107140 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.107011    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-oauth-serving-cert\") pod \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") "
Sep 08 16:25:03.107140 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.107069    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-oauth-config\") pod \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") "
Sep 08 16:25:03.107140 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.107097    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-service-ca\") pod \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") "
Sep 08 16:25:03.107140 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.107133    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-trusted-ca-bundle\") pod \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\" (UID: \"e0779fa7-b3dc-4c70-b9fa-0e87051199cc\") "
Sep 08 16:25:03.107402 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.107277    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-config" (OuterVolumeSpecName: "console-config") pod "e0779fa7-b3dc-4c70-b9fa-0e87051199cc" (UID: "e0779fa7-b3dc-4c70-b9fa-0e87051199cc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:25:03.107459 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.107396    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e0779fa7-b3dc-4c70-b9fa-0e87051199cc" (UID: "e0779fa7-b3dc-4c70-b9fa-0e87051199cc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:25:03.107515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.107468    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-config\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:25:03.107566 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.107524    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-service-ca" (OuterVolumeSpecName: "service-ca") pod "e0779fa7-b3dc-4c70-b9fa-0e87051199cc" (UID: "e0779fa7-b3dc-4c70-b9fa-0e87051199cc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:25:03.107676 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.107653    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e0779fa7-b3dc-4c70-b9fa-0e87051199cc" (UID: "e0779fa7-b3dc-4c70-b9fa-0e87051199cc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:25:03.109073 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.109047    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-kube-api-access-m5hp4" (OuterVolumeSpecName: "kube-api-access-m5hp4") pod "e0779fa7-b3dc-4c70-b9fa-0e87051199cc" (UID: "e0779fa7-b3dc-4c70-b9fa-0e87051199cc"). InnerVolumeSpecName "kube-api-access-m5hp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:25:03.109335 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.109309    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e0779fa7-b3dc-4c70-b9fa-0e87051199cc" (UID: "e0779fa7-b3dc-4c70-b9fa-0e87051199cc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:25:03.109379 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.109323    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e0779fa7-b3dc-4c70-b9fa-0e87051199cc" (UID: "e0779fa7-b3dc-4c70-b9fa-0e87051199cc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:25:03.207758 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.207731    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-oauth-serving-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:25:03.207758 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.207756    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-oauth-config\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:25:03.207913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.207766    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:25:03.207913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.207774    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-trusted-ca-bundle\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:25:03.207913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.207782    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-console-serving-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:25:03.207913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.207792    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5hp4\" (UniqueName: \"kubernetes.io/projected/e0779fa7-b3dc-4c70-b9fa-0e87051199cc-kube-api-access-m5hp4\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:25:03.652717 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.652684    2562 generic.go:356] "Generic (PLEG): container finished" podID="e0779fa7-b3dc-4c70-b9fa-0e87051199cc" containerID="87fe8f038c8f14fddc0d027063d8c403af7cbce0905de1797a91a32436e187d7" exitCode=0
Sep 08 16:25:03.652883 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.652731    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677544f6c8-g99cv"
Sep 08 16:25:03.652883 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.652771    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677544f6c8-g99cv" event={"ID":"e0779fa7-b3dc-4c70-b9fa-0e87051199cc","Type":"ContainerDied","Data":"87fe8f038c8f14fddc0d027063d8c403af7cbce0905de1797a91a32436e187d7"}
Sep 08 16:25:03.652883 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.652826    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677544f6c8-g99cv" event={"ID":"e0779fa7-b3dc-4c70-b9fa-0e87051199cc","Type":"ContainerDied","Data":"996f3a2c9fd2413044d717cf38772c4ac366b393b93f7ff0f0eaf7ebfac535dc"}
Sep 08 16:25:03.652883 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.652847    2562 scope.go:117] "RemoveContainer" containerID="87fe8f038c8f14fddc0d027063d8c403af7cbce0905de1797a91a32436e187d7"
Sep 08 16:25:03.661228 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.661213    2562 scope.go:117] "RemoveContainer" containerID="87fe8f038c8f14fddc0d027063d8c403af7cbce0905de1797a91a32436e187d7"
Sep 08 16:25:03.661469 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:25:03.661449    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87fe8f038c8f14fddc0d027063d8c403af7cbce0905de1797a91a32436e187d7\": container with ID starting with 87fe8f038c8f14fddc0d027063d8c403af7cbce0905de1797a91a32436e187d7 not found: ID does not exist" containerID="87fe8f038c8f14fddc0d027063d8c403af7cbce0905de1797a91a32436e187d7"
Sep 08 16:25:03.661533 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.661477    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87fe8f038c8f14fddc0d027063d8c403af7cbce0905de1797a91a32436e187d7"} err="failed to get container status \"87fe8f038c8f14fddc0d027063d8c403af7cbce0905de1797a91a32436e187d7\": rpc error: code = NotFound desc = could not find container \"87fe8f038c8f14fddc0d027063d8c403af7cbce0905de1797a91a32436e187d7\": container with ID starting with 87fe8f038c8f14fddc0d027063d8c403af7cbce0905de1797a91a32436e187d7 not found: ID does not exist"
Sep 08 16:25:03.675952 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.675929    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677544f6c8-g99cv"]
Sep 08 16:25:03.679239 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:03.679219    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-677544f6c8-g99cv"]
Sep 08 16:25:04.004257 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:04.004224    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0779fa7-b3dc-4c70-b9fa-0e87051199cc" path="/var/lib/kubelet/pods/e0779fa7-b3dc-4c70-b9fa-0e87051199cc/volumes"
Sep 08 16:25:16.619198 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:16.619165    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:25:16.684146 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:16.684115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:25:30.810836 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:30.810747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:25:30.870385 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:30.870354    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:25:37.821222 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:37.821191    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:25:37.986359 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:37.986328    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:25:50.772880 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.772845    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-669ffdd9b8-vnktg"]
Sep 08 16:25:50.773365 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.773100    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0779fa7-b3dc-4c70-b9fa-0e87051199cc" containerName="console"
Sep 08 16:25:50.773365 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.773112    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0779fa7-b3dc-4c70-b9fa-0e87051199cc" containerName="console"
Sep 08 16:25:50.773365 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.773163    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0779fa7-b3dc-4c70-b9fa-0e87051199cc" containerName="console"
Sep 08 16:25:50.775243 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.775227    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.778169 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.778144    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 16:25:50.778303 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.778146    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 16:25:50.779212 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.779190    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p2kn4\""
Sep 08 16:25:50.779212 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.779202    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 16:25:50.779417 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.779232    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 16:25:50.779417 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.779224    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 16:25:50.779927 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.779910    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 16:25:50.780050 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.779909    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 16:25:50.785164 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.785144    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 16:25:50.793922 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.793901    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669ffdd9b8-vnktg"]
Sep 08 16:25:50.828156 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.828133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-service-ca\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.828248 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.828166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-oauth-config\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.828248 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.828192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-oauth-serving-cert\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.828248 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.828233    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-serving-cert\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.828354 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.828324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-config\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.828392 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.828355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42rnv\" (UniqueName: \"kubernetes.io/projected/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-kube-api-access-42rnv\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.828392 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.828376    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-trusted-ca-bundle\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.871735 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.871688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:25:50.929378 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.929356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-config\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.929449 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.929386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42rnv\" (UniqueName: \"kubernetes.io/projected/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-kube-api-access-42rnv\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.929449 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.929405    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-trusted-ca-bundle\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.929449 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.929427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-service-ca\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.929595 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.929450    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-oauth-config\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.929595 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.929469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-oauth-serving-cert\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.929595 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.929494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-serving-cert\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.930254 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.930172    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-config\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.930254 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.930199    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-service-ca\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.930254 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.930243    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-trusted-ca-bundle\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.930409 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.930262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-oauth-serving-cert\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.931840 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.931823    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-oauth-config\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.931997 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.931982    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-serving-cert\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:50.938754 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:50.938736    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42rnv\" (UniqueName: \"kubernetes.io/projected/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-kube-api-access-42rnv\") pod \"console-669ffdd9b8-vnktg\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") " pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:51.084838 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:51.084774    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:25:51.337939 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:51.337865    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:25:51.358401 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:51.358376    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669ffdd9b8-vnktg"]
Sep 08 16:25:51.361292 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:25:51.361268    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0833f4ce_99d0_4f86_8161_6a3a6bec29dd.slice/crio-48db6a6045ae5ad4866e2f7650e29ed977c44b4134931f620dc68d913243dec8 WatchSource:0}: Error finding container 48db6a6045ae5ad4866e2f7650e29ed977c44b4134931f620dc68d913243dec8: Status 404 returned error can't find the container with id 48db6a6045ae5ad4866e2f7650e29ed977c44b4134931f620dc68d913243dec8
Sep 08 16:25:51.808503 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:51.808469    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669ffdd9b8-vnktg" event={"ID":"0833f4ce-99d0-4f86-8161-6a3a6bec29dd","Type":"ContainerStarted","Data":"e40d85578985d374ea8efae4a3e825b734a0e888a0a846ed74983c915896ca3f"}
Sep 08 16:25:51.809008 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:51.808516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669ffdd9b8-vnktg" event={"ID":"0833f4ce-99d0-4f86-8161-6a3a6bec29dd","Type":"ContainerStarted","Data":"48db6a6045ae5ad4866e2f7650e29ed977c44b4134931f620dc68d913243dec8"}
Sep 08 16:25:51.830563 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:51.830514    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-669ffdd9b8-vnktg" podStartSLOduration=1.830499219 podStartE2EDuration="1.830499219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:25:51.829981964 +0000 UTC m=+194.414543582" watchObservedRunningTime="2026-09-08 16:25:51.830499219 +0000 UTC m=+194.415060838"
Sep 08 16:25:57.504697 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:57.504665    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:25:57.605366 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:25:57.605329    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:01.085397 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:01.085355    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:26:01.085863 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:01.085540    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:26:01.090061 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:01.090039    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:26:01.846022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:01.845989    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:26:02.070679 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:02.070651    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:02.168096 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:02.167999    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:02.237844 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:02.237809    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:02.850925 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:02.850894    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:02.958475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:02.958446    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:03.747940 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.747905    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"]
Sep 08 16:26:03.749994 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.749977    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"
Sep 08 16:26:03.753144 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.753121    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 16:26:03.753887 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.753869    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 16:26:03.753951 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.753869    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zjxgh\""
Sep 08 16:26:03.768962 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.768941    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"]
Sep 08 16:26:03.816749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.816721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b85b5244-6312-4ffa-9948-6d8052d80526-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4\" (UID: \"b85b5244-6312-4ffa-9948-6d8052d80526\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"
Sep 08 16:26:03.816863 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.816762    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b85b5244-6312-4ffa-9948-6d8052d80526-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4\" (UID: \"b85b5244-6312-4ffa-9948-6d8052d80526\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"
Sep 08 16:26:03.816863 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.816788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k4qh\" (UniqueName: \"kubernetes.io/projected/b85b5244-6312-4ffa-9948-6d8052d80526-kube-api-access-2k4qh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4\" (UID: \"b85b5244-6312-4ffa-9948-6d8052d80526\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"
Sep 08 16:26:03.917988 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.917961    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b85b5244-6312-4ffa-9948-6d8052d80526-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4\" (UID: \"b85b5244-6312-4ffa-9948-6d8052d80526\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"
Sep 08 16:26:03.918137 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.917997    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k4qh\" (UniqueName: \"kubernetes.io/projected/b85b5244-6312-4ffa-9948-6d8052d80526-kube-api-access-2k4qh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4\" (UID: \"b85b5244-6312-4ffa-9948-6d8052d80526\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"
Sep 08 16:26:03.918254 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.918225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b85b5244-6312-4ffa-9948-6d8052d80526-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4\" (UID: \"b85b5244-6312-4ffa-9948-6d8052d80526\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"
Sep 08 16:26:03.918417 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.918397    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b85b5244-6312-4ffa-9948-6d8052d80526-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4\" (UID: \"b85b5244-6312-4ffa-9948-6d8052d80526\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"
Sep 08 16:26:03.918567 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.918551    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b85b5244-6312-4ffa-9948-6d8052d80526-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4\" (UID: \"b85b5244-6312-4ffa-9948-6d8052d80526\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"
Sep 08 16:26:03.929716 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:03.929690    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k4qh\" (UniqueName: \"kubernetes.io/projected/b85b5244-6312-4ffa-9948-6d8052d80526-kube-api-access-2k4qh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4\" (UID: \"b85b5244-6312-4ffa-9948-6d8052d80526\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"
Sep 08 16:26:04.059273 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:04.059211    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"
Sep 08 16:26:04.327114 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:04.327036    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"]
Sep 08 16:26:04.329975 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:26:04.329947    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85b5244_6312_4ffa_9948_6d8052d80526.slice/crio-bf7f20134c9cd9b826b1e5d8ea9e6019b986f21e5cf9fb0f2b2c10cf5b9756f5 WatchSource:0}: Error finding container bf7f20134c9cd9b826b1e5d8ea9e6019b986f21e5cf9fb0f2b2c10cf5b9756f5: Status 404 returned error can't find the container with id bf7f20134c9cd9b826b1e5d8ea9e6019b986f21e5cf9fb0f2b2c10cf5b9756f5
Sep 08 16:26:04.852631 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:04.852566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4" event={"ID":"b85b5244-6312-4ffa-9948-6d8052d80526","Type":"ContainerStarted","Data":"bf7f20134c9cd9b826b1e5d8ea9e6019b986f21e5cf9fb0f2b2c10cf5b9756f5"}
Sep 08 16:26:12.882661 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:12.882628    2562 generic.go:356] "Generic (PLEG): container finished" podID="b85b5244-6312-4ffa-9948-6d8052d80526" containerID="0b07d1803f6b5b31fd72a14811538cbbd2ecaa35b8d53dc9963ab96daffb3edd" exitCode=0
Sep 08 16:26:12.883041 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:12.882723    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4" event={"ID":"b85b5244-6312-4ffa-9948-6d8052d80526","Type":"ContainerDied","Data":"0b07d1803f6b5b31fd72a14811538cbbd2ecaa35b8d53dc9963ab96daffb3edd"}
Sep 08 16:26:14.891638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:14.891589    2562 generic.go:356] "Generic (PLEG): container finished" podID="b85b5244-6312-4ffa-9948-6d8052d80526" containerID="a50a7a7c32677d4858301f01846f25f5b7eb3d0b5f43d6c0746f8a3c9ace7a6d" exitCode=0
Sep 08 16:26:14.891638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:14.891648    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4" event={"ID":"b85b5244-6312-4ffa-9948-6d8052d80526","Type":"ContainerDied","Data":"a50a7a7c32677d4858301f01846f25f5b7eb3d0b5f43d6c0746f8a3c9ace7a6d"}
Sep 08 16:26:21.922964 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:21.922932    2562 generic.go:356] "Generic (PLEG): container finished" podID="b85b5244-6312-4ffa-9948-6d8052d80526" containerID="4b9dc93da2b1d8a42cb2da6aadb3dcf0ed0fcd75c6f1bb5fab381adf82719679" exitCode=0
Sep 08 16:26:21.923306 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:21.922982    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4" event={"ID":"b85b5244-6312-4ffa-9948-6d8052d80526","Type":"ContainerDied","Data":"4b9dc93da2b1d8a42cb2da6aadb3dcf0ed0fcd75c6f1bb5fab381adf82719679"}
Sep 08 16:26:23.046384 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:23.046360    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"
Sep 08 16:26:23.181856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:23.181774    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b85b5244-6312-4ffa-9948-6d8052d80526-bundle\") pod \"b85b5244-6312-4ffa-9948-6d8052d80526\" (UID: \"b85b5244-6312-4ffa-9948-6d8052d80526\") "
Sep 08 16:26:23.181856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:23.181809    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b85b5244-6312-4ffa-9948-6d8052d80526-util\") pod \"b85b5244-6312-4ffa-9948-6d8052d80526\" (UID: \"b85b5244-6312-4ffa-9948-6d8052d80526\") "
Sep 08 16:26:23.181856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:23.181844    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k4qh\" (UniqueName: \"kubernetes.io/projected/b85b5244-6312-4ffa-9948-6d8052d80526-kube-api-access-2k4qh\") pod \"b85b5244-6312-4ffa-9948-6d8052d80526\" (UID: \"b85b5244-6312-4ffa-9948-6d8052d80526\") "
Sep 08 16:26:23.182597 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:23.182562    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b85b5244-6312-4ffa-9948-6d8052d80526-bundle" (OuterVolumeSpecName: "bundle") pod "b85b5244-6312-4ffa-9948-6d8052d80526" (UID: "b85b5244-6312-4ffa-9948-6d8052d80526"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:26:23.184104 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:23.184076    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b85b5244-6312-4ffa-9948-6d8052d80526-kube-api-access-2k4qh" (OuterVolumeSpecName: "kube-api-access-2k4qh") pod "b85b5244-6312-4ffa-9948-6d8052d80526" (UID: "b85b5244-6312-4ffa-9948-6d8052d80526"). InnerVolumeSpecName "kube-api-access-2k4qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:26:23.186223 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:23.186198    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b85b5244-6312-4ffa-9948-6d8052d80526-util" (OuterVolumeSpecName: "util") pod "b85b5244-6312-4ffa-9948-6d8052d80526" (UID: "b85b5244-6312-4ffa-9948-6d8052d80526"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:26:23.282335 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:23.282311    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k4qh\" (UniqueName: \"kubernetes.io/projected/b85b5244-6312-4ffa-9948-6d8052d80526-kube-api-access-2k4qh\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:26:23.282335 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:23.282331    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b85b5244-6312-4ffa-9948-6d8052d80526-bundle\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:26:23.282458 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:23.282341    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b85b5244-6312-4ffa-9948-6d8052d80526-util\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:26:23.931309 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:23.931275    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4" event={"ID":"b85b5244-6312-4ffa-9948-6d8052d80526","Type":"ContainerDied","Data":"bf7f20134c9cd9b826b1e5d8ea9e6019b986f21e5cf9fb0f2b2c10cf5b9756f5"}
Sep 08 16:26:23.931309 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:23.931299    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hnd4"
Sep 08 16:26:23.931501 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:23.931320    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf7f20134c9cd9b826b1e5d8ea9e6019b986f21e5cf9fb0f2b2c10cf5b9756f5"
Sep 08 16:26:30.121211 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:30.121175    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:30.465694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:30.465663    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:32.217814 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.217784    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp"]
Sep 08 16:26:32.218246 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.218008    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b85b5244-6312-4ffa-9948-6d8052d80526" containerName="pull"
Sep 08 16:26:32.218246 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.218019    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b85b5244-6312-4ffa-9948-6d8052d80526" containerName="pull"
Sep 08 16:26:32.218246 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.218028    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b85b5244-6312-4ffa-9948-6d8052d80526" containerName="util"
Sep 08 16:26:32.218246 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.218034    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b85b5244-6312-4ffa-9948-6d8052d80526" containerName="util"
Sep 08 16:26:32.218246 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.218042    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b85b5244-6312-4ffa-9948-6d8052d80526" containerName="extract"
Sep 08 16:26:32.218246 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.218047    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b85b5244-6312-4ffa-9948-6d8052d80526" containerName="extract"
Sep 08 16:26:32.218246 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.218091    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b85b5244-6312-4ffa-9948-6d8052d80526" containerName="extract"
Sep 08 16:26:32.220678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.220663    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp"
Sep 08 16:26:32.226685 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.226320    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8m5ld\""
Sep 08 16:26:32.226685 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.226598    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:26:32.226818 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.226732    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 08 16:26:32.240588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.240557    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp"]
Sep 08 16:26:32.347180 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.347151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4wdp\" (UniqueName: \"kubernetes.io/projected/9c5d4e12-1c77-4f08-bc8d-56018cfdaec6-kube-api-access-f4wdp\") pod \"cert-manager-operator-controller-manager-55c444bf86-t8fmp\" (UID: \"9c5d4e12-1c77-4f08-bc8d-56018cfdaec6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp"
Sep 08 16:26:32.347301 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.347232    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c5d4e12-1c77-4f08-bc8d-56018cfdaec6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-t8fmp\" (UID: \"9c5d4e12-1c77-4f08-bc8d-56018cfdaec6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp"
Sep 08 16:26:32.447897 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.447868    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4wdp\" (UniqueName: \"kubernetes.io/projected/9c5d4e12-1c77-4f08-bc8d-56018cfdaec6-kube-api-access-f4wdp\") pod \"cert-manager-operator-controller-manager-55c444bf86-t8fmp\" (UID: \"9c5d4e12-1c77-4f08-bc8d-56018cfdaec6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp"
Sep 08 16:26:32.448018 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.447929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c5d4e12-1c77-4f08-bc8d-56018cfdaec6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-t8fmp\" (UID: \"9c5d4e12-1c77-4f08-bc8d-56018cfdaec6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp"
Sep 08 16:26:32.448267 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.448250    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c5d4e12-1c77-4f08-bc8d-56018cfdaec6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-t8fmp\" (UID: \"9c5d4e12-1c77-4f08-bc8d-56018cfdaec6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp"
Sep 08 16:26:32.463499 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.463479    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4wdp\" (UniqueName: \"kubernetes.io/projected/9c5d4e12-1c77-4f08-bc8d-56018cfdaec6-kube-api-access-f4wdp\") pod \"cert-manager-operator-controller-manager-55c444bf86-t8fmp\" (UID: \"9c5d4e12-1c77-4f08-bc8d-56018cfdaec6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp"
Sep 08 16:26:32.529482 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.529430    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp"
Sep 08 16:26:32.810056 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.809967    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp"]
Sep 08 16:26:32.816316 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:26:32.816277    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5d4e12_1c77_4f08_bc8d_56018cfdaec6.slice/crio-0f93fc29db887e3280553359c763a22082fb81431f54a8d3bb1fbe3fea8bb3bb WatchSource:0}: Error finding container 0f93fc29db887e3280553359c763a22082fb81431f54a8d3bb1fbe3fea8bb3bb: Status 404 returned error can't find the container with id 0f93fc29db887e3280553359c763a22082fb81431f54a8d3bb1fbe3fea8bb3bb
Sep 08 16:26:32.962651 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:32.962622    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp" event={"ID":"9c5d4e12-1c77-4f08-bc8d-56018cfdaec6","Type":"ContainerStarted","Data":"0f93fc29db887e3280553359c763a22082fb81431f54a8d3bb1fbe3fea8bb3bb"}
Sep 08 16:26:33.961552 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:33.961498    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:34.061577 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:34.061542    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:34.973832 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:34.973793    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp" event={"ID":"9c5d4e12-1c77-4f08-bc8d-56018cfdaec6","Type":"ContainerStarted","Data":"0e8937a12ec299c02c7537735f25ad7f2b6a05dbfbf8d55bc043c7b8f1edc7a5"}
Sep 08 16:26:35.052764 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.052717    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t8fmp" podStartSLOduration=1.4145503289999999 podStartE2EDuration="3.052704434s" totalImagesPullingTime="1.638154105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:26:35.04355824 +0000 UTC m=+237.628119860" watchObservedRunningTime="2026-09-08 16:26:35.052704434 +0000 UTC m=+237.637266053"
Sep 08 16:26:35.544165 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.544130    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:35.695327 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.695289    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:35.792894 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.792870    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"]
Sep 08 16:26:35.796208 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.796171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"
Sep 08 16:26:35.799570 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.799545    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 16:26:35.800434 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.800415    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 16:26:35.803290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.803271    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zjxgh\""
Sep 08 16:26:35.820866 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.820843    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"]
Sep 08 16:26:35.871357 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.871329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96dbq\" (UniqueName: \"kubernetes.io/projected/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-kube-api-access-96dbq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2\" (UID: \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"
Sep 08 16:26:35.871453 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.871374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2\" (UID: \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"
Sep 08 16:26:35.871453 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.871395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2\" (UID: \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"
Sep 08 16:26:35.972731 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.972705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96dbq\" (UniqueName: \"kubernetes.io/projected/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-kube-api-access-96dbq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2\" (UID: \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"
Sep 08 16:26:35.972845 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.972741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2\" (UID: \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"
Sep 08 16:26:35.972845 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.972759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2\" (UID: \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"
Sep 08 16:26:35.973076 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.973058    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2\" (UID: \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"
Sep 08 16:26:35.973133 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.973098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2\" (UID: \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"
Sep 08 16:26:35.993579 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:35.993551    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96dbq\" (UniqueName: \"kubernetes.io/projected/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-kube-api-access-96dbq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2\" (UID: \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"
Sep 08 16:26:36.104452 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:36.104397    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"
Sep 08 16:26:36.435882 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:36.435854    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"]
Sep 08 16:26:36.437178 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:26:36.437153    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf4bdd95_4fc8_4cab_aeea_16ecd2b52348.slice/crio-61b33324031ed44fae47e453016f7c04ae31ef6128ce37d6e4ea286d15bd30b0 WatchSource:0}: Error finding container 61b33324031ed44fae47e453016f7c04ae31ef6128ce37d6e4ea286d15bd30b0: Status 404 returned error can't find the container with id 61b33324031ed44fae47e453016f7c04ae31ef6128ce37d6e4ea286d15bd30b0
Sep 08 16:26:36.565488 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:36.565460    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:36.937045 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:36.937004    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:36.982145 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:36.982114    2562 generic.go:356] "Generic (PLEG): container finished" podID="df4bdd95-4fc8-4cab-aeea-16ecd2b52348" containerID="9e05b4b0a6a6870ae037a8fe81d9145bf483896c97428dbc1d2c5cb0cd852a05" exitCode=0
Sep 08 16:26:36.982298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:36.982168    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2" event={"ID":"df4bdd95-4fc8-4cab-aeea-16ecd2b52348","Type":"ContainerDied","Data":"9e05b4b0a6a6870ae037a8fe81d9145bf483896c97428dbc1d2c5cb0cd852a05"}
Sep 08 16:26:36.982298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:36.982216    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2" event={"ID":"df4bdd95-4fc8-4cab-aeea-16ecd2b52348","Type":"ContainerStarted","Data":"61b33324031ed44fae47e453016f7c04ae31ef6128ce37d6e4ea286d15bd30b0"}
Sep 08 16:26:37.059860 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.059835    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rn8x6"]
Sep 08 16:26:37.062787 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.062773    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rn8x6"
Sep 08 16:26:37.065851 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.065828    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 16:26:37.065972 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.065955    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vhz57\""
Sep 08 16:26:37.066163 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.066151    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 16:26:37.093829 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.093809    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rn8x6"]
Sep 08 16:26:37.179022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.178993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a883fe5a-e475-4505-b683-8b0c31c689fc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rn8x6\" (UID: \"a883fe5a-e475-4505-b683-8b0c31c689fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rn8x6"
Sep 08 16:26:37.179158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.179034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxzl5\" (UniqueName: \"kubernetes.io/projected/a883fe5a-e475-4505-b683-8b0c31c689fc-kube-api-access-pxzl5\") pod \"cert-manager-webhook-6486ffd997-rn8x6\" (UID: \"a883fe5a-e475-4505-b683-8b0c31c689fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rn8x6"
Sep 08 16:26:37.280388 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.280358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a883fe5a-e475-4505-b683-8b0c31c689fc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rn8x6\" (UID: \"a883fe5a-e475-4505-b683-8b0c31c689fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rn8x6"
Sep 08 16:26:37.280510 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.280399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxzl5\" (UniqueName: \"kubernetes.io/projected/a883fe5a-e475-4505-b683-8b0c31c689fc-kube-api-access-pxzl5\") pod \"cert-manager-webhook-6486ffd997-rn8x6\" (UID: \"a883fe5a-e475-4505-b683-8b0c31c689fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rn8x6"
Sep 08 16:26:37.312115 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.312084    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxzl5\" (UniqueName: \"kubernetes.io/projected/a883fe5a-e475-4505-b683-8b0c31c689fc-kube-api-access-pxzl5\") pod \"cert-manager-webhook-6486ffd997-rn8x6\" (UID: \"a883fe5a-e475-4505-b683-8b0c31c689fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rn8x6"
Sep 08 16:26:37.323483 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.323455    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a883fe5a-e475-4505-b683-8b0c31c689fc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rn8x6\" (UID: \"a883fe5a-e475-4505-b683-8b0c31c689fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rn8x6"
Sep 08 16:26:37.371410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.371385    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rn8x6"
Sep 08 16:26:37.701343 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.701316    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rn8x6"]
Sep 08 16:26:37.703728 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:26:37.703701    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda883fe5a_e475_4505_b683_8b0c31c689fc.slice/crio-0452ecfd7f0c01c795cfeacac768e3e1f136389e71b1d7aa4289a75cc80ec3de WatchSource:0}: Error finding container 0452ecfd7f0c01c795cfeacac768e3e1f136389e71b1d7aa4289a75cc80ec3de: Status 404 returned error can't find the container with id 0452ecfd7f0c01c795cfeacac768e3e1f136389e71b1d7aa4289a75cc80ec3de
Sep 08 16:26:37.987268 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:37.987196    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rn8x6" event={"ID":"a883fe5a-e475-4505-b683-8b0c31c689fc","Type":"ContainerStarted","Data":"0452ecfd7f0c01c795cfeacac768e3e1f136389e71b1d7aa4289a75cc80ec3de"}
Sep 08 16:26:38.489376 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:38.489345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:39.046915 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:39.046886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:47.561870 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:47.561813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:48.433218 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:48.433141    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:48.624140 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:48.624103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:49.033001 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:49.032961    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rn8x6" event={"ID":"a883fe5a-e475-4505-b683-8b0c31c689fc","Type":"ContainerStarted","Data":"563e353027fa705d6b49ccd964ccb8f5b5dafa6eeffc22d11b5854736c0e7211"}
Sep 08 16:26:49.033195 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:49.033018    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rn8x6"
Sep 08 16:26:49.058866 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:49.058823    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-rn8x6" podStartSLOduration=1.631092777 podStartE2EDuration="12.058810123s" totalImagesPullingTime="10.427717346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:26:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:26:49.057671639 +0000 UTC m=+251.642233259" watchObservedRunningTime="2026-09-08 16:26:49.058810123 +0000 UTC m=+251.643371742"
Sep 08 16:26:53.049911 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:53.049878    2562 generic.go:356] "Generic (PLEG): container finished" podID="df4bdd95-4fc8-4cab-aeea-16ecd2b52348" containerID="a0e594641325e4bda2448e739519954ed69addb44950c553472f93a197893ff8" exitCode=0
Sep 08 16:26:53.050272 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:53.049961    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2" event={"ID":"df4bdd95-4fc8-4cab-aeea-16ecd2b52348","Type":"ContainerDied","Data":"a0e594641325e4bda2448e739519954ed69addb44950c553472f93a197893ff8"}
Sep 08 16:26:54.056070 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:54.056037    2562 generic.go:356] "Generic (PLEG): container finished" podID="df4bdd95-4fc8-4cab-aeea-16ecd2b52348" containerID="153a00886c5342b616356e732814aab50f510bd0476174248a5f11a0bc870cfe" exitCode=0
Sep 08 16:26:54.056494 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:54.056106    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2" event={"ID":"df4bdd95-4fc8-4cab-aeea-16ecd2b52348","Type":"ContainerDied","Data":"153a00886c5342b616356e732814aab50f510bd0476174248a5f11a0bc870cfe"}
Sep 08 16:26:55.039126 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:55.039099    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rn8x6"
Sep 08 16:26:55.218400 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:55.218373    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"
Sep 08 16:26:55.407681 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:55.407603    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-util\") pod \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\" (UID: \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\") "
Sep 08 16:26:55.407681 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:55.407667    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96dbq\" (UniqueName: \"kubernetes.io/projected/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-kube-api-access-96dbq\") pod \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\" (UID: \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\") "
Sep 08 16:26:55.407835 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:55.407725    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-bundle\") pod \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\" (UID: \"df4bdd95-4fc8-4cab-aeea-16ecd2b52348\") "
Sep 08 16:26:55.408072 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:55.408046    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-bundle" (OuterVolumeSpecName: "bundle") pod "df4bdd95-4fc8-4cab-aeea-16ecd2b52348" (UID: "df4bdd95-4fc8-4cab-aeea-16ecd2b52348"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:26:55.409670 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:55.409642    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-kube-api-access-96dbq" (OuterVolumeSpecName: "kube-api-access-96dbq") pod "df4bdd95-4fc8-4cab-aeea-16ecd2b52348" (UID: "df4bdd95-4fc8-4cab-aeea-16ecd2b52348"). InnerVolumeSpecName "kube-api-access-96dbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:26:55.412423 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:55.412399    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-util" (OuterVolumeSpecName: "util") pod "df4bdd95-4fc8-4cab-aeea-16ecd2b52348" (UID: "df4bdd95-4fc8-4cab-aeea-16ecd2b52348"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:26:55.508485 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:55.508461    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96dbq\" (UniqueName: \"kubernetes.io/projected/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-kube-api-access-96dbq\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:26:55.508485 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:55.508482    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-bundle\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:26:55.508600 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:55.508492    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df4bdd95-4fc8-4cab-aeea-16ecd2b52348-util\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:26:56.064795 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:56.064767    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2" event={"ID":"df4bdd95-4fc8-4cab-aeea-16ecd2b52348","Type":"ContainerDied","Data":"61b33324031ed44fae47e453016f7c04ae31ef6128ce37d6e4ea286d15bd30b0"}
Sep 08 16:26:56.064925 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:56.064806    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff4qv2"
Sep 08 16:26:56.064925 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:56.064810    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61b33324031ed44fae47e453016f7c04ae31ef6128ce37d6e4ea286d15bd30b0"
Sep 08 16:26:57.648802 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:57.648754    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:57.750831 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:57.750785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:26:58.994786 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:58.994751    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd"]
Sep 08 16:26:58.995229 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:58.995119    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df4bdd95-4fc8-4cab-aeea-16ecd2b52348" containerName="extract"
Sep 08 16:26:58.995229 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:58.995137    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="df4bdd95-4fc8-4cab-aeea-16ecd2b52348" containerName="extract"
Sep 08 16:26:58.995229 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:58.995164    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df4bdd95-4fc8-4cab-aeea-16ecd2b52348" containerName="util"
Sep 08 16:26:58.995229 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:58.995171    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="df4bdd95-4fc8-4cab-aeea-16ecd2b52348" containerName="util"
Sep 08 16:26:58.995229 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:58.995190    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df4bdd95-4fc8-4cab-aeea-16ecd2b52348" containerName="pull"
Sep 08 16:26:58.995229 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:58.995198    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="df4bdd95-4fc8-4cab-aeea-16ecd2b52348" containerName="pull"
Sep 08 16:26:58.995511 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:58.995276    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="df4bdd95-4fc8-4cab-aeea-16ecd2b52348" containerName="extract"
Sep 08 16:26:59.016010 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:59.015981    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd"]
Sep 08 16:26:59.016139 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:59.016029    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd"
Sep 08 16:26:59.018768 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:59.018750    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:26:59.018891 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:59.018758    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 08 16:26:59.019633 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:59.019604    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hmvxw\""
Sep 08 16:26:59.133574 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:59.133527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwrmz\" (UniqueName: \"kubernetes.io/projected/393e0d65-209f-4f4f-806a-3f72006b0b15-kube-api-access-wwrmz\") pod \"openshift-lws-operator-fd8ccff4c-s8cdd\" (UID: \"393e0d65-209f-4f4f-806a-3f72006b0b15\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd"
Sep 08 16:26:59.133728 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:59.133633    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/393e0d65-209f-4f4f-806a-3f72006b0b15-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s8cdd\" (UID: \"393e0d65-209f-4f4f-806a-3f72006b0b15\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd"
Sep 08 16:26:59.233944 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:59.233917    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/393e0d65-209f-4f4f-806a-3f72006b0b15-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s8cdd\" (UID: \"393e0d65-209f-4f4f-806a-3f72006b0b15\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd"
Sep 08 16:26:59.234070 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:59.233950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwrmz\" (UniqueName: \"kubernetes.io/projected/393e0d65-209f-4f4f-806a-3f72006b0b15-kube-api-access-wwrmz\") pod \"openshift-lws-operator-fd8ccff4c-s8cdd\" (UID: \"393e0d65-209f-4f4f-806a-3f72006b0b15\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd"
Sep 08 16:26:59.234283 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:59.234264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/393e0d65-209f-4f4f-806a-3f72006b0b15-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s8cdd\" (UID: \"393e0d65-209f-4f4f-806a-3f72006b0b15\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd"
Sep 08 16:26:59.243747 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:59.243727    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwrmz\" (UniqueName: \"kubernetes.io/projected/393e0d65-209f-4f4f-806a-3f72006b0b15-kube-api-access-wwrmz\") pod \"openshift-lws-operator-fd8ccff4c-s8cdd\" (UID: \"393e0d65-209f-4f4f-806a-3f72006b0b15\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd"
Sep 08 16:26:59.326305 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:59.326241    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd"
Sep 08 16:26:59.595074 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:26:59.595047    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd"]
Sep 08 16:26:59.597661 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:26:59.597634    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod393e0d65_209f_4f4f_806a_3f72006b0b15.slice/crio-2e54e78934e832525549e2889d089776783f2ed3d06eb84a552babc63e9700f9 WatchSource:0}: Error finding container 2e54e78934e832525549e2889d089776783f2ed3d06eb84a552babc63e9700f9: Status 404 returned error can't find the container with id 2e54e78934e832525549e2889d089776783f2ed3d06eb84a552babc63e9700f9
Sep 08 16:27:00.081657 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:00.081566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd" event={"ID":"393e0d65-209f-4f4f-806a-3f72006b0b15","Type":"ContainerStarted","Data":"2e54e78934e832525549e2889d089776783f2ed3d06eb84a552babc63e9700f9"}
Sep 08 16:27:01.087318 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:01.087284    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd" event={"ID":"393e0d65-209f-4f4f-806a-3f72006b0b15","Type":"ContainerStarted","Data":"92e2d31368f88c847b6bbfa4daa761b55e8b05076ace65abd7c250d5680f98e1"}
Sep 08 16:27:01.106849 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:01.106797    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8cdd" podStartSLOduration=1.700229051 podStartE2EDuration="3.106781472s" totalImagesPullingTime="1.406552421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:27:01.106248062 +0000 UTC m=+263.690809681" watchObservedRunningTime="2026-09-08 16:27:01.106781472 +0000 UTC m=+263.691343092"
Sep 08 16:27:01.903390 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:01.903358    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:02.005366 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:02.005331    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:03.975850 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:03.975817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:04.092928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.092898    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"]
Sep 08 16:27:04.095014 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.094998    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"
Sep 08 16:27:04.101857 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.101832    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 16:27:04.101975 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.101958    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 16:27:04.102038 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.101959    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zjxgh\""
Sep 08 16:27:04.112324 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.112301    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"]
Sep 08 16:27:04.274082 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.274015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56556613-ea65-4332-a960-dd14c4ad91b6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h\" (UID: \"56556613-ea65-4332-a960-dd14c4ad91b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"
Sep 08 16:27:04.274082 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.274048    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56556613-ea65-4332-a960-dd14c4ad91b6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h\" (UID: \"56556613-ea65-4332-a960-dd14c4ad91b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"
Sep 08 16:27:04.274082 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.274077    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6wv8\" (UniqueName: \"kubernetes.io/projected/56556613-ea65-4332-a960-dd14c4ad91b6-kube-api-access-d6wv8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h\" (UID: \"56556613-ea65-4332-a960-dd14c4ad91b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"
Sep 08 16:27:04.375051 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.375012    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56556613-ea65-4332-a960-dd14c4ad91b6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h\" (UID: \"56556613-ea65-4332-a960-dd14c4ad91b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"
Sep 08 16:27:04.375051 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.375052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56556613-ea65-4332-a960-dd14c4ad91b6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h\" (UID: \"56556613-ea65-4332-a960-dd14c4ad91b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"
Sep 08 16:27:04.375214 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.375180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6wv8\" (UniqueName: \"kubernetes.io/projected/56556613-ea65-4332-a960-dd14c4ad91b6-kube-api-access-d6wv8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h\" (UID: \"56556613-ea65-4332-a960-dd14c4ad91b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"
Sep 08 16:27:04.375395 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.375379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56556613-ea65-4332-a960-dd14c4ad91b6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h\" (UID: \"56556613-ea65-4332-a960-dd14c4ad91b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"
Sep 08 16:27:04.375474 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.375443    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56556613-ea65-4332-a960-dd14c4ad91b6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h\" (UID: \"56556613-ea65-4332-a960-dd14c4ad91b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"
Sep 08 16:27:04.393693 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.393668    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6wv8\" (UniqueName: \"kubernetes.io/projected/56556613-ea65-4332-a960-dd14c4ad91b6-kube-api-access-d6wv8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h\" (UID: \"56556613-ea65-4332-a960-dd14c4ad91b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"
Sep 08 16:27:04.404137 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.404113    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"
Sep 08 16:27:04.688754 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:04.688727    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"]
Sep 08 16:27:04.690599 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:27:04.690571    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56556613_ea65_4332_a960_dd14c4ad91b6.slice/crio-2d3cd54ded3bfffdbc5c51d579e554c262433a0c61b8f08466dc6fef619f3a79 WatchSource:0}: Error finding container 2d3cd54ded3bfffdbc5c51d579e554c262433a0c61b8f08466dc6fef619f3a79: Status 404 returned error can't find the container with id 2d3cd54ded3bfffdbc5c51d579e554c262433a0c61b8f08466dc6fef619f3a79
Sep 08 16:27:05.103657 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:05.103597    2562 generic.go:356] "Generic (PLEG): container finished" podID="56556613-ea65-4332-a960-dd14c4ad91b6" containerID="4dee7ac8f666d3de8ba673dc5b4b49bdb9f7c04c6f9ba715297d3715ef0317d2" exitCode=0
Sep 08 16:27:05.104004 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:05.103697    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h" event={"ID":"56556613-ea65-4332-a960-dd14c4ad91b6","Type":"ContainerDied","Data":"4dee7ac8f666d3de8ba673dc5b4b49bdb9f7c04c6f9ba715297d3715ef0317d2"}
Sep 08 16:27:05.104004 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:05.103750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h" event={"ID":"56556613-ea65-4332-a960-dd14c4ad91b6","Type":"ContainerStarted","Data":"2d3cd54ded3bfffdbc5c51d579e554c262433a0c61b8f08466dc6fef619f3a79"}
Sep 08 16:27:06.108851 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:06.108813    2562 generic.go:356] "Generic (PLEG): container finished" podID="56556613-ea65-4332-a960-dd14c4ad91b6" containerID="deaeaac3729c0a977a91cbc1e22b81ad02d6517be798c756c2be77c9b3fe20e4" exitCode=0
Sep 08 16:27:06.109206 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:06.108863    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h" event={"ID":"56556613-ea65-4332-a960-dd14c4ad91b6","Type":"ContainerDied","Data":"deaeaac3729c0a977a91cbc1e22b81ad02d6517be798c756c2be77c9b3fe20e4"}
Sep 08 16:27:07.115369 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:07.115338    2562 generic.go:356] "Generic (PLEG): container finished" podID="56556613-ea65-4332-a960-dd14c4ad91b6" containerID="eb80f801eaeb35eba3f69d5ebbac68c43b4a9d7c37fceaceb71b2b7dd08884c4" exitCode=0
Sep 08 16:27:07.115737 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:07.115424    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h" event={"ID":"56556613-ea65-4332-a960-dd14c4ad91b6","Type":"ContainerDied","Data":"eb80f801eaeb35eba3f69d5ebbac68c43b4a9d7c37fceaceb71b2b7dd08884c4"}
Sep 08 16:27:08.236134 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:08.236111    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"
Sep 08 16:27:08.304307 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:08.304280    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6wv8\" (UniqueName: \"kubernetes.io/projected/56556613-ea65-4332-a960-dd14c4ad91b6-kube-api-access-d6wv8\") pod \"56556613-ea65-4332-a960-dd14c4ad91b6\" (UID: \"56556613-ea65-4332-a960-dd14c4ad91b6\") "
Sep 08 16:27:08.304651 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:08.304331    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56556613-ea65-4332-a960-dd14c4ad91b6-util\") pod \"56556613-ea65-4332-a960-dd14c4ad91b6\" (UID: \"56556613-ea65-4332-a960-dd14c4ad91b6\") "
Sep 08 16:27:08.304651 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:08.304448    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56556613-ea65-4332-a960-dd14c4ad91b6-bundle\") pod \"56556613-ea65-4332-a960-dd14c4ad91b6\" (UID: \"56556613-ea65-4332-a960-dd14c4ad91b6\") "
Sep 08 16:27:08.305130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:08.305091    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56556613-ea65-4332-a960-dd14c4ad91b6-bundle" (OuterVolumeSpecName: "bundle") pod "56556613-ea65-4332-a960-dd14c4ad91b6" (UID: "56556613-ea65-4332-a960-dd14c4ad91b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:27:08.306227 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:08.306205    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56556613-ea65-4332-a960-dd14c4ad91b6-kube-api-access-d6wv8" (OuterVolumeSpecName: "kube-api-access-d6wv8") pod "56556613-ea65-4332-a960-dd14c4ad91b6" (UID: "56556613-ea65-4332-a960-dd14c4ad91b6"). InnerVolumeSpecName "kube-api-access-d6wv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:27:08.309981 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:08.309957    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56556613-ea65-4332-a960-dd14c4ad91b6-util" (OuterVolumeSpecName: "util") pod "56556613-ea65-4332-a960-dd14c4ad91b6" (UID: "56556613-ea65-4332-a960-dd14c4ad91b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:27:08.405251 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:08.405188    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56556613-ea65-4332-a960-dd14c4ad91b6-bundle\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:27:08.405251 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:08.405213    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6wv8\" (UniqueName: \"kubernetes.io/projected/56556613-ea65-4332-a960-dd14c4ad91b6-kube-api-access-d6wv8\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:27:08.405251 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:08.405226    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56556613-ea65-4332-a960-dd14c4ad91b6-util\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:27:09.124103 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:09.124065    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h" event={"ID":"56556613-ea65-4332-a960-dd14c4ad91b6","Type":"ContainerDied","Data":"2d3cd54ded3bfffdbc5c51d579e554c262433a0c61b8f08466dc6fef619f3a79"}
Sep 08 16:27:09.124271 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:09.124113    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfv7h"
Sep 08 16:27:09.124271 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:09.124117    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d3cd54ded3bfffdbc5c51d579e554c262433a0c61b8f08466dc6fef619f3a79"
Sep 08 16:27:14.644640 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:14.644593    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:14.809245 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:14.809207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:15.024586 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.024553    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"]
Sep 08 16:27:15.024830 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.024817    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56556613-ea65-4332-a960-dd14c4ad91b6" containerName="util"
Sep 08 16:27:15.024872 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.024832    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="56556613-ea65-4332-a960-dd14c4ad91b6" containerName="util"
Sep 08 16:27:15.024872 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.024845    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56556613-ea65-4332-a960-dd14c4ad91b6" containerName="pull"
Sep 08 16:27:15.024872 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.024851    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="56556613-ea65-4332-a960-dd14c4ad91b6" containerName="pull"
Sep 08 16:27:15.024872 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.024857    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56556613-ea65-4332-a960-dd14c4ad91b6" containerName="extract"
Sep 08 16:27:15.024872 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.024862    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="56556613-ea65-4332-a960-dd14c4ad91b6" containerName="extract"
Sep 08 16:27:15.025065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.024912    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="56556613-ea65-4332-a960-dd14c4ad91b6" containerName="extract"
Sep 08 16:27:15.026917 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.026899    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"
Sep 08 16:27:15.031444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.031424    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 16:27:15.031534 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.031448    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zjxgh\""
Sep 08 16:27:15.032317 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.032298    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 16:27:15.053536 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.053510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qts6\" (UniqueName: \"kubernetes.io/projected/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-kube-api-access-2qts6\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq\" (UID: \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"
Sep 08 16:27:15.053665 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.053576    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq\" (UID: \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"
Sep 08 16:27:15.053665 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.053601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq\" (UID: \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"
Sep 08 16:27:15.055656 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.055636    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"]
Sep 08 16:27:15.154255 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.154228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq\" (UID: \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"
Sep 08 16:27:15.154255 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.154254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq\" (UID: \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"
Sep 08 16:27:15.154418 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.154364    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qts6\" (UniqueName: \"kubernetes.io/projected/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-kube-api-access-2qts6\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq\" (UID: \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"
Sep 08 16:27:15.154585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.154566    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq\" (UID: \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"
Sep 08 16:27:15.154660 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.154599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq\" (UID: \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"
Sep 08 16:27:15.186900 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.186874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qts6\" (UniqueName: \"kubernetes.io/projected/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-kube-api-access-2qts6\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq\" (UID: \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"
Sep 08 16:27:15.336012 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.335944    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"
Sep 08 16:27:15.671139 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.671064    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"]
Sep 08 16:27:15.674289 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:27:15.674252    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe254a8d_93f7_4194_a0cb_7a59d5f41b19.slice/crio-1acbc42ca087d91fca2808b2d1a6ba9313bac0ef2d976c40b1ec389f9f62b761 WatchSource:0}: Error finding container 1acbc42ca087d91fca2808b2d1a6ba9313bac0ef2d976c40b1ec389f9f62b761: Status 404 returned error can't find the container with id 1acbc42ca087d91fca2808b2d1a6ba9313bac0ef2d976c40b1ec389f9f62b761
Sep 08 16:27:15.827971 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:15.827945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:16.156258 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:16.156215    2562 generic.go:356] "Generic (PLEG): container finished" podID="fe254a8d-93f7-4194-a0cb-7a59d5f41b19" containerID="d31f9a61a6f674255a1b9adbf36b36fdc61353d5296db04d0ea821fa64942475" exitCode=0
Sep 08 16:27:16.156438 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:16.156296    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq" event={"ID":"fe254a8d-93f7-4194-a0cb-7a59d5f41b19","Type":"ContainerDied","Data":"d31f9a61a6f674255a1b9adbf36b36fdc61353d5296db04d0ea821fa64942475"}
Sep 08 16:27:16.156438 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:16.156365    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq" event={"ID":"fe254a8d-93f7-4194-a0cb-7a59d5f41b19","Type":"ContainerStarted","Data":"1acbc42ca087d91fca2808b2d1a6ba9313bac0ef2d976c40b1ec389f9f62b761"}
Sep 08 16:27:16.373888 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:16.373849    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:16.498821 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:16.498784    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:18.167046 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:18.167014    2562 generic.go:356] "Generic (PLEG): container finished" podID="fe254a8d-93f7-4194-a0cb-7a59d5f41b19" containerID="40fd3a9beb5bc740539b745c8596b7f2bb39fc442701a84a2c0d284069286ae5" exitCode=0
Sep 08 16:27:18.167398 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:18.167102    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq" event={"ID":"fe254a8d-93f7-4194-a0cb-7a59d5f41b19","Type":"ContainerDied","Data":"40fd3a9beb5bc740539b745c8596b7f2bb39fc442701a84a2c0d284069286ae5"}
Sep 08 16:27:18.734656 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:18.734596    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:19.120837 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.120747    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"]
Sep 08 16:27:19.122896 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.122874    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.148871 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.148848    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 16:27:19.155644 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.155617    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 16:27:19.155747 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.155726    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 16:27:19.155806 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.155752    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 16:27:19.156576 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.156557    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mtxq4\""
Sep 08 16:27:19.158208 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.158191    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"]
Sep 08 16:27:19.172813 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.172791    2562 generic.go:356] "Generic (PLEG): container finished" podID="fe254a8d-93f7-4194-a0cb-7a59d5f41b19" containerID="437dbffd698190e8b1e885f94e980f5b2d2d170945af271a9beaf50a9faeb9e6" exitCode=0
Sep 08 16:27:19.173083 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.172857    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq" event={"ID":"fe254a8d-93f7-4194-a0cb-7a59d5f41b19","Type":"ContainerDied","Data":"437dbffd698190e8b1e885f94e980f5b2d2d170945af271a9beaf50a9faeb9e6"}
Sep 08 16:27:19.186242 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.186223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cade7f97-90d6-49f5-9247-1b107cf5061d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.186325 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.186254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cade7f97-90d6-49f5-9247-1b107cf5061d-manifests\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.186325 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.186274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-966jw\" (UniqueName: \"kubernetes.io/projected/cade7f97-90d6-49f5-9247-1b107cf5061d-kube-api-access-966jw\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.186325 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.186315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cade7f97-90d6-49f5-9247-1b107cf5061d-tmp\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.186435 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.186356    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cade7f97-90d6-49f5-9247-1b107cf5061d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.202505 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.202480    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:19.287436 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.287412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cade7f97-90d6-49f5-9247-1b107cf5061d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.287539 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.287444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cade7f97-90d6-49f5-9247-1b107cf5061d-manifests\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.287539 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.287462    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-966jw\" (UniqueName: \"kubernetes.io/projected/cade7f97-90d6-49f5-9247-1b107cf5061d-kube-api-access-966jw\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.287539 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.287482    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cade7f97-90d6-49f5-9247-1b107cf5061d-tmp\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.287539 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.287517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cade7f97-90d6-49f5-9247-1b107cf5061d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.287948 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.287922    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cade7f97-90d6-49f5-9247-1b107cf5061d-manifests\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.289786 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.289757    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cade7f97-90d6-49f5-9247-1b107cf5061d-tmp\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.289880 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.289840    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cade7f97-90d6-49f5-9247-1b107cf5061d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.289880 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.289865    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cade7f97-90d6-49f5-9247-1b107cf5061d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.372418 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.372365    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"]
Sep 08 16:27:19.374360 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.374342    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.378656 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.378637    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-966jw\" (UniqueName: \"kubernetes.io/projected/cade7f97-90d6-49f5-9247-1b107cf5061d-kube-api-access-966jw\") pod \"opendatahub-operator-controller-manager-6fcf9b86-b9qnp\" (UID: \"cade7f97-90d6-49f5-9247-1b107cf5061d\") " pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.388230 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.388204    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/214d8793-55a5-467f-8583-4543780e4e7f-metrics-cert\") pod \"lws-controller-manager-5ddb9f5cb8-rm45r\" (UID: \"214d8793-55a5-467f-8583-4543780e4e7f\") " pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.388332 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.388278    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/214d8793-55a5-467f-8583-4543780e4e7f-manager-config\") pod \"lws-controller-manager-5ddb9f5cb8-rm45r\" (UID: \"214d8793-55a5-467f-8583-4543780e4e7f\") " pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.388332 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.388306    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/214d8793-55a5-467f-8583-4543780e4e7f-cert\") pod \"lws-controller-manager-5ddb9f5cb8-rm45r\" (UID: \"214d8793-55a5-467f-8583-4543780e4e7f\") " pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.388332 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.388325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg8wp\" (UniqueName: \"kubernetes.io/projected/214d8793-55a5-467f-8583-4543780e4e7f-kube-api-access-lg8wp\") pod \"lws-controller-manager-5ddb9f5cb8-rm45r\" (UID: \"214d8793-55a5-467f-8583-4543780e4e7f\") " pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.432230 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.432200    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:19.475492 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.475462    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 08 16:27:19.488854 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.488827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/214d8793-55a5-467f-8583-4543780e4e7f-manager-config\") pod \"lws-controller-manager-5ddb9f5cb8-rm45r\" (UID: \"214d8793-55a5-467f-8583-4543780e4e7f\") " pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.488947 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.488873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/214d8793-55a5-467f-8583-4543780e4e7f-cert\") pod \"lws-controller-manager-5ddb9f5cb8-rm45r\" (UID: \"214d8793-55a5-467f-8583-4543780e4e7f\") " pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.489015 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.488967    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg8wp\" (UniqueName: \"kubernetes.io/projected/214d8793-55a5-467f-8583-4543780e4e7f-kube-api-access-lg8wp\") pod \"lws-controller-manager-5ddb9f5cb8-rm45r\" (UID: \"214d8793-55a5-467f-8583-4543780e4e7f\") " pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.489068 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.489033    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/214d8793-55a5-467f-8583-4543780e4e7f-metrics-cert\") pod \"lws-controller-manager-5ddb9f5cb8-rm45r\" (UID: \"214d8793-55a5-467f-8583-4543780e4e7f\") " pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.491751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.491562    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/214d8793-55a5-467f-8583-4543780e4e7f-cert\") pod \"lws-controller-manager-5ddb9f5cb8-rm45r\" (UID: \"214d8793-55a5-467f-8583-4543780e4e7f\") " pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.616398 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.616371    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 08 16:27:19.621621 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.621585    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/214d8793-55a5-467f-8583-4543780e4e7f-metrics-cert\") pod \"lws-controller-manager-5ddb9f5cb8-rm45r\" (UID: \"214d8793-55a5-467f-8583-4543780e4e7f\") " pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.629158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.629110    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g8gnn\""
Sep 08 16:27:19.631036 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.631013    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"]
Sep 08 16:27:19.661247 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.661220    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 08 16:27:19.670027 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.670002    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/214d8793-55a5-467f-8583-4543780e4e7f-manager-config\") pod \"lws-controller-manager-5ddb9f5cb8-rm45r\" (UID: \"214d8793-55a5-467f-8583-4543780e4e7f\") " pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.685289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.685269    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg8wp\" (UniqueName: \"kubernetes.io/projected/214d8793-55a5-467f-8583-4543780e4e7f-kube-api-access-lg8wp\") pod \"lws-controller-manager-5ddb9f5cb8-rm45r\" (UID: \"214d8793-55a5-467f-8583-4543780e4e7f\") " pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.689081 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.689064    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:19.842746 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:19.842718    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"]
Sep 08 16:27:19.845288 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:27:19.845264    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcade7f97_90d6_49f5_9247_1b107cf5061d.slice/crio-ff98a356b103acd7a12a9532771d3fb171ea1e82701159c39f1706a375a3e5ae WatchSource:0}: Error finding container ff98a356b103acd7a12a9532771d3fb171ea1e82701159c39f1706a375a3e5ae: Status 404 returned error can't find the container with id ff98a356b103acd7a12a9532771d3fb171ea1e82701159c39f1706a375a3e5ae
Sep 08 16:27:20.063413 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.063340    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"]
Sep 08 16:27:20.065769 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:27:20.065746    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod214d8793_55a5_467f_8583_4543780e4e7f.slice/crio-be499ac6c530ea72f7234683fe4d1937edfc4215b05db997f49aff028285e405 WatchSource:0}: Error finding container be499ac6c530ea72f7234683fe4d1937edfc4215b05db997f49aff028285e405: Status 404 returned error can't find the container with id be499ac6c530ea72f7234683fe4d1937edfc4215b05db997f49aff028285e405
Sep 08 16:27:20.178393 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.178356    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp" event={"ID":"cade7f97-90d6-49f5-9247-1b107cf5061d","Type":"ContainerStarted","Data":"ff98a356b103acd7a12a9532771d3fb171ea1e82701159c39f1706a375a3e5ae"}
Sep 08 16:27:20.179484 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.179462    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r" event={"ID":"214d8793-55a5-467f-8583-4543780e4e7f","Type":"ContainerStarted","Data":"be499ac6c530ea72f7234683fe4d1937edfc4215b05db997f49aff028285e405"}
Sep 08 16:27:20.291598 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.291574    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"
Sep 08 16:27:20.392131 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.392059    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:20.394944 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.394928    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qts6\" (UniqueName: \"kubernetes.io/projected/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-kube-api-access-2qts6\") pod \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\" (UID: \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\") "
Sep 08 16:27:20.395046 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.394973    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-bundle\") pod \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\" (UID: \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\") "
Sep 08 16:27:20.395046 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.395039    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-util\") pod \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\" (UID: \"fe254a8d-93f7-4194-a0cb-7a59d5f41b19\") "
Sep 08 16:27:20.395835 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.395807    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-bundle" (OuterVolumeSpecName: "bundle") pod "fe254a8d-93f7-4194-a0cb-7a59d5f41b19" (UID: "fe254a8d-93f7-4194-a0cb-7a59d5f41b19"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:27:20.397063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.397038    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-kube-api-access-2qts6" (OuterVolumeSpecName: "kube-api-access-2qts6") pod "fe254a8d-93f7-4194-a0cb-7a59d5f41b19" (UID: "fe254a8d-93f7-4194-a0cb-7a59d5f41b19"). InnerVolumeSpecName "kube-api-access-2qts6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:27:20.400875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.400856    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-util" (OuterVolumeSpecName: "util") pod "fe254a8d-93f7-4194-a0cb-7a59d5f41b19" (UID: "fe254a8d-93f7-4194-a0cb-7a59d5f41b19"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:27:20.495554 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.495524    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-bundle\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:27:20.495554 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.495543    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-util\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:27:20.495554 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.495552    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qts6\" (UniqueName: \"kubernetes.io/projected/fe254a8d-93f7-4194-a0cb-7a59d5f41b19-kube-api-access-2qts6\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:27:20.680244 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:20.680093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:21.146435 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:21.146392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:21.190810 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:21.188776    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq" event={"ID":"fe254a8d-93f7-4194-a0cb-7a59d5f41b19","Type":"ContainerDied","Data":"1acbc42ca087d91fca2808b2d1a6ba9313bac0ef2d976c40b1ec389f9f62b761"}
Sep 08 16:27:21.190810 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:21.188837    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1acbc42ca087d91fca2808b2d1a6ba9313bac0ef2d976c40b1ec389f9f62b761"
Sep 08 16:27:21.190810 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:21.188795    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bcllq"
Sep 08 16:27:21.583539 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:21.583488    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:22.082410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:22.082375    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:24.204352 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:24.204315    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp" event={"ID":"cade7f97-90d6-49f5-9247-1b107cf5061d","Type":"ContainerStarted","Data":"57b24da85256ecca33f6d961e38ff12924bb35af148e5e2e94d5257c1e6cbf2e"}
Sep 08 16:27:24.205977 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:24.205952    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r" event={"ID":"214d8793-55a5-467f-8583-4543780e4e7f","Type":"ContainerStarted","Data":"5852bf16b0e31f9f2d796cd84f044f0ff972227a335d05babe2e49c6281aeb26"}
Sep 08 16:27:24.206069 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:24.206005    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:24.320353 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:24.320306    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r" podStartSLOduration=1.9879643040000001 podStartE2EDuration="5.320290488s" totalImagesPullingTime="3.332326184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:27:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:27:24.318926519 +0000 UTC m=+286.903488139" watchObservedRunningTime="2026-09-08 16:27:24.320290488 +0000 UTC m=+286.904852106"
Sep 08 16:27:25.212243 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:25.212206    2562 generic.go:356] "Generic (PLEG): container finished" podID="cade7f97-90d6-49f5-9247-1b107cf5061d" containerID="57b24da85256ecca33f6d961e38ff12924bb35af148e5e2e94d5257c1e6cbf2e" exitCode=0
Sep 08 16:27:25.212627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:25.212285    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp" event={"ID":"cade7f97-90d6-49f5-9247-1b107cf5061d","Type":"ContainerDied","Data":"57b24da85256ecca33f6d961e38ff12924bb35af148e5e2e94d5257c1e6cbf2e"}
Sep 08 16:27:26.218293 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:26.218255    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp" event={"ID":"cade7f97-90d6-49f5-9247-1b107cf5061d","Type":"ContainerStarted","Data":"73ff960611cde9c322c609e334d06592bece315a671ead45aa9c14fb0bdb5198"}
Sep 08 16:27:26.218690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:26.218412    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:34.322121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:34.322088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:35.214160 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:35.214132    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5ddb9f5cb8-rm45r"
Sep 08 16:27:35.250582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:35.250536    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp" podStartSLOduration=11.132081157 podStartE2EDuration="16.250522244s" totalImagesPullingTime="4.066777787s" totalInitContainerRuntime="1.0516633s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:27:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:27:26.312100608 +0000 UTC m=+288.896662226" watchObservedRunningTime="2026-09-08 16:27:35.250522244 +0000 UTC m=+297.835083863"
Sep 08 16:27:36.081241 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:36.081206    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:37.225000 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:37.224970    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fcf9b86-b9qnp"
Sep 08 16:27:37.820717 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:37.820689    2562 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 16:27:42.006889 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:42.006852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:42.232751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:42.232719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:42.744853 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:42.744807    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:43.040321 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:43.040237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:46.676767 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:46.676730    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:47.597223 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:47.597180    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:49.036260 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:49.036216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:51.475279 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:51.475250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:51.589180 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:51.589145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:52.390071 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.390039    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"]
Sep 08 16:27:52.390403 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.390390    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe254a8d-93f7-4194-a0cb-7a59d5f41b19" containerName="extract"
Sep 08 16:27:52.390444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.390406    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe254a8d-93f7-4194-a0cb-7a59d5f41b19" containerName="extract"
Sep 08 16:27:52.390444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.390427    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe254a8d-93f7-4194-a0cb-7a59d5f41b19" containerName="util"
Sep 08 16:27:52.390444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.390435    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe254a8d-93f7-4194-a0cb-7a59d5f41b19" containerName="util"
Sep 08 16:27:52.390534 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.390446    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe254a8d-93f7-4194-a0cb-7a59d5f41b19" containerName="pull"
Sep 08 16:27:52.390534 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.390454    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe254a8d-93f7-4194-a0cb-7a59d5f41b19" containerName="pull"
Sep 08 16:27:52.390597 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.390533    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe254a8d-93f7-4194-a0cb-7a59d5f41b19" containerName="extract"
Sep 08 16:27:52.396998 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.396980    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.401420 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.401394    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 16:27:52.401563 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.401543    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 16:27:52.401632 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.401543    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 16:27:52.406103 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.406087    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6jvcl\""
Sep 08 16:27:52.425240 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.425209    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"]
Sep 08 16:27:52.449485 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.449442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:52.525253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.525219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.525588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.525258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.525588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.525345    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.525588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.525376    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.525588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.525393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.525588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.525416    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.525588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.525433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.525588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.525452    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.525588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.525521    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6qh5\" (UniqueName: \"kubernetes.io/projected/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-kube-api-access-h6qh5\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.626220 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.626186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.626379 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.626229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.626379 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.626256    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.626379 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.626278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.626379 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.626300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.626379 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.626324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.626654 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.626383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6qh5\" (UniqueName: \"kubernetes.io/projected/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-kube-api-access-h6qh5\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.626654 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.626430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.626654 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.626483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.626804 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.626702    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.627051 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.627022    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.627159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.627056    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.627159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.627093    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.627159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.627149    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.629403 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.629375    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.629604 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.629586    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.637619 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.637581    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6qh5\" (UniqueName: \"kubernetes.io/projected/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-kube-api-access-h6qh5\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.638947 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.638930    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/041f90c4-50b0-4ce8-bfff-1f3ba3486e19-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf\" (UID: \"041f90c4-50b0-4ce8-bfff-1f3ba3486e19\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.706781 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.706749    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:52.784177 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:52.784130    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:53.003562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.003472    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:53.030357 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.030326    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"]
Sep 08 16:27:53.031106 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:27:53.031083    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041f90c4_50b0_4ce8_bfff_1f3ba3486e19.slice/crio-d715028bfbcc6329758386dff8f9a9507b0ea374886af2b4d00b92cc10959116 WatchSource:0}: Error finding container d715028bfbcc6329758386dff8f9a9507b0ea374886af2b4d00b92cc10959116: Status 404 returned error can't find the container with id d715028bfbcc6329758386dff8f9a9507b0ea374886af2b4d00b92cc10959116
Sep 08 16:27:53.032998 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.032982    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:27:53.234718 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.234685    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6bkt2"]
Sep 08 16:27:53.239420 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.239400    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6bkt2"
Sep 08 16:27:53.246187 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.246167    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:53.254077 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.254023    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-58khx\""
Sep 08 16:27:53.254174 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.254130    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 08 16:27:53.299273 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.299250    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6bkt2"]
Sep 08 16:27:53.331159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.331131    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf" event={"ID":"041f90c4-50b0-4ce8-bfff-1f3ba3486e19","Type":"ContainerStarted","Data":"d715028bfbcc6329758386dff8f9a9507b0ea374886af2b4d00b92cc10959116"}
Sep 08 16:27:53.334554 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.334531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eec2efee-b97f-43db-9172-11c873e190b2-cert\") pod \"odh-model-controller-7998c67dc4-6bkt2\" (UID: \"eec2efee-b97f-43db-9172-11c873e190b2\") " pod="opendatahub/odh-model-controller-7998c67dc4-6bkt2"
Sep 08 16:27:53.334665 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.334641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rtl5\" (UniqueName: \"kubernetes.io/projected/eec2efee-b97f-43db-9172-11c873e190b2-kube-api-access-4rtl5\") pod \"odh-model-controller-7998c67dc4-6bkt2\" (UID: \"eec2efee-b97f-43db-9172-11c873e190b2\") " pod="opendatahub/odh-model-controller-7998c67dc4-6bkt2"
Sep 08 16:27:53.435880 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.435845    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rtl5\" (UniqueName: \"kubernetes.io/projected/eec2efee-b97f-43db-9172-11c873e190b2-kube-api-access-4rtl5\") pod \"odh-model-controller-7998c67dc4-6bkt2\" (UID: \"eec2efee-b97f-43db-9172-11c873e190b2\") " pod="opendatahub/odh-model-controller-7998c67dc4-6bkt2"
Sep 08 16:27:53.436020 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.435908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eec2efee-b97f-43db-9172-11c873e190b2-cert\") pod \"odh-model-controller-7998c67dc4-6bkt2\" (UID: \"eec2efee-b97f-43db-9172-11c873e190b2\") " pod="opendatahub/odh-model-controller-7998c67dc4-6bkt2"
Sep 08 16:27:53.438202 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.438178    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eec2efee-b97f-43db-9172-11c873e190b2-cert\") pod \"odh-model-controller-7998c67dc4-6bkt2\" (UID: \"eec2efee-b97f-43db-9172-11c873e190b2\") " pod="opendatahub/odh-model-controller-7998c67dc4-6bkt2"
Sep 08 16:27:53.448992 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.448970    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rtl5\" (UniqueName: \"kubernetes.io/projected/eec2efee-b97f-43db-9172-11c873e190b2-kube-api-access-4rtl5\") pod \"odh-model-controller-7998c67dc4-6bkt2\" (UID: \"eec2efee-b97f-43db-9172-11c873e190b2\") " pod="opendatahub/odh-model-controller-7998c67dc4-6bkt2"
Sep 08 16:27:53.453886 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.453863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:53.549540 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.549492    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6bkt2"
Sep 08 16:27:53.832121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:53.832042    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6bkt2"]
Sep 08 16:27:53.835481 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:27:53.835455    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec2efee_b97f_43db_9172_11c873e190b2.slice/crio-8a475ea40b0bf33601127ffd96931db9a9904bcc79c0d3c7f15d8550dd1d85ec WatchSource:0}: Error finding container 8a475ea40b0bf33601127ffd96931db9a9904bcc79c0d3c7f15d8550dd1d85ec: Status 404 returned error can't find the container with id 8a475ea40b0bf33601127ffd96931db9a9904bcc79c0d3c7f15d8550dd1d85ec
Sep 08 16:27:54.208566 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:54.208538    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qwgbj"]
Sep 08 16:27:54.213093 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:54.213078    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj"
Sep 08 16:27:54.217065 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:27:54.217031    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"model-serving-api-54d89bd5fc-qwgbj\" is forbidden: User \"system:node:ip-10-0-139-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-55.ec2.internal' and this object" podUID="c26109ce-727a-4b30-bb5d-0cd035426db9" pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj"
Sep 08 16:27:54.217214 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:27:54.217073    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"model-serving-api-dockercfg-rmw89\" is forbidden: User \"system:node:ip-10-0-139-55.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-55.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-rmw89\"" type="*v1.Secret"
Sep 08 16:27:54.217214 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:27:54.217073    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"model-serving-api-tls\" is forbidden: User \"system:node:ip-10-0-139-55.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-55.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" type="*v1.Secret"
Sep 08 16:27:54.258907 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:54.258881    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qwgbj"]
Sep 08 16:27:54.337270 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:54.337241    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6bkt2" event={"ID":"eec2efee-b97f-43db-9172-11c873e190b2","Type":"ContainerStarted","Data":"8a475ea40b0bf33601127ffd96931db9a9904bcc79c0d3c7f15d8550dd1d85ec"}
Sep 08 16:27:54.343788 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:54.343763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj4ln\" (UniqueName: \"kubernetes.io/projected/c26109ce-727a-4b30-bb5d-0cd035426db9-kube-api-access-cj4ln\") pod \"model-serving-api-54d89bd5fc-qwgbj\" (UID: \"c26109ce-727a-4b30-bb5d-0cd035426db9\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj"
Sep 08 16:27:54.343901 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:54.343878    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c26109ce-727a-4b30-bb5d-0cd035426db9-tls-certs\") pod \"model-serving-api-54d89bd5fc-qwgbj\" (UID: \"c26109ce-727a-4b30-bb5d-0cd035426db9\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj"
Sep 08 16:27:54.444553 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:54.444524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj4ln\" (UniqueName: \"kubernetes.io/projected/c26109ce-727a-4b30-bb5d-0cd035426db9-kube-api-access-cj4ln\") pod \"model-serving-api-54d89bd5fc-qwgbj\" (UID: \"c26109ce-727a-4b30-bb5d-0cd035426db9\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj"
Sep 08 16:27:54.444722 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:54.444587    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c26109ce-727a-4b30-bb5d-0cd035426db9-tls-certs\") pod \"model-serving-api-54d89bd5fc-qwgbj\" (UID: \"c26109ce-727a-4b30-bb5d-0cd035426db9\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj"
Sep 08 16:27:54.456600 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:54.456568    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:54.457366 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:54.457344    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj4ln\" (UniqueName: \"kubernetes.io/projected/c26109ce-727a-4b30-bb5d-0cd035426db9-kube-api-access-cj4ln\") pod \"model-serving-api-54d89bd5fc-qwgbj\" (UID: \"c26109ce-727a-4b30-bb5d-0cd035426db9\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj"
Sep 08 16:27:54.596355 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:54.596297    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:27:55.445337 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:27:55.445303    2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: failed to sync secret cache: timed out waiting for the condition
Sep 08 16:27:55.445527 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:27:55.445394    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26109ce-727a-4b30-bb5d-0cd035426db9-tls-certs podName:c26109ce-727a-4b30-bb5d-0cd035426db9 nodeName:}" failed. No retries permitted until 2026-09-08 16:27:55.945372307 +0000 UTC m=+318.529933917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c26109ce-727a-4b30-bb5d-0cd035426db9-tls-certs") pod "model-serving-api-54d89bd5fc-qwgbj" (UID: "c26109ce-727a-4b30-bb5d-0cd035426db9") : failed to sync secret cache: timed out waiting for the condition
Sep 08 16:27:55.758377 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:55.758306    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 08 16:27:55.770622 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:55.770579    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-rmw89\""
Sep 08 16:27:55.958853 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:55.958814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c26109ce-727a-4b30-bb5d-0cd035426db9-tls-certs\") pod \"model-serving-api-54d89bd5fc-qwgbj\" (UID: \"c26109ce-727a-4b30-bb5d-0cd035426db9\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj"
Sep 08 16:27:55.961749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:55.961721    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c26109ce-727a-4b30-bb5d-0cd035426db9-tls-certs\") pod \"model-serving-api-54d89bd5fc-qwgbj\" (UID: \"c26109ce-727a-4b30-bb5d-0cd035426db9\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj"
Sep 08 16:27:56.024159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:56.024080    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj"
Sep 08 16:27:58.440782 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:58.440731    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:27:58.441084 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:58.440817    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:27:58.441084 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:58.440850    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:27:58.726327 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:58.726294    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qwgbj"]
Sep 08 16:27:58.732532 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:27:58.732506    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26109ce_727a_4b30_bb5d_0cd035426db9.slice/crio-b1173deb2cb710ea00c254075121fbc942f72c3eb1b12d7e2d45e87cac3d0f54 WatchSource:0}: Error finding container b1173deb2cb710ea00c254075121fbc942f72c3eb1b12d7e2d45e87cac3d0f54: Status 404 returned error can't find the container with id b1173deb2cb710ea00c254075121fbc942f72c3eb1b12d7e2d45e87cac3d0f54
Sep 08 16:27:59.369270 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:59.369200    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf" event={"ID":"041f90c4-50b0-4ce8-bfff-1f3ba3486e19","Type":"ContainerStarted","Data":"6f45e62cdfd36c7db67224eae86692e6da18b881004cbbe582b5e3551ff62611"}
Sep 08 16:27:59.371053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:59.371019    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6bkt2" event={"ID":"eec2efee-b97f-43db-9172-11c873e190b2","Type":"ContainerStarted","Data":"41836d24fb3025a16800e8ccc3c26f2446756f6b8305cdaca4ff48d4d42b3f77"}
Sep 08 16:27:59.371193 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:59.371100    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-6bkt2"
Sep 08 16:27:59.372560 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:59.372531    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj" event={"ID":"c26109ce-727a-4b30-bb5d-0cd035426db9","Type":"ContainerStarted","Data":"b1173deb2cb710ea00c254075121fbc942f72c3eb1b12d7e2d45e87cac3d0f54"}
Sep 08 16:27:59.477121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:59.477065    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf" podStartSLOduration=2.069657405 podStartE2EDuration="7.47704662s" totalImagesPullingTime="5.407389215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:27:59.475922556 +0000 UTC m=+322.060484175" watchObservedRunningTime="2026-09-08 16:27:59.47704662 +0000 UTC m=+322.061608239"
Sep 08 16:27:59.707664 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:59.707628    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:59.713593 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:59.713570    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:27:59.844722 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:59.844663    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-6bkt2" podStartSLOduration=2.234034238 podStartE2EDuration="6.844644144s" totalImagesPullingTime="4.610609906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:27:59.50421652 +0000 UTC m=+322.088778138" watchObservedRunningTime="2026-09-08 16:27:59.844644144 +0000 UTC m=+322.429205762"
Sep 08 16:27:59.958793 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:27:59.958707    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:28:00.179005 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:00.178969    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:28:00.378494 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:00.378378    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:28:00.379361 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:00.379334    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf"
Sep 08 16:28:01.384475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:01.384392    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj" event={"ID":"c26109ce-727a-4b30-bb5d-0cd035426db9","Type":"ContainerStarted","Data":"ef51212fdcaef90b750a7107a40a4fe07734621c4819492139ff473bf9c31de3"}
Sep 08 16:28:01.384838 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:01.384482    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj"
Sep 08 16:28:01.425864 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:01.425812    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj" podStartSLOduration=5.093452421 podStartE2EDuration="7.425793251s" totalImagesPullingTime="2.33234083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:28:01.424888615 +0000 UTC m=+324.009450234" watchObservedRunningTime="2026-09-08 16:28:01.425793251 +0000 UTC m=+324.010354870"
Sep 08 16:28:05.874530 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:05.874493    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:28:06.058103 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:06.058070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:28:06.451157 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:06.451103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:28:06.579543 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:06.579508    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:28:06.859420 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:06.859334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:28:07.494206 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:07.494177    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:28:07.611553 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:07.611509    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:28:07.725429 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:07.725396    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:28:10.380821 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:10.380789    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-6bkt2"
Sep 08 16:28:12.393298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:12.393268    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qwgbj"
Sep 08 16:28:54.111416 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:54.111372    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:28:54.262863 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:54.262822    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:28:58.785238 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.785203    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"]
Sep 08 16:28:58.789601 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.789582    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"
Sep 08 16:28:58.792172 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.792151    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 16:28:58.792447 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.792416    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zjxgh\""
Sep 08 16:28:58.793164 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.793144    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 16:28:58.798683 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.798662    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"]
Sep 08 16:28:58.878190 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.878158    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czx2m\" (UniqueName: \"kubernetes.io/projected/13a7f736-e436-4fbb-8a7b-fa5a5781b939-kube-api-access-czx2m\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4\" (UID: \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"
Sep 08 16:28:58.878384 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.878228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13a7f736-e436-4fbb-8a7b-fa5a5781b939-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4\" (UID: \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"
Sep 08 16:28:58.878384 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.878279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13a7f736-e436-4fbb-8a7b-fa5a5781b939-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4\" (UID: \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"
Sep 08 16:28:58.885278 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.885254    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"]
Sep 08 16:28:58.887669 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.887655    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"
Sep 08 16:28:58.901724 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.901700    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"]
Sep 08 16:28:58.979570 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.979540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13a7f736-e436-4fbb-8a7b-fa5a5781b939-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4\" (UID: \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"
Sep 08 16:28:58.979760 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.979577    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13a7f736-e436-4fbb-8a7b-fa5a5781b939-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4\" (UID: \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"
Sep 08 16:28:58.979760 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.979604    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fce2c663-266d-4dfa-aa72-e955186ae717-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q\" (UID: \"fce2c663-266d-4dfa-aa72-e955186ae717\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"
Sep 08 16:28:58.979760 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.979670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czx2m\" (UniqueName: \"kubernetes.io/projected/13a7f736-e436-4fbb-8a7b-fa5a5781b939-kube-api-access-czx2m\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4\" (UID: \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"
Sep 08 16:28:58.979760 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.979727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z9n8\" (UniqueName: \"kubernetes.io/projected/fce2c663-266d-4dfa-aa72-e955186ae717-kube-api-access-9z9n8\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q\" (UID: \"fce2c663-266d-4dfa-aa72-e955186ae717\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"
Sep 08 16:28:58.979974 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.979764    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fce2c663-266d-4dfa-aa72-e955186ae717-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q\" (UID: \"fce2c663-266d-4dfa-aa72-e955186ae717\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"
Sep 08 16:28:58.979974 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.979949    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13a7f736-e436-4fbb-8a7b-fa5a5781b939-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4\" (UID: \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"
Sep 08 16:28:58.980081 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.980035    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13a7f736-e436-4fbb-8a7b-fa5a5781b939-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4\" (UID: \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"
Sep 08 16:28:58.987677 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.987648    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"]
Sep 08 16:28:58.990050 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.990035    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"
Sep 08 16:28:58.994883 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:58.994859    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czx2m\" (UniqueName: \"kubernetes.io/projected/13a7f736-e436-4fbb-8a7b-fa5a5781b939-kube-api-access-czx2m\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4\" (UID: \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"
Sep 08 16:28:59.001486 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.001462    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"]
Sep 08 16:28:59.080342 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.080268    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae5d8784-79de-4846-a5cd-23134fcf20db-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g\" (UID: \"ae5d8784-79de-4846-a5cd-23134fcf20db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"
Sep 08 16:28:59.080342 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.080328    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fce2c663-266d-4dfa-aa72-e955186ae717-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q\" (UID: \"fce2c663-266d-4dfa-aa72-e955186ae717\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"
Sep 08 16:28:59.080519 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.080374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2n7t\" (UniqueName: \"kubernetes.io/projected/ae5d8784-79de-4846-a5cd-23134fcf20db-kube-api-access-f2n7t\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g\" (UID: \"ae5d8784-79de-4846-a5cd-23134fcf20db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"
Sep 08 16:28:59.080519 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.080420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae5d8784-79de-4846-a5cd-23134fcf20db-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g\" (UID: \"ae5d8784-79de-4846-a5cd-23134fcf20db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"
Sep 08 16:28:59.080598 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.080543    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z9n8\" (UniqueName: \"kubernetes.io/projected/fce2c663-266d-4dfa-aa72-e955186ae717-kube-api-access-9z9n8\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q\" (UID: \"fce2c663-266d-4dfa-aa72-e955186ae717\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"
Sep 08 16:28:59.080665 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.080645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fce2c663-266d-4dfa-aa72-e955186ae717-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q\" (UID: \"fce2c663-266d-4dfa-aa72-e955186ae717\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"
Sep 08 16:28:59.080813 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.080792    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fce2c663-266d-4dfa-aa72-e955186ae717-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q\" (UID: \"fce2c663-266d-4dfa-aa72-e955186ae717\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"
Sep 08 16:28:59.080917 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.080903    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fce2c663-266d-4dfa-aa72-e955186ae717-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q\" (UID: \"fce2c663-266d-4dfa-aa72-e955186ae717\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"
Sep 08 16:28:59.083475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.083455    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"]
Sep 08 16:28:59.089915 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.089893    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"
Sep 08 16:28:59.093788 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.093768    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z9n8\" (UniqueName: \"kubernetes.io/projected/fce2c663-266d-4dfa-aa72-e955186ae717-kube-api-access-9z9n8\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q\" (UID: \"fce2c663-266d-4dfa-aa72-e955186ae717\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"
Sep 08 16:28:59.098505 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.098489    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"
Sep 08 16:28:59.104399 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.104378    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"]
Sep 08 16:28:59.181218 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.181183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv\" (UID: \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"
Sep 08 16:28:59.181333 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.181229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae5d8784-79de-4846-a5cd-23134fcf20db-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g\" (UID: \"ae5d8784-79de-4846-a5cd-23134fcf20db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"
Sep 08 16:28:59.181333 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.181310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2n7t\" (UniqueName: \"kubernetes.io/projected/ae5d8784-79de-4846-a5cd-23134fcf20db-kube-api-access-f2n7t\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g\" (UID: \"ae5d8784-79de-4846-a5cd-23134fcf20db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"
Sep 08 16:28:59.181420 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.181346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae5d8784-79de-4846-a5cd-23134fcf20db-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g\" (UID: \"ae5d8784-79de-4846-a5cd-23134fcf20db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"
Sep 08 16:28:59.181420 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.181366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clv29\" (UniqueName: \"kubernetes.io/projected/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-kube-api-access-clv29\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv\" (UID: \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"
Sep 08 16:28:59.181484 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.181469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv\" (UID: \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"
Sep 08 16:28:59.181588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.181570    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae5d8784-79de-4846-a5cd-23134fcf20db-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g\" (UID: \"ae5d8784-79de-4846-a5cd-23134fcf20db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"
Sep 08 16:28:59.181666 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.181650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae5d8784-79de-4846-a5cd-23134fcf20db-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g\" (UID: \"ae5d8784-79de-4846-a5cd-23134fcf20db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"
Sep 08 16:28:59.191216 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.191191    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2n7t\" (UniqueName: \"kubernetes.io/projected/ae5d8784-79de-4846-a5cd-23134fcf20db-kube-api-access-f2n7t\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g\" (UID: \"ae5d8784-79de-4846-a5cd-23134fcf20db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"
Sep 08 16:28:59.196007 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.195990    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"
Sep 08 16:28:59.282407 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.282374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv\" (UID: \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"
Sep 08 16:28:59.282574 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.282451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clv29\" (UniqueName: \"kubernetes.io/projected/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-kube-api-access-clv29\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv\" (UID: \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"
Sep 08 16:28:59.282574 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.282477    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv\" (UID: \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"
Sep 08 16:28:59.282887 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.282792    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv\" (UID: \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"
Sep 08 16:28:59.282887 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.282836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv\" (UID: \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"
Sep 08 16:28:59.291732 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.291705    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clv29\" (UniqueName: \"kubernetes.io/projected/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-kube-api-access-clv29\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv\" (UID: \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"
Sep 08 16:28:59.307070 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.307046    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"
Sep 08 16:28:59.373354 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.373324    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"]
Sep 08 16:28:59.375227 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:28:59.375178    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a7f736_e436_4fbb_8a7b_fa5a5781b939.slice/crio-3a24a6ff821aa8ed7ec9088b50aed92c432f8db2b6cea4dcb93db222426d8710 WatchSource:0}: Error finding container 3a24a6ff821aa8ed7ec9088b50aed92c432f8db2b6cea4dcb93db222426d8710: Status 404 returned error can't find the container with id 3a24a6ff821aa8ed7ec9088b50aed92c432f8db2b6cea4dcb93db222426d8710
Sep 08 16:28:59.405241 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.405217    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"
Sep 08 16:28:59.466666 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.466313    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"]
Sep 08 16:28:59.470752 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:28:59.470717    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfce2c663_266d_4dfa_aa72_e955186ae717.slice/crio-2adf42a17d5cb9a7db0440ef4e8a0c164b93981b842291901464f140f9a0b068 WatchSource:0}: Error finding container 2adf42a17d5cb9a7db0440ef4e8a0c164b93981b842291901464f140f9a0b068: Status 404 returned error can't find the container with id 2adf42a17d5cb9a7db0440ef4e8a0c164b93981b842291901464f140f9a0b068
Sep 08 16:28:59.578283 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.578254    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"]
Sep 08 16:28:59.579676 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:28:59.579648    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5d8784_79de_4846_a5cd_23134fcf20db.slice/crio-36482a593c56f711751e00d8437d0a5543aff1eeed45523b10ee7e9f4cc3aab1 WatchSource:0}: Error finding container 36482a593c56f711751e00d8437d0a5543aff1eeed45523b10ee7e9f4cc3aab1: Status 404 returned error can't find the container with id 36482a593c56f711751e00d8437d0a5543aff1eeed45523b10ee7e9f4cc3aab1
Sep 08 16:28:59.642395 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.642333    2562 generic.go:356] "Generic (PLEG): container finished" podID="fce2c663-266d-4dfa-aa72-e955186ae717" containerID="712d2c83f842f9803de1354297d7028048514fdfe0364746af3fb002405d0822" exitCode=0
Sep 08 16:28:59.642515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.642418    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q" event={"ID":"fce2c663-266d-4dfa-aa72-e955186ae717","Type":"ContainerDied","Data":"712d2c83f842f9803de1354297d7028048514fdfe0364746af3fb002405d0822"}
Sep 08 16:28:59.642515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.642473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q" event={"ID":"fce2c663-266d-4dfa-aa72-e955186ae717","Type":"ContainerStarted","Data":"2adf42a17d5cb9a7db0440ef4e8a0c164b93981b842291901464f140f9a0b068"}
Sep 08 16:28:59.644061 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.644038    2562 generic.go:356] "Generic (PLEG): container finished" podID="13a7f736-e436-4fbb-8a7b-fa5a5781b939" containerID="77704d832f59a37d8e3eb72422b352965aeed29cf9776d69def879d2265ae4d3" exitCode=0
Sep 08 16:28:59.644154 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.644131    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4" event={"ID":"13a7f736-e436-4fbb-8a7b-fa5a5781b939","Type":"ContainerDied","Data":"77704d832f59a37d8e3eb72422b352965aeed29cf9776d69def879d2265ae4d3"}
Sep 08 16:28:59.644217 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.644178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4" event={"ID":"13a7f736-e436-4fbb-8a7b-fa5a5781b939","Type":"ContainerStarted","Data":"3a24a6ff821aa8ed7ec9088b50aed92c432f8db2b6cea4dcb93db222426d8710"}
Sep 08 16:28:59.645331 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.645308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g" event={"ID":"ae5d8784-79de-4846-a5cd-23134fcf20db","Type":"ContainerStarted","Data":"36482a593c56f711751e00d8437d0a5543aff1eeed45523b10ee7e9f4cc3aab1"}
Sep 08 16:28:59.689086 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:28:59.689064    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"]
Sep 08 16:28:59.691996 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:28:59.691972    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee5a1c8_7065_4df1_a80a_eeec9880eecc.slice/crio-f3dcd0c5bbec779dff7dd00233b46537b0073c83f367ca0a9791880ddc7a2579 WatchSource:0}: Error finding container f3dcd0c5bbec779dff7dd00233b46537b0073c83f367ca0a9791880ddc7a2579: Status 404 returned error can't find the container with id f3dcd0c5bbec779dff7dd00233b46537b0073c83f367ca0a9791880ddc7a2579
Sep 08 16:29:00.651987 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:00.651952    2562 generic.go:356] "Generic (PLEG): container finished" podID="4ee5a1c8-7065-4df1-a80a-eeec9880eecc" containerID="344c021a6a9f5eb3f310ba50e68fe7293bb2f2d1d2a9dd9a026a963ac43702e8" exitCode=0
Sep 08 16:29:00.652360 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:00.652033    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv" event={"ID":"4ee5a1c8-7065-4df1-a80a-eeec9880eecc","Type":"ContainerDied","Data":"344c021a6a9f5eb3f310ba50e68fe7293bb2f2d1d2a9dd9a026a963ac43702e8"}
Sep 08 16:29:00.652360 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:00.652083    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv" event={"ID":"4ee5a1c8-7065-4df1-a80a-eeec9880eecc","Type":"ContainerStarted","Data":"f3dcd0c5bbec779dff7dd00233b46537b0073c83f367ca0a9791880ddc7a2579"}
Sep 08 16:29:00.654001 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:00.653982    2562 generic.go:356] "Generic (PLEG): container finished" podID="13a7f736-e436-4fbb-8a7b-fa5a5781b939" containerID="6bc906bea33c59f175e528fb2296e71482e16d267809dc618f609f7c0a332e63" exitCode=0
Sep 08 16:29:00.654097 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:00.654068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4" event={"ID":"13a7f736-e436-4fbb-8a7b-fa5a5781b939","Type":"ContainerDied","Data":"6bc906bea33c59f175e528fb2296e71482e16d267809dc618f609f7c0a332e63"}
Sep 08 16:29:00.655947 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:00.655925    2562 generic.go:356] "Generic (PLEG): container finished" podID="ae5d8784-79de-4846-a5cd-23134fcf20db" containerID="e1b5d47c3615a47924b650913c22bbcc140322308c198554d3d25f1c9b470219" exitCode=0
Sep 08 16:29:00.656051 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:00.655956    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g" event={"ID":"ae5d8784-79de-4846-a5cd-23134fcf20db","Type":"ContainerDied","Data":"e1b5d47c3615a47924b650913c22bbcc140322308c198554d3d25f1c9b470219"}
Sep 08 16:29:00.657951 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:00.657933    2562 generic.go:356] "Generic (PLEG): container finished" podID="fce2c663-266d-4dfa-aa72-e955186ae717" containerID="9b449506c2ed60541b8075df3ef7484d975c3aaaa62c8491029c23733d3ef1bd" exitCode=0
Sep 08 16:29:00.658043 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:00.657959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q" event={"ID":"fce2c663-266d-4dfa-aa72-e955186ae717","Type":"ContainerDied","Data":"9b449506c2ed60541b8075df3ef7484d975c3aaaa62c8491029c23733d3ef1bd"}
Sep 08 16:29:01.664404 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:01.664314    2562 generic.go:356] "Generic (PLEG): container finished" podID="ae5d8784-79de-4846-a5cd-23134fcf20db" containerID="d4e2ff660357ed68368161d3eb4a43ac42dcf3259d4aeca52233688b5fbf49ce" exitCode=0
Sep 08 16:29:01.664404 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:01.664376    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g" event={"ID":"ae5d8784-79de-4846-a5cd-23134fcf20db","Type":"ContainerDied","Data":"d4e2ff660357ed68368161d3eb4a43ac42dcf3259d4aeca52233688b5fbf49ce"}
Sep 08 16:29:01.666677 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:01.666652    2562 generic.go:356] "Generic (PLEG): container finished" podID="fce2c663-266d-4dfa-aa72-e955186ae717" containerID="419655b58ff23c3428ceb951070d9b0e163504758bd8103b02f9c68462c7a809" exitCode=0
Sep 08 16:29:01.666789 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:01.666734    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q" event={"ID":"fce2c663-266d-4dfa-aa72-e955186ae717","Type":"ContainerDied","Data":"419655b58ff23c3428ceb951070d9b0e163504758bd8103b02f9c68462c7a809"}
Sep 08 16:29:01.668511 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:01.668491    2562 generic.go:356] "Generic (PLEG): container finished" podID="4ee5a1c8-7065-4df1-a80a-eeec9880eecc" containerID="d8d413cc8842029154f8199ce872895488a5851bb14ad7f304ba3557c0a88bf1" exitCode=0
Sep 08 16:29:01.668630 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:01.668567    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv" event={"ID":"4ee5a1c8-7065-4df1-a80a-eeec9880eecc","Type":"ContainerDied","Data":"d8d413cc8842029154f8199ce872895488a5851bb14ad7f304ba3557c0a88bf1"}
Sep 08 16:29:01.670934 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:01.670912    2562 generic.go:356] "Generic (PLEG): container finished" podID="13a7f736-e436-4fbb-8a7b-fa5a5781b939" containerID="353f42f3bdfcf9e04f481b446c0296401736fe63daa09aeb4e8d7f16ecfcd98c" exitCode=0
Sep 08 16:29:01.671009 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:01.670969    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4" event={"ID":"13a7f736-e436-4fbb-8a7b-fa5a5781b939","Type":"ContainerDied","Data":"353f42f3bdfcf9e04f481b446c0296401736fe63daa09aeb4e8d7f16ecfcd98c"}
Sep 08 16:29:01.883734 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:01.883701    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:01.982889 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:01.982858    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:02.677591 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.677559    2562 generic.go:356] "Generic (PLEG): container finished" podID="ae5d8784-79de-4846-a5cd-23134fcf20db" containerID="dcdd940c266a4019f29dc3f96bb1142359c98421542bc57bdac19a4382a1ce9f" exitCode=0
Sep 08 16:29:02.677999 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.677646    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g" event={"ID":"ae5d8784-79de-4846-a5cd-23134fcf20db","Type":"ContainerDied","Data":"dcdd940c266a4019f29dc3f96bb1142359c98421542bc57bdac19a4382a1ce9f"}
Sep 08 16:29:02.679737 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.679711    2562 generic.go:356] "Generic (PLEG): container finished" podID="4ee5a1c8-7065-4df1-a80a-eeec9880eecc" containerID="46c06318417623a356a1a3099b8ce2bf2c111247624d1e32a4768a4600124239" exitCode=0
Sep 08 16:29:02.679857 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.679794    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv" event={"ID":"4ee5a1c8-7065-4df1-a80a-eeec9880eecc","Type":"ContainerDied","Data":"46c06318417623a356a1a3099b8ce2bf2c111247624d1e32a4768a4600124239"}
Sep 08 16:29:02.830360 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.830336    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"
Sep 08 16:29:02.833504 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.833483    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"
Sep 08 16:29:02.913444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.913409    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fce2c663-266d-4dfa-aa72-e955186ae717-util\") pod \"fce2c663-266d-4dfa-aa72-e955186ae717\" (UID: \"fce2c663-266d-4dfa-aa72-e955186ae717\") "
Sep 08 16:29:02.913618 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.913467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fce2c663-266d-4dfa-aa72-e955186ae717-bundle\") pod \"fce2c663-266d-4dfa-aa72-e955186ae717\" (UID: \"fce2c663-266d-4dfa-aa72-e955186ae717\") "
Sep 08 16:29:02.913618 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.913509    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z9n8\" (UniqueName: \"kubernetes.io/projected/fce2c663-266d-4dfa-aa72-e955186ae717-kube-api-access-9z9n8\") pod \"fce2c663-266d-4dfa-aa72-e955186ae717\" (UID: \"fce2c663-266d-4dfa-aa72-e955186ae717\") "
Sep 08 16:29:02.913618 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.913561    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czx2m\" (UniqueName: \"kubernetes.io/projected/13a7f736-e436-4fbb-8a7b-fa5a5781b939-kube-api-access-czx2m\") pod \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\" (UID: \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\") "
Sep 08 16:29:02.913794 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.913659    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13a7f736-e436-4fbb-8a7b-fa5a5781b939-bundle\") pod \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\" (UID: \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\") "
Sep 08 16:29:02.913794 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.913694    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13a7f736-e436-4fbb-8a7b-fa5a5781b939-util\") pod \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\" (UID: \"13a7f736-e436-4fbb-8a7b-fa5a5781b939\") "
Sep 08 16:29:02.914129 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.914082    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce2c663-266d-4dfa-aa72-e955186ae717-bundle" (OuterVolumeSpecName: "bundle") pod "fce2c663-266d-4dfa-aa72-e955186ae717" (UID: "fce2c663-266d-4dfa-aa72-e955186ae717"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:29:02.916035 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.915984    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13a7f736-e436-4fbb-8a7b-fa5a5781b939-bundle" (OuterVolumeSpecName: "bundle") pod "13a7f736-e436-4fbb-8a7b-fa5a5781b939" (UID: "13a7f736-e436-4fbb-8a7b-fa5a5781b939"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:29:02.916035 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.916008    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce2c663-266d-4dfa-aa72-e955186ae717-kube-api-access-9z9n8" (OuterVolumeSpecName: "kube-api-access-9z9n8") pod "fce2c663-266d-4dfa-aa72-e955186ae717" (UID: "fce2c663-266d-4dfa-aa72-e955186ae717"). InnerVolumeSpecName "kube-api-access-9z9n8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:29:02.916277 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.916257    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13a7f736-e436-4fbb-8a7b-fa5a5781b939-kube-api-access-czx2m" (OuterVolumeSpecName: "kube-api-access-czx2m") pod "13a7f736-e436-4fbb-8a7b-fa5a5781b939" (UID: "13a7f736-e436-4fbb-8a7b-fa5a5781b939"). InnerVolumeSpecName "kube-api-access-czx2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:29:02.919722 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.919702    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce2c663-266d-4dfa-aa72-e955186ae717-util" (OuterVolumeSpecName: "util") pod "fce2c663-266d-4dfa-aa72-e955186ae717" (UID: "fce2c663-266d-4dfa-aa72-e955186ae717"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:29:02.922395 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:02.922368    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13a7f736-e436-4fbb-8a7b-fa5a5781b939-util" (OuterVolumeSpecName: "util") pod "13a7f736-e436-4fbb-8a7b-fa5a5781b939" (UID: "13a7f736-e436-4fbb-8a7b-fa5a5781b939"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:29:03.015223 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.015193    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13a7f736-e436-4fbb-8a7b-fa5a5781b939-bundle\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:03.015223 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.015220    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13a7f736-e436-4fbb-8a7b-fa5a5781b939-util\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:03.015223 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.015228    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fce2c663-266d-4dfa-aa72-e955186ae717-util\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:03.015430 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.015236    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fce2c663-266d-4dfa-aa72-e955186ae717-bundle\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:03.015430 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.015244    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z9n8\" (UniqueName: \"kubernetes.io/projected/fce2c663-266d-4dfa-aa72-e955186ae717-kube-api-access-9z9n8\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:03.015430 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.015252    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czx2m\" (UniqueName: \"kubernetes.io/projected/13a7f736-e436-4fbb-8a7b-fa5a5781b939-kube-api-access-czx2m\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:03.686137 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.686108    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4"
Sep 08 16:29:03.686552 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.686141    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xxbn4" event={"ID":"13a7f736-e436-4fbb-8a7b-fa5a5781b939","Type":"ContainerDied","Data":"3a24a6ff821aa8ed7ec9088b50aed92c432f8db2b6cea4dcb93db222426d8710"}
Sep 08 16:29:03.686552 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.686194    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a24a6ff821aa8ed7ec9088b50aed92c432f8db2b6cea4dcb93db222426d8710"
Sep 08 16:29:03.688095 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.688070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q" event={"ID":"fce2c663-266d-4dfa-aa72-e955186ae717","Type":"ContainerDied","Data":"2adf42a17d5cb9a7db0440ef4e8a0c164b93981b842291901464f140f9a0b068"}
Sep 08 16:29:03.688194 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.688098    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vcv4q"
Sep 08 16:29:03.688194 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.688109    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2adf42a17d5cb9a7db0440ef4e8a0c164b93981b842291901464f140f9a0b068"
Sep 08 16:29:03.822700 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.822591    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"
Sep 08 16:29:03.835838 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.835818    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"
Sep 08 16:29:03.923786 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.923756    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae5d8784-79de-4846-a5cd-23134fcf20db-bundle\") pod \"ae5d8784-79de-4846-a5cd-23134fcf20db\" (UID: \"ae5d8784-79de-4846-a5cd-23134fcf20db\") "
Sep 08 16:29:03.923786 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.923790    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-util\") pod \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\" (UID: \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\") "
Sep 08 16:29:03.923974 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.923816    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2n7t\" (UniqueName: \"kubernetes.io/projected/ae5d8784-79de-4846-a5cd-23134fcf20db-kube-api-access-f2n7t\") pod \"ae5d8784-79de-4846-a5cd-23134fcf20db\" (UID: \"ae5d8784-79de-4846-a5cd-23134fcf20db\") "
Sep 08 16:29:03.923974 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.923873    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae5d8784-79de-4846-a5cd-23134fcf20db-util\") pod \"ae5d8784-79de-4846-a5cd-23134fcf20db\" (UID: \"ae5d8784-79de-4846-a5cd-23134fcf20db\") "
Sep 08 16:29:03.923974 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.923898    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-bundle\") pod \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\" (UID: \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\") "
Sep 08 16:29:03.923974 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.923927    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clv29\" (UniqueName: \"kubernetes.io/projected/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-kube-api-access-clv29\") pod \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\" (UID: \"4ee5a1c8-7065-4df1-a80a-eeec9880eecc\") "
Sep 08 16:29:03.924469 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.924433    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5d8784-79de-4846-a5cd-23134fcf20db-bundle" (OuterVolumeSpecName: "bundle") pod "ae5d8784-79de-4846-a5cd-23134fcf20db" (UID: "ae5d8784-79de-4846-a5cd-23134fcf20db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:29:03.924685 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.924658    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-bundle" (OuterVolumeSpecName: "bundle") pod "4ee5a1c8-7065-4df1-a80a-eeec9880eecc" (UID: "4ee5a1c8-7065-4df1-a80a-eeec9880eecc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:29:03.926150 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.926120    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae5d8784-79de-4846-a5cd-23134fcf20db-kube-api-access-f2n7t" (OuterVolumeSpecName: "kube-api-access-f2n7t") pod "ae5d8784-79de-4846-a5cd-23134fcf20db" (UID: "ae5d8784-79de-4846-a5cd-23134fcf20db"). InnerVolumeSpecName "kube-api-access-f2n7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:29:03.926222 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.926143    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-kube-api-access-clv29" (OuterVolumeSpecName: "kube-api-access-clv29") pod "4ee5a1c8-7065-4df1-a80a-eeec9880eecc" (UID: "4ee5a1c8-7065-4df1-a80a-eeec9880eecc"). InnerVolumeSpecName "kube-api-access-clv29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:29:03.932850 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.932812    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-util" (OuterVolumeSpecName: "util") pod "4ee5a1c8-7065-4df1-a80a-eeec9880eecc" (UID: "4ee5a1c8-7065-4df1-a80a-eeec9880eecc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:29:03.932980 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:03.932965    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5d8784-79de-4846-a5cd-23134fcf20db-util" (OuterVolumeSpecName: "util") pod "ae5d8784-79de-4846-a5cd-23134fcf20db" (UID: "ae5d8784-79de-4846-a5cd-23134fcf20db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:29:04.025008 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:04.024989    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clv29\" (UniqueName: \"kubernetes.io/projected/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-kube-api-access-clv29\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:04.025008 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:04.025008    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae5d8784-79de-4846-a5cd-23134fcf20db-bundle\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:04.025120 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:04.025017    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-util\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:04.025120 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:04.025025    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2n7t\" (UniqueName: \"kubernetes.io/projected/ae5d8784-79de-4846-a5cd-23134fcf20db-kube-api-access-f2n7t\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:04.025120 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:04.025033    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae5d8784-79de-4846-a5cd-23134fcf20db-util\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:04.025120 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:04.025041    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee5a1c8-7065-4df1-a80a-eeec9880eecc-bundle\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:04.694554 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:04.694528    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g"
Sep 08 16:29:04.695018 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:04.694564    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjxc9g" event={"ID":"ae5d8784-79de-4846-a5cd-23134fcf20db","Type":"ContainerDied","Data":"36482a593c56f711751e00d8437d0a5543aff1eeed45523b10ee7e9f4cc3aab1"}
Sep 08 16:29:04.695018 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:04.694625    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36482a593c56f711751e00d8437d0a5543aff1eeed45523b10ee7e9f4cc3aab1"
Sep 08 16:29:04.696675 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:04.696649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv" event={"ID":"4ee5a1c8-7065-4df1-a80a-eeec9880eecc","Type":"ContainerDied","Data":"f3dcd0c5bbec779dff7dd00233b46537b0073c83f367ca0a9791880ddc7a2579"}
Sep 08 16:29:04.696800 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:04.696693    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3dcd0c5bbec779dff7dd00233b46537b0073c83f367ca0a9791880ddc7a2579"
Sep 08 16:29:04.696800 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:04.696750    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avwxpv"
Sep 08 16:29:06.532641 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.532591    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fd4d5b5ff-vbhbd"]
Sep 08 16:29:06.532979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.532905    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5d8784-79de-4846-a5cd-23134fcf20db" containerName="util"
Sep 08 16:29:06.532979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.532917    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5d8784-79de-4846-a5cd-23134fcf20db" containerName="util"
Sep 08 16:29:06.532979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.532925    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee5a1c8-7065-4df1-a80a-eeec9880eecc" containerName="pull"
Sep 08 16:29:06.532979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.532931    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee5a1c8-7065-4df1-a80a-eeec9880eecc" containerName="pull"
Sep 08 16:29:06.532979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.532942    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a7f736-e436-4fbb-8a7b-fa5a5781b939" containerName="extract"
Sep 08 16:29:06.532979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.532947    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a7f736-e436-4fbb-8a7b-fa5a5781b939" containerName="extract"
Sep 08 16:29:06.532979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.532953    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a7f736-e436-4fbb-8a7b-fa5a5781b939" containerName="pull"
Sep 08 16:29:06.532979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.532961    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a7f736-e436-4fbb-8a7b-fa5a5781b939" containerName="pull"
Sep 08 16:29:06.532979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.532972    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce2c663-266d-4dfa-aa72-e955186ae717" containerName="extract"
Sep 08 16:29:06.532979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.532977    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce2c663-266d-4dfa-aa72-e955186ae717" containerName="extract"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.532989    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5d8784-79de-4846-a5cd-23134fcf20db" containerName="pull"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.532994    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5d8784-79de-4846-a5cd-23134fcf20db" containerName="pull"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533001    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce2c663-266d-4dfa-aa72-e955186ae717" containerName="util"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533006    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce2c663-266d-4dfa-aa72-e955186ae717" containerName="util"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533015    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a7f736-e436-4fbb-8a7b-fa5a5781b939" containerName="util"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533020    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a7f736-e436-4fbb-8a7b-fa5a5781b939" containerName="util"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533026    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee5a1c8-7065-4df1-a80a-eeec9880eecc" containerName="util"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533030    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee5a1c8-7065-4df1-a80a-eeec9880eecc" containerName="util"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533038    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce2c663-266d-4dfa-aa72-e955186ae717" containerName="pull"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533046    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce2c663-266d-4dfa-aa72-e955186ae717" containerName="pull"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533053    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5d8784-79de-4846-a5cd-23134fcf20db" containerName="extract"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533058    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5d8784-79de-4846-a5cd-23134fcf20db" containerName="extract"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533062    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee5a1c8-7065-4df1-a80a-eeec9880eecc" containerName="extract"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533067    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee5a1c8-7065-4df1-a80a-eeec9880eecc" containerName="extract"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533116    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fce2c663-266d-4dfa-aa72-e955186ae717" containerName="extract"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533127    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a7f736-e436-4fbb-8a7b-fa5a5781b939" containerName="extract"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533134    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5d8784-79de-4846-a5cd-23134fcf20db" containerName="extract"
Sep 08 16:29:06.533289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.533141    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee5a1c8-7065-4df1-a80a-eeec9880eecc" containerName="extract"
Sep 08 16:29:06.537237 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.537219    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.566438 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.566413    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd4d5b5ff-vbhbd"]
Sep 08 16:29:06.638200 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.638172    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:06.643083 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.643057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2888e97a-7209-4449-9af7-3bb12c20fe61-console-config\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.643186 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.643093    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2888e97a-7209-4449-9af7-3bb12c20fe61-service-ca\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.643186 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.643130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2888e97a-7209-4449-9af7-3bb12c20fe61-console-oauth-config\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.643186 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.643151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2888e97a-7209-4449-9af7-3bb12c20fe61-console-serving-cert\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.643186 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.643171    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2888e97a-7209-4449-9af7-3bb12c20fe61-trusted-ca-bundle\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.643328 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.643245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck9tn\" (UniqueName: \"kubernetes.io/projected/2888e97a-7209-4449-9af7-3bb12c20fe61-kube-api-access-ck9tn\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.643328 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.643281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2888e97a-7209-4449-9af7-3bb12c20fe61-oauth-serving-cert\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.744079 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.744049    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2888e97a-7209-4449-9af7-3bb12c20fe61-oauth-serving-cert\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.744079 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.744084    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2888e97a-7209-4449-9af7-3bb12c20fe61-console-config\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.744261 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.744104    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2888e97a-7209-4449-9af7-3bb12c20fe61-service-ca\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.744261 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.744151    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2888e97a-7209-4449-9af7-3bb12c20fe61-console-oauth-config\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.744261 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.744181    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2888e97a-7209-4449-9af7-3bb12c20fe61-console-serving-cert\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.744261 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.744206    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2888e97a-7209-4449-9af7-3bb12c20fe61-trusted-ca-bundle\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.744444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.744276    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck9tn\" (UniqueName: \"kubernetes.io/projected/2888e97a-7209-4449-9af7-3bb12c20fe61-kube-api-access-ck9tn\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.744897 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.744873    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2888e97a-7209-4449-9af7-3bb12c20fe61-oauth-serving-cert\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.745013 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.744975    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2888e97a-7209-4449-9af7-3bb12c20fe61-console-config\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.745068 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.744975    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2888e97a-7209-4449-9af7-3bb12c20fe61-service-ca\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.745232 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.745205    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2888e97a-7209-4449-9af7-3bb12c20fe61-trusted-ca-bundle\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.746718 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.746698    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2888e97a-7209-4449-9af7-3bb12c20fe61-console-serving-cert\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.746802 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.746718    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2888e97a-7209-4449-9af7-3bb12c20fe61-console-oauth-config\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.759198 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.759172    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck9tn\" (UniqueName: \"kubernetes.io/projected/2888e97a-7209-4449-9af7-3bb12c20fe61-kube-api-access-ck9tn\") pod \"console-7fd4d5b5ff-vbhbd\" (UID: \"2888e97a-7209-4449-9af7-3bb12c20fe61\") " pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:06.771319 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.771290    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:06.845512 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:06.845437    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:07.129044 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:07.129020    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd4d5b5ff-vbhbd"]
Sep 08 16:29:07.131039 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:29:07.131013    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2888e97a_7209_4449_9af7_3bb12c20fe61.slice/crio-7f7fb92dca1437fe7d4b5c48e126729746f622510834bb50bf6086d70e9b7256 WatchSource:0}: Error finding container 7f7fb92dca1437fe7d4b5c48e126729746f622510834bb50bf6086d70e9b7256: Status 404 returned error can't find the container with id 7f7fb92dca1437fe7d4b5c48e126729746f622510834bb50bf6086d70e9b7256
Sep 08 16:29:07.713065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:07.713034    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd4d5b5ff-vbhbd" event={"ID":"2888e97a-7209-4449-9af7-3bb12c20fe61","Type":"ContainerStarted","Data":"7b6ff599f06086cbe3b49604a6f14c4c58c32d427024f01758109f28a623f603"}
Sep 08 16:29:07.713416 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:07.713080    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd4d5b5ff-vbhbd" event={"ID":"2888e97a-7209-4449-9af7-3bb12c20fe61","Type":"ContainerStarted","Data":"7f7fb92dca1437fe7d4b5c48e126729746f622510834bb50bf6086d70e9b7256"}
Sep 08 16:29:09.754347 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:09.754298    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:12.301312 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:12.301260    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fd4d5b5ff-vbhbd" podStartSLOduration=6.301244457 podStartE2EDuration="6.301244457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:29:07.751494906 +0000 UTC m=+390.336056524" watchObservedRunningTime="2026-09-08 16:29:12.301244457 +0000 UTC m=+394.885806076"
Sep 08 16:29:12.302202 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:12.302183    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"]
Sep 08 16:29:12.305381 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:12.305367    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"
Sep 08 16:29:12.308260 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:12.308236    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 16:29:12.309347 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:12.309331    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5trc5\""
Sep 08 16:29:12.314030 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:12.314008    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 16:29:12.494469 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:12.494433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbg6l\" (UniqueName: \"kubernetes.io/projected/6e3ea7b3-dc0e-46a9-9b33-42db24d31763-kube-api-access-kbg6l\") pod \"limitador-operator-controller-manager-74495c69f8-9sx9l\" (UID: \"6e3ea7b3-dc0e-46a9-9b33-42db24d31763\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"
Sep 08 16:29:12.555450 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:12.555365    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"]
Sep 08 16:29:12.595201 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:12.595167    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbg6l\" (UniqueName: \"kubernetes.io/projected/6e3ea7b3-dc0e-46a9-9b33-42db24d31763-kube-api-access-kbg6l\") pod \"limitador-operator-controller-manager-74495c69f8-9sx9l\" (UID: \"6e3ea7b3-dc0e-46a9-9b33-42db24d31763\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"
Sep 08 16:29:12.616209 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:12.616177    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbg6l\" (UniqueName: \"kubernetes.io/projected/6e3ea7b3-dc0e-46a9-9b33-42db24d31763-kube-api-access-kbg6l\") pod \"limitador-operator-controller-manager-74495c69f8-9sx9l\" (UID: \"6e3ea7b3-dc0e-46a9-9b33-42db24d31763\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"
Sep 08 16:29:12.668859 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:12.668821    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:12.916049 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:12.915957    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"
Sep 08 16:29:13.228467 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:29:13.228440    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3ea7b3_dc0e_46a9_9b33_42db24d31763.slice/crio-6d313715e77a17a061a2e1ed8df5463a88cd478cae99dd8e0c37bf4896c6510e WatchSource:0}: Error finding container 6d313715e77a17a061a2e1ed8df5463a88cd478cae99dd8e0c37bf4896c6510e: Status 404 returned error can't find the container with id 6d313715e77a17a061a2e1ed8df5463a88cd478cae99dd8e0c37bf4896c6510e
Sep 08 16:29:13.232501 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:13.232475    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"]
Sep 08 16:29:13.742936 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:13.742901    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l" event={"ID":"6e3ea7b3-dc0e-46a9-9b33-42db24d31763","Type":"ContainerStarted","Data":"6d313715e77a17a061a2e1ed8df5463a88cd478cae99dd8e0c37bf4896c6510e"}
Sep 08 16:29:14.180644 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:14.180532    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:15.105663 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:15.105628    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:15.449312 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:15.449281    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:15.617057 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:15.617019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:16.118088 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:16.118056    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:16.417802 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:16.417722    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:16.608331 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:16.608300    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:16.761134 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:16.761103    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l" event={"ID":"6e3ea7b3-dc0e-46a9-9b33-42db24d31763","Type":"ContainerStarted","Data":"0553f6840d82f94290e01275890f505c40bbd7e2308dac4c12cf8e20f415bab4"}
Sep 08 16:29:16.761269 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:16.761162    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"
Sep 08 16:29:16.804141 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:16.804099    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l" podStartSLOduration=2.063466138 podStartE2EDuration="4.80408471s" totalImagesPullingTime="2.740618572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:29:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:29:16.80398621 +0000 UTC m=+399.388547828" watchObservedRunningTime="2026-09-08 16:29:16.80408471 +0000 UTC m=+399.388646364"
Sep 08 16:29:16.846311 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:16.846284    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:16.846458 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:16.846366    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:16.851431 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:16.851411    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:17.770072 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:17.770047    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fd4d5b5ff-vbhbd"
Sep 08 16:29:17.903624 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:17.903582    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-669ffdd9b8-vnktg"]
Sep 08 16:29:18.249181 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:18.249150    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:18.378073 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:18.378043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:19.703602 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:19.703564    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:19.876061 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:19.876022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:20.236967 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:20.236934    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:20.443564 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:20.443526    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:23.431306 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:23.431246    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:23.529672 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:23.529604    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:27.528127 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.528096    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"]
Sep 08 16:29:27.531496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.531480    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"
Sep 08 16:29:27.538773 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.538754    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k28s9\""
Sep 08 16:29:27.538866 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.538856    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 08 16:29:27.538924 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.538910    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 08 16:29:27.541922 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.541893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:27.546920 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.546900    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"]
Sep 08 16:29:27.620773 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.620735    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2f005c9-fd38-4c15-a432-7d464d0a9b12-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6whl8\" (UID: \"d2f005c9-fd38-4c15-a432-7d464d0a9b12\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"
Sep 08 16:29:27.620928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.620783    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2f005c9-fd38-4c15-a432-7d464d0a9b12-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6whl8\" (UID: \"d2f005c9-fd38-4c15-a432-7d464d0a9b12\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"
Sep 08 16:29:27.620928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.620858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmzzz\" (UniqueName: \"kubernetes.io/projected/d2f005c9-fd38-4c15-a432-7d464d0a9b12-kube-api-access-lmzzz\") pod \"kuadrant-console-plugin-fbdd4f445-6whl8\" (UID: \"d2f005c9-fd38-4c15-a432-7d464d0a9b12\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"
Sep 08 16:29:27.702260 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.702228    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:27.721921 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.721892    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2f005c9-fd38-4c15-a432-7d464d0a9b12-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6whl8\" (UID: \"d2f005c9-fd38-4c15-a432-7d464d0a9b12\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"
Sep 08 16:29:27.722053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.721933    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2f005c9-fd38-4c15-a432-7d464d0a9b12-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6whl8\" (UID: \"d2f005c9-fd38-4c15-a432-7d464d0a9b12\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"
Sep 08 16:29:27.722053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.721985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmzzz\" (UniqueName: \"kubernetes.io/projected/d2f005c9-fd38-4c15-a432-7d464d0a9b12-kube-api-access-lmzzz\") pod \"kuadrant-console-plugin-fbdd4f445-6whl8\" (UID: \"d2f005c9-fd38-4c15-a432-7d464d0a9b12\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"
Sep 08 16:29:27.722053 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:29:27.722026    2562 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 08 16:29:27.722210 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:29:27.722097    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f005c9-fd38-4c15-a432-7d464d0a9b12-plugin-serving-cert podName:d2f005c9-fd38-4c15-a432-7d464d0a9b12 nodeName:}" failed. No retries permitted until 2026-09-08 16:29:28.222078197 +0000 UTC m=+410.806639807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/d2f005c9-fd38-4c15-a432-7d464d0a9b12-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-6whl8" (UID: "d2f005c9-fd38-4c15-a432-7d464d0a9b12") : secret "plugin-serving-cert" not found
Sep 08 16:29:27.722744 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.722723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2f005c9-fd38-4c15-a432-7d464d0a9b12-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6whl8\" (UID: \"d2f005c9-fd38-4c15-a432-7d464d0a9b12\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"
Sep 08 16:29:27.757252 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.757228    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmzzz\" (UniqueName: \"kubernetes.io/projected/d2f005c9-fd38-4c15-a432-7d464d0a9b12-kube-api-access-lmzzz\") pod \"kuadrant-console-plugin-fbdd4f445-6whl8\" (UID: \"d2f005c9-fd38-4c15-a432-7d464d0a9b12\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"
Sep 08 16:29:27.768967 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.768937    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"
Sep 08 16:29:27.854022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:27.853941    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:28.064627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:28.064571    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:28.225895 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:28.225866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2f005c9-fd38-4c15-a432-7d464d0a9b12-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6whl8\" (UID: \"d2f005c9-fd38-4c15-a432-7d464d0a9b12\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"
Sep 08 16:29:28.228144 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:28.228123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2f005c9-fd38-4c15-a432-7d464d0a9b12-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6whl8\" (UID: \"d2f005c9-fd38-4c15-a432-7d464d0a9b12\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"
Sep 08 16:29:28.439937 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:28.439905    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"
Sep 08 16:29:28.735707 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:28.735656    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8"]
Sep 08 16:29:28.736996 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:29:28.736970    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2f005c9_fd38_4c15_a432_7d464d0a9b12.slice/crio-45c4362fac72feafdfbfe13ce9141392811a99ebcdb343e57ef33ad99b115b4b WatchSource:0}: Error finding container 45c4362fac72feafdfbfe13ce9141392811a99ebcdb343e57ef33ad99b115b4b: Status 404 returned error can't find the container with id 45c4362fac72feafdfbfe13ce9141392811a99ebcdb343e57ef33ad99b115b4b
Sep 08 16:29:28.820423 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:28.820390    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8" event={"ID":"d2f005c9-fd38-4c15-a432-7d464d0a9b12","Type":"ContainerStarted","Data":"45c4362fac72feafdfbfe13ce9141392811a99ebcdb343e57ef33ad99b115b4b"}
Sep 08 16:29:33.810087 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:33.810045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:33.850125 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:33.850099    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8" event={"ID":"d2f005c9-fd38-4c15-a432-7d464d0a9b12","Type":"ContainerStarted","Data":"afbf1f44c2b1f85f7033bfb34e826da3c2dda6c94a990dd6e2b04606e6d863eb"}
Sep 08 16:29:33.873249 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:33.868300    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6whl8" podStartSLOduration=1.903460698 podStartE2EDuration="6.868281148s" totalImagesPullingTime="4.96482045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:29:33.868146818 +0000 UTC m=+416.452708437" watchObservedRunningTime="2026-09-08 16:29:33.868281148 +0000 UTC m=+416.452842767"
Sep 08 16:29:33.882667 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:33.882636    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:34.005226 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:34.005141    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:34.173748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:34.173716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:34.319012 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:34.318928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:34.417425 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:34.417388    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:39.057717 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.057682    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"]
Sep 08 16:29:39.058225 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.057908    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l" podUID="6e3ea7b3-dc0e-46a9-9b33-42db24d31763" containerName="manager" containerID="cri-o://0553f6840d82f94290e01275890f505c40bbd7e2308dac4c12cf8e20f415bab4" gracePeriod=2
Sep 08 16:29:39.074504 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.074476    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"]
Sep 08 16:29:39.110946 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.110918    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jdxfs"]
Sep 08 16:29:39.111232 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.111221    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e3ea7b3-dc0e-46a9-9b33-42db24d31763" containerName="manager"
Sep 08 16:29:39.111276 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.111234    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e3ea7b3-dc0e-46a9-9b33-42db24d31763" containerName="manager"
Sep 08 16:29:39.111312 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.111301    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e3ea7b3-dc0e-46a9-9b33-42db24d31763" containerName="manager"
Sep 08 16:29:39.118401 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.118379    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jdxfs"
Sep 08 16:29:39.139084 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.139053    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jdxfs"]
Sep 08 16:29:39.165834 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:29:39.165798    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9sx9l\" is forbidden: User \"system:node:ip-10-0-139-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-55.ec2.internal' and this object" podUID="6e3ea7b3-dc0e-46a9-9b33-42db24d31763" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"
Sep 08 16:29:39.219878 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.219845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-972n4\" (UniqueName: \"kubernetes.io/projected/49be2251-9462-4023-86f7-c2589169a265-kube-api-access-972n4\") pod \"limitador-operator-controller-manager-74495c69f8-jdxfs\" (UID: \"49be2251-9462-4023-86f7-c2589169a265\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jdxfs"
Sep 08 16:29:39.300783 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.300762    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"
Sep 08 16:29:39.302974 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:29:39.302953    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9sx9l\" is forbidden: User \"system:node:ip-10-0-139-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-55.ec2.internal' and this object" podUID="6e3ea7b3-dc0e-46a9-9b33-42db24d31763" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"
Sep 08 16:29:39.320375 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.320325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-972n4\" (UniqueName: \"kubernetes.io/projected/49be2251-9462-4023-86f7-c2589169a265-kube-api-access-972n4\") pod \"limitador-operator-controller-manager-74495c69f8-jdxfs\" (UID: \"49be2251-9462-4023-86f7-c2589169a265\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jdxfs"
Sep 08 16:29:39.331482 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.331458    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-972n4\" (UniqueName: \"kubernetes.io/projected/49be2251-9462-4023-86f7-c2589169a265-kube-api-access-972n4\") pod \"limitador-operator-controller-manager-74495c69f8-jdxfs\" (UID: \"49be2251-9462-4023-86f7-c2589169a265\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jdxfs"
Sep 08 16:29:39.421365 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.421339    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbg6l\" (UniqueName: \"kubernetes.io/projected/6e3ea7b3-dc0e-46a9-9b33-42db24d31763-kube-api-access-kbg6l\") pod \"6e3ea7b3-dc0e-46a9-9b33-42db24d31763\" (UID: \"6e3ea7b3-dc0e-46a9-9b33-42db24d31763\") "
Sep 08 16:29:39.423314 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.423288    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e3ea7b3-dc0e-46a9-9b33-42db24d31763-kube-api-access-kbg6l" (OuterVolumeSpecName: "kube-api-access-kbg6l") pod "6e3ea7b3-dc0e-46a9-9b33-42db24d31763" (UID: "6e3ea7b3-dc0e-46a9-9b33-42db24d31763"). InnerVolumeSpecName "kube-api-access-kbg6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:29:39.442199 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.442170    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jdxfs"
Sep 08 16:29:39.522161 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.522122    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbg6l\" (UniqueName: \"kubernetes.io/projected/6e3ea7b3-dc0e-46a9-9b33-42db24d31763-kube-api-access-kbg6l\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:39.761212 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.761181    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jdxfs"]
Sep 08 16:29:39.775464 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:29:39.775435    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49be2251_9462_4023_86f7_c2589169a265.slice/crio-f280ddcc1292d02fa5d17f8a49cbe51bd589ac1cd21b9412ce9e11cfd8d18370 WatchSource:0}: Error finding container f280ddcc1292d02fa5d17f8a49cbe51bd589ac1cd21b9412ce9e11cfd8d18370: Status 404 returned error can't find the container with id f280ddcc1292d02fa5d17f8a49cbe51bd589ac1cd21b9412ce9e11cfd8d18370
Sep 08 16:29:39.880552 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.880492    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jdxfs" event={"ID":"49be2251-9462-4023-86f7-c2589169a265","Type":"ContainerStarted","Data":"4a0438ae0955d38a9a30a6ee2aa1e076772da10fe89462899b8a32d756c00831"}
Sep 08 16:29:39.880745 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.880575    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jdxfs" event={"ID":"49be2251-9462-4023-86f7-c2589169a265","Type":"ContainerStarted","Data":"f280ddcc1292d02fa5d17f8a49cbe51bd589ac1cd21b9412ce9e11cfd8d18370"}
Sep 08 16:29:39.880745 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.880619    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jdxfs"
Sep 08 16:29:39.881826 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.881804    2562 generic.go:356] "Generic (PLEG): container finished" podID="6e3ea7b3-dc0e-46a9-9b33-42db24d31763" containerID="0553f6840d82f94290e01275890f505c40bbd7e2308dac4c12cf8e20f415bab4" exitCode=0
Sep 08 16:29:39.881899 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.881837    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"
Sep 08 16:29:39.881899 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.881862    2562 scope.go:117] "RemoveContainer" containerID="0553f6840d82f94290e01275890f505c40bbd7e2308dac4c12cf8e20f415bab4"
Sep 08 16:29:39.892106 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.892086    2562 scope.go:117] "RemoveContainer" containerID="0553f6840d82f94290e01275890f505c40bbd7e2308dac4c12cf8e20f415bab4"
Sep 08 16:29:39.892381 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:29:39.892361    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0553f6840d82f94290e01275890f505c40bbd7e2308dac4c12cf8e20f415bab4\": container with ID starting with 0553f6840d82f94290e01275890f505c40bbd7e2308dac4c12cf8e20f415bab4 not found: ID does not exist" containerID="0553f6840d82f94290e01275890f505c40bbd7e2308dac4c12cf8e20f415bab4"
Sep 08 16:29:39.892438 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.892389    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0553f6840d82f94290e01275890f505c40bbd7e2308dac4c12cf8e20f415bab4"} err="failed to get container status \"0553f6840d82f94290e01275890f505c40bbd7e2308dac4c12cf8e20f415bab4\": rpc error: code = NotFound desc = could not find container \"0553f6840d82f94290e01275890f505c40bbd7e2308dac4c12cf8e20f415bab4\": container with ID starting with 0553f6840d82f94290e01275890f505c40bbd7e2308dac4c12cf8e20f415bab4 not found: ID does not exist"
Sep 08 16:29:39.927517 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:39.927473    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jdxfs" podStartSLOduration=0.927457423 podStartE2EDuration="927.457423ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:29:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:29:39.925469411 +0000 UTC m=+422.510031033" watchObservedRunningTime="2026-09-08 16:29:39.927457423 +0000 UTC m=+422.512019043"
Sep 08 16:29:39.927847 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:29:39.927815    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9sx9l\" is forbidden: User \"system:node:ip-10-0-139-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-55.ec2.internal' and this object" podUID="6e3ea7b3-dc0e-46a9-9b33-42db24d31763" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"
Sep 08 16:29:39.939138 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:29:39.939111    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9sx9l\" is forbidden: User \"system:node:ip-10-0-139-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-55.ec2.internal' and this object" podUID="6e3ea7b3-dc0e-46a9-9b33-42db24d31763" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9sx9l"
Sep 08 16:29:40.004994 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:40.004970    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e3ea7b3-dc0e-46a9-9b33-42db24d31763" path="/var/lib/kubelet/pods/6e3ea7b3-dc0e-46a9-9b33-42db24d31763/volumes"
Sep 08 16:29:42.017899 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:42.017864    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:42.111711 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:42.111686    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:42.924045 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:42.924006    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-669ffdd9b8-vnktg" podUID="0833f4ce-99d0-4f86-8161-6a3a6bec29dd" containerName="console" containerID="cri-o://e40d85578985d374ea8efae4a3e825b734a0e888a0a846ed74983c915896ca3f" gracePeriod=15
Sep 08 16:29:43.156390 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.156365    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:29:43.251817 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.251789    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42rnv\" (UniqueName: \"kubernetes.io/projected/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-kube-api-access-42rnv\") pod \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") "
Sep 08 16:29:43.251960 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.251832    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-oauth-serving-cert\") pod \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") "
Sep 08 16:29:43.251960 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.251855    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-config\") pod \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") "
Sep 08 16:29:43.251960 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.251885    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-service-ca\") pod \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") "
Sep 08 16:29:43.252132 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.252044    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-oauth-config\") pod \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") "
Sep 08 16:29:43.252132 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.252096    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-serving-cert\") pod \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") "
Sep 08 16:29:43.252277 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.252243    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-service-ca" (OuterVolumeSpecName: "service-ca") pod "0833f4ce-99d0-4f86-8161-6a3a6bec29dd" (UID: "0833f4ce-99d0-4f86-8161-6a3a6bec29dd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:29:43.252335 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.252265    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-config" (OuterVolumeSpecName: "console-config") pod "0833f4ce-99d0-4f86-8161-6a3a6bec29dd" (UID: "0833f4ce-99d0-4f86-8161-6a3a6bec29dd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:29:43.252335 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.252309    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-trusted-ca-bundle\") pod \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\" (UID: \"0833f4ce-99d0-4f86-8161-6a3a6bec29dd\") "
Sep 08 16:29:43.252435 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.252360    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0833f4ce-99d0-4f86-8161-6a3a6bec29dd" (UID: "0833f4ce-99d0-4f86-8161-6a3a6bec29dd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:29:43.252559 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.252543    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-oauth-serving-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:43.252634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.252562    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-config\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:43.252634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.252571    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:43.252767 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.252742    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0833f4ce-99d0-4f86-8161-6a3a6bec29dd" (UID: "0833f4ce-99d0-4f86-8161-6a3a6bec29dd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:29:43.254033 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.254010    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-kube-api-access-42rnv" (OuterVolumeSpecName: "kube-api-access-42rnv") pod "0833f4ce-99d0-4f86-8161-6a3a6bec29dd" (UID: "0833f4ce-99d0-4f86-8161-6a3a6bec29dd"). InnerVolumeSpecName "kube-api-access-42rnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:29:43.254148 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.254105    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0833f4ce-99d0-4f86-8161-6a3a6bec29dd" (UID: "0833f4ce-99d0-4f86-8161-6a3a6bec29dd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:29:43.254148 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.254130    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0833f4ce-99d0-4f86-8161-6a3a6bec29dd" (UID: "0833f4ce-99d0-4f86-8161-6a3a6bec29dd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:29:43.354105 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.354075    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-oauth-config\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:43.354105 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.354101    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-console-serving-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:43.354272 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.354117    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-trusted-ca-bundle\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:43.354272 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.354136    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42rnv\" (UniqueName: \"kubernetes.io/projected/0833f4ce-99d0-4f86-8161-6a3a6bec29dd-kube-api-access-42rnv\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:29:43.903330 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.903293    2562 generic.go:356] "Generic (PLEG): container finished" podID="0833f4ce-99d0-4f86-8161-6a3a6bec29dd" containerID="e40d85578985d374ea8efae4a3e825b734a0e888a0a846ed74983c915896ca3f" exitCode=0
Sep 08 16:29:43.903495 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.903341    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669ffdd9b8-vnktg" event={"ID":"0833f4ce-99d0-4f86-8161-6a3a6bec29dd","Type":"ContainerDied","Data":"e40d85578985d374ea8efae4a3e825b734a0e888a0a846ed74983c915896ca3f"}
Sep 08 16:29:43.903495 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.903347    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669ffdd9b8-vnktg"
Sep 08 16:29:43.903495 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.903403    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669ffdd9b8-vnktg" event={"ID":"0833f4ce-99d0-4f86-8161-6a3a6bec29dd","Type":"ContainerDied","Data":"48db6a6045ae5ad4866e2f7650e29ed977c44b4134931f620dc68d913243dec8"}
Sep 08 16:29:43.903495 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.903424    2562 scope.go:117] "RemoveContainer" containerID="e40d85578985d374ea8efae4a3e825b734a0e888a0a846ed74983c915896ca3f"
Sep 08 16:29:43.912812 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.912792    2562 scope.go:117] "RemoveContainer" containerID="e40d85578985d374ea8efae4a3e825b734a0e888a0a846ed74983c915896ca3f"
Sep 08 16:29:43.913069 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:29:43.913049    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e40d85578985d374ea8efae4a3e825b734a0e888a0a846ed74983c915896ca3f\": container with ID starting with e40d85578985d374ea8efae4a3e825b734a0e888a0a846ed74983c915896ca3f not found: ID does not exist" containerID="e40d85578985d374ea8efae4a3e825b734a0e888a0a846ed74983c915896ca3f"
Sep 08 16:29:43.913127 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.913077    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e40d85578985d374ea8efae4a3e825b734a0e888a0a846ed74983c915896ca3f"} err="failed to get container status \"e40d85578985d374ea8efae4a3e825b734a0e888a0a846ed74983c915896ca3f\": rpc error: code = NotFound desc = could not find container \"e40d85578985d374ea8efae4a3e825b734a0e888a0a846ed74983c915896ca3f\": container with ID starting with e40d85578985d374ea8efae4a3e825b734a0e888a0a846ed74983c915896ca3f not found: ID does not exist"
Sep 08 16:29:43.929874 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.929843    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-669ffdd9b8-vnktg"]
Sep 08 16:29:43.942642 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:43.942600    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-669ffdd9b8-vnktg"]
Sep 08 16:29:44.005259 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:44.005232    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0833f4ce-99d0-4f86-8161-6a3a6bec29dd" path="/var/lib/kubelet/pods/0833f4ce-99d0-4f86-8161-6a3a6bec29dd/volumes"
Sep 08 16:29:44.869457 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:44.869426    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:44.972174 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:44.972143    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:47.405599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:47.405559    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:47.763582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:47.763545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:50.771599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:50.771561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:50.839739 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:50.839711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:50.890741 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:50.890719    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jdxfs"
Sep 08 16:29:52.307061 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:52.307027    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:52.399782 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:52.399753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:53.355792 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:53.355759    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:29:53.455907 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:29:53.455875    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:01.227716 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:01.227602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:01.388496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:01.388455    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:10.257603 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.257568    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"]
Sep 08 16:30:10.258054 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.258034    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0833f4ce-99d0-4f86-8161-6a3a6bec29dd" containerName="console"
Sep 08 16:30:10.258095 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.258058    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0833f4ce-99d0-4f86-8161-6a3a6bec29dd" containerName="console"
Sep 08 16:30:10.258159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.258148    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0833f4ce-99d0-4f86-8161-6a3a6bec29dd" containerName="console"
Sep 08 16:30:10.276712 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.276680    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"]
Sep 08 16:30:10.276863 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.276773    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.280935 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.280908    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zl5j5\""
Sep 08 16:30:10.315236 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.315208    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:10.373241 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.373213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.373241 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.373244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.373409 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.373272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.373409 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.373321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.373409 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.373345    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgkf4\" (UniqueName: \"kubernetes.io/projected/5e3350f7-f053-4982-bf8c-bd822f1c77ec-kube-api-access-tgkf4\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.373409 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.373388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.373409 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.373405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.373582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.373422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.373582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.373555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.474867 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.474832    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.475053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.474875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.475053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.474891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.475053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.474920    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.475053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.474957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.475053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.474991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgkf4\" (UniqueName: \"kubernetes.io/projected/5e3350f7-f053-4982-bf8c-bd822f1c77ec-kube-api-access-tgkf4\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.475053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.475031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.475053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.475052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.475409 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.475079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.475409 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.475298    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.475409 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.475347    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.475409 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.475382    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.475555 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.475510    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.475817 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.475792    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.478185 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.478164    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.479002 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.478981    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.483689 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.483667    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e3350f7-f053-4982-bf8c-bd822f1c77ec-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.484264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.484244    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgkf4\" (UniqueName: \"kubernetes.io/projected/5e3350f7-f053-4982-bf8c-bd822f1c77ec-kube-api-access-tgkf4\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mrfvn\" (UID: \"5e3350f7-f053-4982-bf8c-bd822f1c77ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.586394 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.586318    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:10.868660 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.868559    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"]
Sep 08 16:30:10.872371 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:30:10.872342    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3350f7_f053_4982_bf8c_bd822f1c77ec.slice/crio-54a395c322647e78dab300eec470e133b5ef163cc670ef1ad62c48425980adfb WatchSource:0}: Error finding container 54a395c322647e78dab300eec470e133b5ef163cc670ef1ad62c48425980adfb: Status 404 returned error can't find the container with id 54a395c322647e78dab300eec470e133b5ef163cc670ef1ad62c48425980adfb
Sep 08 16:30:10.874745 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.874709    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:30:10.874819 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.874792    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:30:10.874856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:10.874831    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:30:11.039126 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:11.039045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn" event={"ID":"5e3350f7-f053-4982-bf8c-bd822f1c77ec","Type":"ContainerStarted","Data":"3f11cff8b5619c0982bd53a254ccfe9dffa494f55f0f92711bc4f88c8bdc21d4"}
Sep 08 16:30:11.039126 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:11.039107    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn" event={"ID":"5e3350f7-f053-4982-bf8c-bd822f1c77ec","Type":"ContainerStarted","Data":"54a395c322647e78dab300eec470e133b5ef163cc670ef1ad62c48425980adfb"}
Sep 08 16:30:11.064798 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:11.064733    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn" podStartSLOduration=1.064713029 podStartE2EDuration="1.064713029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:11.062169293 +0000 UTC m=+453.646730913" watchObservedRunningTime="2026-09-08 16:30:11.064713029 +0000 UTC m=+453.649274650"
Sep 08 16:30:11.587312 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:11.587282    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:11.591723 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:11.591700    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:12.008851 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.008815    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:12.044258 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.044232    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:12.045215 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.045196    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:30:12.387081 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.386994    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:12.461525 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.461490    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:12.695434 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.695399    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:30:12.702650 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.702621    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"
Sep 08 16:30:12.704848 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.704827    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 16:30:12.708620 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.708586    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:30:12.735277 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.735248    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:30:12.795049 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.795023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/846955b8-cf57-4801-921e-fd2293d0fbbb-config-file\") pod \"limitador-limitador-84994f7ffc-9lqx5\" (UID: \"846955b8-cf57-4801-921e-fd2293d0fbbb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"
Sep 08 16:30:12.795171 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.795084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpnsv\" (UniqueName: \"kubernetes.io/projected/846955b8-cf57-4801-921e-fd2293d0fbbb-kube-api-access-rpnsv\") pod \"limitador-limitador-84994f7ffc-9lqx5\" (UID: \"846955b8-cf57-4801-921e-fd2293d0fbbb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"
Sep 08 16:30:12.896376 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.896341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/846955b8-cf57-4801-921e-fd2293d0fbbb-config-file\") pod \"limitador-limitador-84994f7ffc-9lqx5\" (UID: \"846955b8-cf57-4801-921e-fd2293d0fbbb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"
Sep 08 16:30:12.896505 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.896412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpnsv\" (UniqueName: \"kubernetes.io/projected/846955b8-cf57-4801-921e-fd2293d0fbbb-kube-api-access-rpnsv\") pod \"limitador-limitador-84994f7ffc-9lqx5\" (UID: \"846955b8-cf57-4801-921e-fd2293d0fbbb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"
Sep 08 16:30:12.896988 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.896967    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/846955b8-cf57-4801-921e-fd2293d0fbbb-config-file\") pod \"limitador-limitador-84994f7ffc-9lqx5\" (UID: \"846955b8-cf57-4801-921e-fd2293d0fbbb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"
Sep 08 16:30:12.905261 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:12.905240    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpnsv\" (UniqueName: \"kubernetes.io/projected/846955b8-cf57-4801-921e-fd2293d0fbbb-kube-api-access-rpnsv\") pod \"limitador-limitador-84994f7ffc-9lqx5\" (UID: \"846955b8-cf57-4801-921e-fd2293d0fbbb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"
Sep 08 16:30:13.014242 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:13.014161    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"
Sep 08 16:30:13.306779 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:13.306758    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:30:13.308541 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:30:13.308516    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846955b8_cf57_4801_921e_fd2293d0fbbb.slice/crio-df8ff5763761e1adf82023a1fbff895e37c4741939709fc588a58b5df1ae2c9c WatchSource:0}: Error finding container df8ff5763761e1adf82023a1fbff895e37c4741939709fc588a58b5df1ae2c9c: Status 404 returned error can't find the container with id df8ff5763761e1adf82023a1fbff895e37c4741939709fc588a58b5df1ae2c9c
Sep 08 16:30:13.381139 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:13.381112    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:13.469387 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:13.469357    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:14.056076 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:14.056042    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-9lqx5" event={"ID":"846955b8-cf57-4801-921e-fd2293d0fbbb","Type":"ContainerStarted","Data":"df8ff5763761e1adf82023a1fbff895e37c4741939709fc588a58b5df1ae2c9c"}
Sep 08 16:30:15.063208 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:15.063178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-9lqx5" event={"ID":"846955b8-cf57-4801-921e-fd2293d0fbbb","Type":"ContainerStarted","Data":"f037a74c45f2d630ea4c471b378fbfad3c7d1727a9e57110621bfaefa67a8e09"}
Sep 08 16:30:15.063694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:15.063233    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"
Sep 08 16:30:15.082550 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:15.082506    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-9lqx5" podStartSLOduration=2.143056278 podStartE2EDuration="3.082492565s" totalImagesPullingTime="939.436287ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:15.080195433 +0000 UTC m=+457.664757052" watchObservedRunningTime="2026-09-08 16:30:15.082492565 +0000 UTC m=+457.667054183"
Sep 08 16:30:26.068890 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:26.068863    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"
Sep 08 16:30:28.271891 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:28.271858    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:28.374051 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:28.374018    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:28.736591 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:28.736537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:33.033935 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:33.033895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:33.656423 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:33.656393    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:41.726199 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:41.726162    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:41.838386 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:41.838353    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:48.300265 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:48.300225    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:48.385649 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:48.385599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:48.443773 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:48.443742    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:48.630461 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:48.630347    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:51.501619 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:51.501574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:51.596918 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:30:51.596860    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:07.430627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:07.430568    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:07.530948 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:07.530918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:23.144725 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:23.144685    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:23.308567 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:23.308534    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:24.589028 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:24.588996    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:24.691170 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:24.691132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:24.855907 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:24.855823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:24.948724 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:24.948690    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:25.194419 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:25.194388    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:25.293480 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:25.293428    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:25.450323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:25.450245    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:31:34.449798 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:34.449767    2562 generic.go:356] "Generic (PLEG): container finished" podID="5e3350f7-f053-4982-bf8c-bd822f1c77ec" containerID="3f11cff8b5619c0982bd53a254ccfe9dffa494f55f0f92711bc4f88c8bdc21d4" exitCode=0
Sep 08 16:31:34.450146 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:34.449846    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn" event={"ID":"5e3350f7-f053-4982-bf8c-bd822f1c77ec","Type":"ContainerDied","Data":"3f11cff8b5619c0982bd53a254ccfe9dffa494f55f0f92711bc4f88c8bdc21d4"}
Sep 08 16:31:34.450255 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:34.450240    2562 scope.go:117] "RemoveContainer" containerID="3f11cff8b5619c0982bd53a254ccfe9dffa494f55f0f92711bc4f88c8bdc21d4"
Sep 08 16:31:34.451206 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:34.451181    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:31:34.451267 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:34.451244    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:31:34.451302 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:34.451277    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:31:35.457299 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:35.457269    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn" event={"ID":"5e3350f7-f053-4982-bf8c-bd822f1c77ec","Type":"ContainerStarted","Data":"7e51a7c853e6c494cf14f74320833701434b07adbac66855a258e1b65211286d"}
Sep 08 16:31:35.586620 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:35.586581    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:31:35.586831 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:35.586806    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-mrfvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 08 16:31:35.586891 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:35.586856    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn" podUID="5e3350f7-f053-4982-bf8c-bd822f1c77ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 08 16:31:36.188494 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:36.188453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:36.289266 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:36.289234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:36.587147 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:36.587112    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-mrfvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 08 16:31:36.587539 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:36.587162    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn" podUID="5e3350f7-f053-4982-bf8c-bd822f1c77ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 08 16:31:37.587376 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:37.587339    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-mrfvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 08 16:31:37.587790 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:37.587395    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn" podUID="5e3350f7-f053-4982-bf8c-bd822f1c77ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 08 16:31:38.587020 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:38.586981    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-mrfvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 08 16:31:38.587193 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:38.587045    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn" podUID="5e3350f7-f053-4982-bf8c-bd822f1c77ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 08 16:31:39.587405 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:39.587362    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-mrfvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 08 16:31:39.587828 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:39.587432    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn" podUID="5e3350f7-f053-4982-bf8c-bd822f1c77ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 08 16:31:40.591028 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:40.590991    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:31:40.591450 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:40.591276    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:31:40.591877 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:40.591854    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn"
Sep 08 16:31:47.082742 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:47.082705    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:49.089344 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:49.089306    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:49.666688 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:31:49.666652    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:32:07.827176 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:07.827134    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:32:15.519097 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:15.519047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:32:16.287801 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:16.287763    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:32:20.861203 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:20.861160    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:32:21.858440 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:21.858406    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:32:32.354904 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.354867    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"]
Sep 08 16:32:32.357425 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.357402    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.361271 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.361244    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 16:32:32.362186 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.362168    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-whvrm\""
Sep 08 16:32:32.362287 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.362172    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 08 16:32:32.362287 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.362210    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 16:32:32.372344 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.372320    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"]
Sep 08 16:32:32.386416 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.386376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:32:32.445721 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.445682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48cefef3-5912-42d1-af7f-4912e3f6dd24-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.445721 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.445718    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48cefef3-5912-42d1-af7f-4912e3f6dd24-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.445931 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.445742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ql7g\" (UniqueName: \"kubernetes.io/projected/48cefef3-5912-42d1-af7f-4912e3f6dd24-kube-api-access-6ql7g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.445931 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.445835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48cefef3-5912-42d1-af7f-4912e3f6dd24-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.445931 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.445876    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48cefef3-5912-42d1-af7f-4912e3f6dd24-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.446035 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.445934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48cefef3-5912-42d1-af7f-4912e3f6dd24-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.546982 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.546938    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ql7g\" (UniqueName: \"kubernetes.io/projected/48cefef3-5912-42d1-af7f-4912e3f6dd24-kube-api-access-6ql7g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.547163 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.547005    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48cefef3-5912-42d1-af7f-4912e3f6dd24-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.547163 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.547039    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48cefef3-5912-42d1-af7f-4912e3f6dd24-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.547163 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.547086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48cefef3-5912-42d1-af7f-4912e3f6dd24-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.547330 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.547163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48cefef3-5912-42d1-af7f-4912e3f6dd24-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.547330 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.547185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48cefef3-5912-42d1-af7f-4912e3f6dd24-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.547571 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.547543    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48cefef3-5912-42d1-af7f-4912e3f6dd24-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.547738 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.547543    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48cefef3-5912-42d1-af7f-4912e3f6dd24-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.547738 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.547601    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48cefef3-5912-42d1-af7f-4912e3f6dd24-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.549546 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.549527    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48cefef3-5912-42d1-af7f-4912e3f6dd24-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.549865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.549844    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48cefef3-5912-42d1-af7f-4912e3f6dd24-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.555279 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.555249    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ql7g\" (UniqueName: \"kubernetes.io/projected/48cefef3-5912-42d1-af7f-4912e3f6dd24-kube-api-access-6ql7g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xxgkp\" (UID: \"48cefef3-5912-42d1-af7f-4912e3f6dd24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.667463 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.667368    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:32.938935 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:32.938905    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"]
Sep 08 16:32:32.940477 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:32:32.940444    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48cefef3_5912_42d1_af7f_4912e3f6dd24.slice/crio-8255662a8ac650a6522cf5cade50d8275e4b38d746fba90b3722c1a5cf3d0c93 WatchSource:0}: Error finding container 8255662a8ac650a6522cf5cade50d8275e4b38d746fba90b3722c1a5cf3d0c93: Status 404 returned error can't find the container with id 8255662a8ac650a6522cf5cade50d8275e4b38d746fba90b3722c1a5cf3d0c93
Sep 08 16:32:33.655133 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:33.655098    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:32:33.752082 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:33.752045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp" event={"ID":"48cefef3-5912-42d1-af7f-4912e3f6dd24","Type":"ContainerStarted","Data":"8255662a8ac650a6522cf5cade50d8275e4b38d746fba90b3722c1a5cf3d0c93"}
Sep 08 16:32:34.759704 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:34.759667    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp" event={"ID":"48cefef3-5912-42d1-af7f-4912e3f6dd24","Type":"ContainerStarted","Data":"10d47a84ac71b831fa3b6da354704945fa63c2f4dd94056e9f2b160ce4d2ec09"}
Sep 08 16:32:34.776515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:34.776459    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp" podStartSLOduration=1.780378403 podStartE2EDuration="2.776440342s" totalImagesPullingTime="996.061939ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:32:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:32:34.776334954 +0000 UTC m=+597.360896575" watchObservedRunningTime="2026-09-08 16:32:34.776440342 +0000 UTC m=+597.361001961"
Sep 08 16:32:42.667734 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:42.667692    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:42.668262 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:42.667749    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:42.680085 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:42.680061    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:32:42.810625 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:32:42.810577    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xxgkp"
Sep 08 16:33:02.185895 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:02.185797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:33:03.655738 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:03.655702    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:33:05.951895 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:05.951865    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"]
Sep 08 16:33:05.954301 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:05.954283    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:05.956861 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:05.956839    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 08 16:33:05.968432 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:05.968411    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"]
Sep 08 16:33:06.006035 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.006006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:33:06.028323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.028295    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2715c1c1-df46-461a-bc06-84ee4cad89c3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.028459 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.028357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2715c1c1-df46-461a-bc06-84ee4cad89c3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.028459 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.028391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2715c1c1-df46-461a-bc06-84ee4cad89c3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.028459 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.028426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2715c1c1-df46-461a-bc06-84ee4cad89c3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.028587 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.028457    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2715c1c1-df46-461a-bc06-84ee4cad89c3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.028587 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.028494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftq7k\" (UniqueName: \"kubernetes.io/projected/2715c1c1-df46-461a-bc06-84ee4cad89c3-kube-api-access-ftq7k\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.129904 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.129871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2715c1c1-df46-461a-bc06-84ee4cad89c3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.130095 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.129913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2715c1c1-df46-461a-bc06-84ee4cad89c3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.130095 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.129940    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftq7k\" (UniqueName: \"kubernetes.io/projected/2715c1c1-df46-461a-bc06-84ee4cad89c3-kube-api-access-ftq7k\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.130095 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.130041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2715c1c1-df46-461a-bc06-84ee4cad89c3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.130095 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.130078    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2715c1c1-df46-461a-bc06-84ee4cad89c3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.130319 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.130110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2715c1c1-df46-461a-bc06-84ee4cad89c3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.130378 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.130326    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2715c1c1-df46-461a-bc06-84ee4cad89c3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.130454 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.130427    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2715c1c1-df46-461a-bc06-84ee4cad89c3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.130454 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.130442    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2715c1c1-df46-461a-bc06-84ee4cad89c3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.132261 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.132233    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2715c1c1-df46-461a-bc06-84ee4cad89c3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.132529 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.132510    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2715c1c1-df46-461a-bc06-84ee4cad89c3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.137756 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.137735    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftq7k\" (UniqueName: \"kubernetes.io/projected/2715c1c1-df46-461a-bc06-84ee4cad89c3-kube-api-access-ftq7k\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zqn5k\" (UID: \"2715c1c1-df46-461a-bc06-84ee4cad89c3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.265056 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.264970    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:06.536387 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.536312    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"]
Sep 08 16:33:06.539480 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:33:06.539454    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2715c1c1_df46_461a_bc06_84ee4cad89c3.slice/crio-d4b05deabf1a093753416cf46fb1c56dedf655b5ea1da26cce1e26e291c23666 WatchSource:0}: Error finding container d4b05deabf1a093753416cf46fb1c56dedf655b5ea1da26cce1e26e291c23666: Status 404 returned error can't find the container with id d4b05deabf1a093753416cf46fb1c56dedf655b5ea1da26cce1e26e291c23666
Sep 08 16:33:06.541199 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.541179    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:33:06.926121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.926085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k" event={"ID":"2715c1c1-df46-461a-bc06-84ee4cad89c3","Type":"ContainerStarted","Data":"bfd3120c3ba1181da4fbabe8efee5c154cc8274d74c34bd88f80df3decf58044"}
Sep 08 16:33:06.926312 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.926151    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k" event={"ID":"2715c1c1-df46-461a-bc06-84ee4cad89c3","Type":"ContainerStarted","Data":"d4b05deabf1a093753416cf46fb1c56dedf655b5ea1da26cce1e26e291c23666"}
Sep 08 16:33:06.943836 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:06.943755    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k" podStartSLOduration=1.739880346 podStartE2EDuration="1.943736875s" totalImagesPullingTime="203.856529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:33:06.941956395 +0000 UTC m=+629.526518013" watchObservedRunningTime="2026-09-08 16:33:06.943736875 +0000 UTC m=+629.528298487"
Sep 08 16:33:08.366286 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:08.366241    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:33:16.265318 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:16.265272    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:16.265842 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:16.265363    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:16.278436 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:16.278403    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:16.999603 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:16.999568    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zqn5k"
Sep 08 16:33:24.891462 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:24.891427    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:33:27.362048 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:27.362006    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:33:31.536409 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:33:31.536371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:29.231586 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:29.231537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:29.332654 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:29.332602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:30.458941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:30.458855    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:30.698722 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:30.698686    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:41.773025 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:41.772986    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:46.340100 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.340064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:46.456243 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.456210    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:46.708596 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.708565    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"]
Sep 08 16:34:46.712030 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.712011    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.715121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.715098    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ff43b8-openshift-default-dockercfg-58prt\""
Sep 08 16:34:46.737014 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.736985    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"]
Sep 08 16:34:46.769853 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.769816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:46.796547 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.796513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-token\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.796717 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.796666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-credential-socket\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.796717 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.796705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-podinfo\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.796813 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.796770    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-data\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.796813 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.796795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-workload-socket\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.796893 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.796831    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-envoy\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.796893 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.796858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bn8x\" (UniqueName: \"kubernetes.io/projected/849698a2-7cad-4e55-a7f8-2beeb0708f02-kube-api-access-5bn8x\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.796970 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.796910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-workload-certs\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.796970 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.796938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849698a2-7cad-4e55-a7f8-2beeb0708f02-istiod-ca-cert\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.898030 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.897991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-token\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.898215 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.898068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-credential-socket\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.898292 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.898212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-podinfo\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.898352 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.898314    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-data\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.898413 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.898348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-workload-socket\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.898469 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.898432    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-credential-socket\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.898512 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.898465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-envoy\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.898512 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.898506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bn8x\" (UniqueName: \"kubernetes.io/projected/849698a2-7cad-4e55-a7f8-2beeb0708f02-kube-api-access-5bn8x\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.898598 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.898545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-workload-certs\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.898598 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.898574    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849698a2-7cad-4e55-a7f8-2beeb0708f02-istiod-ca-cert\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.898736 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.898650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-data\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.898736 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.898728    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-workload-socket\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.898915 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.898896    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-workload-certs\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.899398 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.899376    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849698a2-7cad-4e55-a7f8-2beeb0708f02-istiod-ca-cert\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.900796 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.900775    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-envoy\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.900922 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.900904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-podinfo\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.907711 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.907689    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-token\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.911703 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.911676    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bn8x\" (UniqueName: \"kubernetes.io/projected/849698a2-7cad-4e55-a7f8-2beeb0708f02-kube-api-access-5bn8x\") pod \"e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") " pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:46.957428 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:46.957391    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:47.023889 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:47.023810    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:47.318650 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:47.318624    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"]
Sep 08 16:34:47.320651 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:34:47.320625    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849698a2_7cad_4e55_a7f8_2beeb0708f02.slice/crio-7b83e352e0550d19a1b3c04fe49ba955884bf157df3afee8ff8e2bb3bad7285c WatchSource:0}: Error finding container 7b83e352e0550d19a1b3c04fe49ba955884bf157df3afee8ff8e2bb3bad7285c: Status 404 returned error can't find the container with id 7b83e352e0550d19a1b3c04fe49ba955884bf157df3afee8ff8e2bb3bad7285c
Sep 08 16:34:47.322682 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:47.322645    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:34:47.322778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:47.322715    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:34:47.322778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:47.322744    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:34:47.445457 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:47.445421    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" event={"ID":"849698a2-7cad-4e55-a7f8-2beeb0708f02","Type":"ContainerStarted","Data":"9cc5601894c7387c37b343eb44e96ece27c3479c32cba90ed2c3d9269a28a5cc"}
Sep 08 16:34:47.445847 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:47.445471    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" event={"ID":"849698a2-7cad-4e55-a7f8-2beeb0708f02","Type":"ContainerStarted","Data":"7b83e352e0550d19a1b3c04fe49ba955884bf157df3afee8ff8e2bb3bad7285c"}
Sep 08 16:34:47.473752 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:47.473695    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" podStartSLOduration=1.473677988 podStartE2EDuration="1.473677988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:34:47.470409751 +0000 UTC m=+730.054971370" watchObservedRunningTime="2026-09-08 16:34:47.473677988 +0000 UTC m=+730.058239607"
Sep 08 16:34:48.012517 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:48.012481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:48.024300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:48.024275    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:48.029546 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:48.029511    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:48.182154 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:48.182123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:48.422025 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:48.421937    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:48.450462 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:48.450429    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:48.451332 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:48.451316    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:34:49.650709 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:49.650671    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:49.806775 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:49.806746    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:50.508783 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:50.506990    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:34:50.875882 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:50.875792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:51.220504 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:51.220464    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:51.444025 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:51.443972    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:51.938229 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:51.938193    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:52.091184 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:52.091145    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7851-140370438503216"]
Sep 08 16:34:52.095035 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:52.095014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7851-140370438503216"
Sep 08 16:34:52.100035 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:52.100015    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mrsv6\""
Sep 08 16:34:52.125825 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:52.125804    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7851-140370438503216"]
Sep 08 16:34:52.145540 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:52.145514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl7kl\" (UniqueName: \"kubernetes.io/projected/23564ca9-4c6b-4221-80ad-2bd9bedb1e4f-kube-api-access-vl7kl\") pod \"test-curl-7851-140370438503216\" (UID: \"23564ca9-4c6b-4221-80ad-2bd9bedb1e4f\") " pod="opendatahub/test-curl-7851-140370438503216"
Sep 08 16:34:52.240956 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:52.240914    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:52.246994 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:52.246966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl7kl\" (UniqueName: \"kubernetes.io/projected/23564ca9-4c6b-4221-80ad-2bd9bedb1e4f-kube-api-access-vl7kl\") pod \"test-curl-7851-140370438503216\" (UID: \"23564ca9-4c6b-4221-80ad-2bd9bedb1e4f\") " pod="opendatahub/test-curl-7851-140370438503216"
Sep 08 16:34:52.271031 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:52.271008    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl7kl\" (UniqueName: \"kubernetes.io/projected/23564ca9-4c6b-4221-80ad-2bd9bedb1e4f-kube-api-access-vl7kl\") pod \"test-curl-7851-140370438503216\" (UID: \"23564ca9-4c6b-4221-80ad-2bd9bedb1e4f\") " pod="opendatahub/test-curl-7851-140370438503216"
Sep 08 16:34:52.404735 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:52.404700    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7851-140370438503216"
Sep 08 16:34:52.681806 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:52.681781    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7851-140370438503216"]
Sep 08 16:34:52.683902 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:34:52.683875    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23564ca9_4c6b_4221_80ad_2bd9bedb1e4f.slice/crio-ae2603de9faba3cad9e6b54648329a0e70be08411406ec512914017bdedc5d51 WatchSource:0}: Error finding container ae2603de9faba3cad9e6b54648329a0e70be08411406ec512914017bdedc5d51: Status 404 returned error can't find the container with id ae2603de9faba3cad9e6b54648329a0e70be08411406ec512914017bdedc5d51
Sep 08 16:34:53.478204 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:53.478173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7851-140370438503216" event={"ID":"23564ca9-4c6b-4221-80ad-2bd9bedb1e4f","Type":"ContainerStarted","Data":"ae2603de9faba3cad9e6b54648329a0e70be08411406ec512914017bdedc5d51"}
Sep 08 16:34:54.484342 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:54.484311    2562 generic.go:356] "Generic (PLEG): container finished" podID="23564ca9-4c6b-4221-80ad-2bd9bedb1e4f" containerID="d6e65b4527bd5450c500e79fff431f47382e4db26e53b6554cfe71cbf09ab28d" exitCode=0
Sep 08 16:34:54.484760 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:54.484352    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7851-140370438503216" event={"ID":"23564ca9-4c6b-4221-80ad-2bd9bedb1e4f","Type":"ContainerDied","Data":"d6e65b4527bd5450c500e79fff431f47382e4db26e53b6554cfe71cbf09ab28d"}
Sep 08 16:34:55.426487 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:55.426444    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:55.574713 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:55.574678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:55.615051 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:55.615031    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7851-140370438503216"
Sep 08 16:34:55.663892 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:55.663860    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7851-140370438503216_23564ca9-4c6b-4221-80ad-2bd9bedb1e4f/test-curl-7851-140370438503216/0.log"
Sep 08 16:34:55.679635 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:55.679537    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl7kl\" (UniqueName: \"kubernetes.io/projected/23564ca9-4c6b-4221-80ad-2bd9bedb1e4f-kube-api-access-vl7kl\") pod \"23564ca9-4c6b-4221-80ad-2bd9bedb1e4f\" (UID: \"23564ca9-4c6b-4221-80ad-2bd9bedb1e4f\") "
Sep 08 16:34:55.681770 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:55.681749    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23564ca9-4c6b-4221-80ad-2bd9bedb1e4f-kube-api-access-vl7kl" (OuterVolumeSpecName: "kube-api-access-vl7kl") pod "23564ca9-4c6b-4221-80ad-2bd9bedb1e4f" (UID: "23564ca9-4c6b-4221-80ad-2bd9bedb1e4f"). InnerVolumeSpecName "kube-api-access-vl7kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:34:55.709594 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:55.709570    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7851-140370438503216"]
Sep 08 16:34:55.713067 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:55.713045    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7851-140370438503216"]
Sep 08 16:34:55.719501 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:55.719467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:55.780269 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:55.780238    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl7kl\" (UniqueName: \"kubernetes.io/projected/23564ca9-4c6b-4221-80ad-2bd9bedb1e4f-kube-api-access-vl7kl\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:34:56.006174 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.006138    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23564ca9-4c6b-4221-80ad-2bd9bedb1e4f" path="/var/lib/kubelet/pods/23564ca9-4c6b-4221-80ad-2bd9bedb1e4f/volumes"
Sep 08 16:34:56.096387 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.096353    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"]
Sep 08 16:34:56.096758 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.096739    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23564ca9-4c6b-4221-80ad-2bd9bedb1e4f" containerName="test-curl-7851-140370438503216"
Sep 08 16:34:56.096758 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.096757    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="23564ca9-4c6b-4221-80ad-2bd9bedb1e4f" containerName="test-curl-7851-140370438503216"
Sep 08 16:34:56.096908 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.096815    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="23564ca9-4c6b-4221-80ad-2bd9bedb1e4f" containerName="test-curl-7851-140370438503216"
Sep 08 16:34:56.099977 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.099961    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.102671 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.102650    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7553b8c9-openshift-default-dockercfg-k6gpp\""
Sep 08 16:34:56.130094 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.130066    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"]
Sep 08 16:34:56.153531 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.153504    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:56.182769 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.182734    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df091143-c904-4160-95fe-01fd2d06f1cf-istio-podinfo\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.182950 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.182827    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfbmd\" (UniqueName: \"kubernetes.io/projected/df091143-c904-4160-95fe-01fd2d06f1cf-kube-api-access-pfbmd\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.182950 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.182870    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-workload-certs\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.182950 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.182897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-istio-data\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.183144 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.182983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-credential-socket\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.183144 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.183032    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df091143-c904-4160-95fe-01fd2d06f1cf-istiod-ca-cert\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.183144 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.183126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-workload-socket\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.183361 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.183158    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-istio-envoy\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.183361 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.183182    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df091143-c904-4160-95fe-01fd2d06f1cf-istio-token\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.284637 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.284517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-credential-socket\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.284637 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.284569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df091143-c904-4160-95fe-01fd2d06f1cf-istiod-ca-cert\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.284875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.284657    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-workload-socket\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.284875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.284687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-istio-envoy\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.284875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.284710    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df091143-c904-4160-95fe-01fd2d06f1cf-istio-token\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.284875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.284751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df091143-c904-4160-95fe-01fd2d06f1cf-istio-podinfo\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.284875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.284790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfbmd\" (UniqueName: \"kubernetes.io/projected/df091143-c904-4160-95fe-01fd2d06f1cf-kube-api-access-pfbmd\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.284875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.284833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-workload-certs\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.285170 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.284970    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-credential-socket\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.285170 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.285013    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-workload-socket\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.285170 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.284858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-istio-data\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.285331 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.285209    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-workload-certs\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.285331 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.285313    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df091143-c904-4160-95fe-01fd2d06f1cf-istiod-ca-cert\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.285437 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.285410    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-istio-data\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.286966 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.286940    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-istio-envoy\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.287421 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.287397    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df091143-c904-4160-95fe-01fd2d06f1cf-istio-podinfo\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.319259 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.319227    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfbmd\" (UniqueName: \"kubernetes.io/projected/df091143-c904-4160-95fe-01fd2d06f1cf-kube-api-access-pfbmd\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.327580 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.327557    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df091143-c904-4160-95fe-01fd2d06f1cf-istio-token\") pod \"e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") " pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.361792 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.361760    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:56.410036 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.410000    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:56.493142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.493103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:56.497060 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.497038    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7851-140370438503216"
Sep 08 16:34:56.497188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.497074    2562 scope.go:117] "RemoveContainer" containerID="d6e65b4527bd5450c500e79fff431f47382e4db26e53b6554cfe71cbf09ab28d"
Sep 08 16:34:56.738993 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.738958    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"]
Sep 08 16:34:56.744164 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.744133    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.747452 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.747430    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-616972-openshift-default-dockercfg-fltqd\""
Sep 08 16:34:56.770481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.770451    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:56.788924 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.788888    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"]
Sep 08 16:34:56.790403 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.790374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-workload-socket\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.790521 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.790422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-token\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.790521 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.790471    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knlsn\" (UniqueName: \"kubernetes.io/projected/641becdc-04cd-4d0f-827e-5f1a61e996b2-kube-api-access-knlsn\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.790521 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.790500    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/641becdc-04cd-4d0f-827e-5f1a61e996b2-istiod-ca-cert\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.790665 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.790527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-envoy\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.790665 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.790553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-podinfo\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.790756 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.790677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-credential-socket\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.790756 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.790703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-workload-certs\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.790855 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.790750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-data\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.821686 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.821661    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"]
Sep 08 16:34:56.823732 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:34:56.823703    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf091143_c904_4160_95fe_01fd2d06f1cf.slice/crio-48fafdae31a15031d75d9e135ce606e025676f175cbd015b1380ac6698e0277a WatchSource:0}: Error finding container 48fafdae31a15031d75d9e135ce606e025676f175cbd015b1380ac6698e0277a: Status 404 returned error can't find the container with id 48fafdae31a15031d75d9e135ce606e025676f175cbd015b1380ac6698e0277a
Sep 08 16:34:56.826104 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.826074    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:34:56.826223 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.826132    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:34:56.826223 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.826157    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:34:56.891437 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.891413    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-workload-socket\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.891562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.891454    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-token\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.891562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.891483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knlsn\" (UniqueName: \"kubernetes.io/projected/641becdc-04cd-4d0f-827e-5f1a61e996b2-kube-api-access-knlsn\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.891562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.891512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/641becdc-04cd-4d0f-827e-5f1a61e996b2-istiod-ca-cert\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.891562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.891538    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-envoy\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.891792 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.891725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-podinfo\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.891857 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.891822    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-credential-socket\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.891916 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.891858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-workload-certs\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.891916 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.891882    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-data\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.892483 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.892201    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-workload-socket\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.892483 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.892274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-data\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.892483 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.892401    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-credential-socket\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.892483 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.892401    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/641becdc-04cd-4d0f-827e-5f1a61e996b2-istiod-ca-cert\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.892759 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.892484    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-workload-certs\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.894639 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.894590    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-podinfo\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.894839 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.894816    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-envoy\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.919822 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.919790    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knlsn\" (UniqueName: \"kubernetes.io/projected/641becdc-04cd-4d0f-827e-5f1a61e996b2-kube-api-access-knlsn\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:56.932557 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:56.932515    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-token\") pod \"e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") " pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:57.055233 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:57.055138    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:57.353789 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:57.353747    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"]
Sep 08 16:34:57.355698 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:34:57.355668    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641becdc_04cd_4d0f_827e_5f1a61e996b2.slice/crio-feba5a434c5bd56c9c123f8da14648f38378500aa9cd5431c13714f3610097c7 WatchSource:0}: Error finding container feba5a434c5bd56c9c123f8da14648f38378500aa9cd5431c13714f3610097c7: Status 404 returned error can't find the container with id feba5a434c5bd56c9c123f8da14648f38378500aa9cd5431c13714f3610097c7
Sep 08 16:34:57.358716 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:57.358676    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:34:57.358819 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:57.358761    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:34:57.358819 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:57.358803    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:34:57.504413 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:57.504375    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:57.505642 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:57.505572    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" event={"ID":"df091143-c904-4160-95fe-01fd2d06f1cf","Type":"ContainerStarted","Data":"6d366f1e035f73c6542b71bbc1bb70d06e4f2a133f2fa96ea9bff65e82e10187"}
Sep 08 16:34:57.505795 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:57.505644    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" event={"ID":"df091143-c904-4160-95fe-01fd2d06f1cf","Type":"ContainerStarted","Data":"48fafdae31a15031d75d9e135ce606e025676f175cbd015b1380ac6698e0277a"}
Sep 08 16:34:57.508411 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:57.508379    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" event={"ID":"641becdc-04cd-4d0f-827e-5f1a61e996b2","Type":"ContainerStarted","Data":"b7586e3e03b74148421348181c0f44c4a4b0ca80fa4e0f639a8175f440f118f7"}
Sep 08 16:34:57.508537 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:57.508437    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" event={"ID":"641becdc-04cd-4d0f-827e-5f1a61e996b2","Type":"ContainerStarted","Data":"feba5a434c5bd56c9c123f8da14648f38378500aa9cd5431c13714f3610097c7"}
Sep 08 16:34:57.538222 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:57.538152    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" podStartSLOduration=1.538132075 podStartE2EDuration="1.538132075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:34:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:34:57.528455659 +0000 UTC m=+740.113017283" watchObservedRunningTime="2026-09-08 16:34:57.538132075 +0000 UTC m=+740.122693696"
Sep 08 16:34:57.575346 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:57.575278    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" podStartSLOduration=1.5752543559999999 podStartE2EDuration="1.575254356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:34:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:34:57.574042768 +0000 UTC m=+740.158604388" watchObservedRunningTime="2026-09-08 16:34:57.575254356 +0000 UTC m=+740.159815975"
Sep 08 16:34:58.058631 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:58.055758    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:58.063148 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:58.063117    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:58.410965 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:58.410868    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:58.416313 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:58.416286    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:58.514183 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:58.514153    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:58.514377 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:58.514212    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:58.514940 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:58.514914    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:34:58.515066 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:58.514968    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:34:59.087463 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:59.087423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:59.229496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:59.229462    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:59.812836 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:59.812803    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:59.969370 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:34:59.969335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:00.480168 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:00.480131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:00.676066 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:00.676033    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:01.044292 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:01.044255    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:01.604352 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:01.604319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:01.811051 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:01.811008    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:02.314118 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:02.314077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:02.413031 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:02.412996    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:02.880412 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:02.880378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:02.985226 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:02.985192    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:03.311265 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:03.311233    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:03.863219 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:03.863182    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:35:04.198879 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:04.198836    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:05.568874 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:05.568840    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:05.760633 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:05.760577    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:05.852807 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:05.852711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:06.033338 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:06.033303    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:07.430700 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:07.430664    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:07.510566 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:07.510529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:07.582700 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:07.582663    2562 generic.go:356] "Generic (PLEG): container finished" podID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerID="9cc5601894c7387c37b343eb44e96ece27c3479c32cba90ed2c3d9269a28a5cc" exitCode=0
Sep 08 16:35:07.582880 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:07.582738    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" event={"ID":"849698a2-7cad-4e55-a7f8-2beeb0708f02","Type":"ContainerDied","Data":"9cc5601894c7387c37b343eb44e96ece27c3479c32cba90ed2c3d9269a28a5cc"}
Sep 08 16:35:07.583184 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:07.583166    2562 scope.go:117] "RemoveContainer" containerID="9cc5601894c7387c37b343eb44e96ece27c3479c32cba90ed2c3d9269a28a5cc"
Sep 08 16:35:07.584376 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:07.584351    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:07.584441 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:07.584416    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:07.584478 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:07.584447    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:07.642431 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:07.641127    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:08.590929 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:08.590885    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" event={"ID":"849698a2-7cad-4e55-a7f8-2beeb0708f02","Type":"ContainerStarted","Data":"74a6b10ab49575efc689102daa4da0e533ee406103e313013c3de0c037958558"}
Sep 08 16:35:08.676694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:08.676645    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:09.024872 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:09.024832    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:35:09.025074 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:09.024951    2562 patch_prober.go:28] interesting pod/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 08 16:35:09.025074 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:09.024997    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 08 16:35:10.025133 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:10.025095    2562 patch_prober.go:28] interesting pod/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 08 16:35:10.025647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:10.025178    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 08 16:35:10.467185 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:10.467143    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:11.024852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:11.024812    2562 patch_prober.go:28] interesting pod/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 08 16:35:11.025143 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:11.025111    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 08 16:35:12.024385 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:12.024336    2562 patch_prober.go:28] interesting pod/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 08 16:35:12.024896 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:12.024415    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 08 16:35:12.063871 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:12.063814    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:12.165066 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:12.165031    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:12.766586 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:12.766538    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:13.025050 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:13.024945    2562 patch_prober.go:28] interesting pod/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 08 16:35:13.025050 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:13.025015    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 08 16:35:14.115474 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:14.115433    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:35:14.116013 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:14.115982    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:35:14.116834 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:14.116812    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:35:14.154583 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:14.154550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:14.256263 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:14.256228    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:14.348630 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:14.348556    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:14.554770 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:14.554727    2562 patch_prober.go:28] interesting pod/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:35:14.554937 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:14.554784    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:35:14.981836 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:14.981794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:15.084463 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.084424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:15.172153 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.172102    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"]
Sep 08 16:35:15.175279 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.175257    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.178673 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.178595    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-870dc0-openshift-default-dockercfg-9jcc6\""
Sep 08 16:35:15.183097 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.183074    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"]
Sep 08 16:35:15.185457 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.185439    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.188031 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.188014    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-04ecbe44-kserve-self-signed-certs\""
Sep 08 16:35:15.208377 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.208307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:15.209864 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.209844    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"]
Sep 08 16:35:15.213402 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.213378    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"]
Sep 08 16:35:15.293928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.293791    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-dshm\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.293928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.293836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-tls-certs\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.293928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.293923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-tmp-dir\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.294188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.293952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-workload-certs\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.294188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.293982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-token\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.294188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.294040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfsjz\" (UniqueName: \"kubernetes.io/projected/416a3ece-7fb6-4f4a-8d25-f65146013891-kube-api-access-sfsjz\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.294188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.294087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-home\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.294188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.294130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-data\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.294188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.294164    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-workload-socket\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.294188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.294188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-podinfo\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.294666 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.294225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/416a3ece-7fb6-4f4a-8d25-f65146013891-istiod-ca-cert\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.294666 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.294255    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-credential-socket\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.294666 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.294309    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psvkp\" (UniqueName: \"kubernetes.io/projected/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-kube-api-access-psvkp\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.294666 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.294358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-envoy\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.294666 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.294410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-model-cache\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.395348 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395309    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-dshm\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.395348 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-tls-certs\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.395599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395387    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-tmp-dir\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.395599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395411    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-workload-certs\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.395599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-token\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.395599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfsjz\" (UniqueName: \"kubernetes.io/projected/416a3ece-7fb6-4f4a-8d25-f65146013891-kube-api-access-sfsjz\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.395599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-home\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.395599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-data\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.395599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-workload-socket\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.395996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-podinfo\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.395996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395663    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/416a3ece-7fb6-4f4a-8d25-f65146013891-istiod-ca-cert\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.395996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-credential-socket\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.395996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psvkp\" (UniqueName: \"kubernetes.io/projected/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-kube-api-access-psvkp\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.395996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-envoy\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.395996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395825    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-model-cache\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.395996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395845    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-tmp-dir\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.395996 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.395873    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-workload-certs\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.396475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.396059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-credential-socket\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.396475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.396148    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-home\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.396475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.396148    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-data\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.396475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.396332    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-workload-socket\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.396475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.396390    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-model-cache\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.396768 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.396645    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/416a3ece-7fb6-4f4a-8d25-f65146013891-istiod-ca-cert\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.398237 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.398214    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-tls-certs\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.398736 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.398708    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-dshm\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.398847 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.398808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-envoy\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.398928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.398893    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-podinfo\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.412938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.412910    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfsjz\" (UniqueName: \"kubernetes.io/projected/416a3ece-7fb6-4f4a-8d25-f65146013891-kube-api-access-sfsjz\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.413738 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.413693    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psvkp\" (UniqueName: \"kubernetes.io/projected/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-kube-api-access-psvkp\") pod \"e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") " pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.414247 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.414215    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-token\") pod \"e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") " pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.432137 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.431995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:15.488279 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.488237    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:15.494352 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.494322    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:15.542654 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.541121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:15.834679 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.832283    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"]
Sep 08 16:35:15.848183 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:35:15.848150    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416a3ece_7fb6_4f4a_8d25_f65146013891.slice/crio-4f5917ec1a4cd4e0e7d506f60d85e4cc3ed0d5b9bede53e457d3bf8ef9febae3 WatchSource:0}: Error finding container 4f5917ec1a4cd4e0e7d506f60d85e4cc3ed0d5b9bede53e457d3bf8ef9febae3: Status 404 returned error can't find the container with id 4f5917ec1a4cd4e0e7d506f60d85e4cc3ed0d5b9bede53e457d3bf8ef9febae3
Sep 08 16:35:15.850921 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.850887    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:15.851009 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.850955    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:15.851009 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.850985    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:15.865420 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:15.865398    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"]
Sep 08 16:35:15.867840 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:35:15.867816    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9c5d225_ad9d_4d74_b0c5_9a52e09b0f1a.slice/crio-87ba78d64d1ae8b76c76fcc892f8732e7fbf57b5ba026032272e0524814ce0ab WatchSource:0}: Error finding container 87ba78d64d1ae8b76c76fcc892f8732e7fbf57b5ba026032272e0524814ce0ab: Status 404 returned error can't find the container with id 87ba78d64d1ae8b76c76fcc892f8732e7fbf57b5ba026032272e0524814ce0ab
Sep 08 16:35:16.658380 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:16.658348    2562 generic.go:356] "Generic (PLEG): container finished" podID="df091143-c904-4160-95fe-01fd2d06f1cf" containerID="6d366f1e035f73c6542b71bbc1bb70d06e4f2a133f2fa96ea9bff65e82e10187" exitCode=0
Sep 08 16:35:16.658872 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:16.658430    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" event={"ID":"df091143-c904-4160-95fe-01fd2d06f1cf","Type":"ContainerDied","Data":"6d366f1e035f73c6542b71bbc1bb70d06e4f2a133f2fa96ea9bff65e82e10187"}
Sep 08 16:35:16.658940 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:16.658905    2562 scope.go:117] "RemoveContainer" containerID="6d366f1e035f73c6542b71bbc1bb70d06e4f2a133f2fa96ea9bff65e82e10187"
Sep 08 16:35:16.660125 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:16.660096    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:16.660199 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:16.660186    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:16.660260 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:16.660225    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" event={"ID":"416a3ece-7fb6-4f4a-8d25-f65146013891","Type":"ContainerStarted","Data":"651f0f288ad183bea0aa11b41368b4f0d66df9e2c243c03fb1311293822d546b"}
Sep 08 16:35:16.660317 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:16.660272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" event={"ID":"416a3ece-7fb6-4f4a-8d25-f65146013891","Type":"ContainerStarted","Data":"4f5917ec1a4cd4e0e7d506f60d85e4cc3ed0d5b9bede53e457d3bf8ef9febae3"}
Sep 08 16:35:16.660317 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:16.660228    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:16.661793 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:16.661766    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm" event={"ID":"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a","Type":"ContainerStarted","Data":"39a27964802d6692440fb5e5eb134ca37cae220a3f81d85a663436dbd42e6324"}
Sep 08 16:35:16.661890 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:16.661805    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm" event={"ID":"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a","Type":"ContainerStarted","Data":"87ba78d64d1ae8b76c76fcc892f8732e7fbf57b5ba026032272e0524814ce0ab"}
Sep 08 16:35:16.695656 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:16.695599    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm" podStartSLOduration=1.69558345 podStartE2EDuration="1.69558345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:35:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:35:16.694309605 +0000 UTC m=+759.278871224" watchObservedRunningTime="2026-09-08 16:35:16.69558345 +0000 UTC m=+759.280145068"
Sep 08 16:35:16.716767 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:16.716725    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" podStartSLOduration=1.71670842 podStartE2EDuration="1.71670842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:35:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:35:16.715572402 +0000 UTC m=+759.300134023" watchObservedRunningTime="2026-09-08 16:35:16.71670842 +0000 UTC m=+759.301270040"
Sep 08 16:35:17.489413 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:17.489371    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:17.494502 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:17.494473    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:17.670117 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:17.670082    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" event={"ID":"df091143-c904-4160-95fe-01fd2d06f1cf","Type":"ContainerStarted","Data":"b980a94c2833a4f8a9e85416d8931b7201bbd2bf7bcba54b8393b3a796bd79fc"}
Sep 08 16:35:17.670603 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:17.670540    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:17.677625 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:17.671676    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:18.410940 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:18.410899    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:35:18.411214 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:18.411143    2562 patch_prober.go:28] interesting pod/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 08 16:35:18.411214 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:18.411197    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 08 16:35:18.679717 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:18.679636    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:18.779188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:18.779142    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:19.410823 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:19.410770    2562 patch_prober.go:28] interesting pod/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 08 16:35:19.411030 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:19.410846    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 08 16:35:19.696839 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:19.696807    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:35:20.045714 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:20.042584    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:20.141656 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:20.141597    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:20.410519 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:20.410441    2562 patch_prober.go:28] interesting pod/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 08 16:35:20.410680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:20.410521    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 08 16:35:20.469684 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:20.469631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:20.842388 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:20.842344    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:20.963723 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:20.963685    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:21.411039 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:21.411003    2562 patch_prober.go:28] interesting pod/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 08 16:35:21.411184 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:21.411064    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 08 16:35:21.696971 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:21.696935    2562 generic.go:356] "Generic (PLEG): container finished" podID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerID="b7586e3e03b74148421348181c0f44c4a4b0ca80fa4e0f639a8175f440f118f7" exitCode=0
Sep 08 16:35:21.697138 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:21.697014    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" event={"ID":"641becdc-04cd-4d0f-827e-5f1a61e996b2","Type":"ContainerDied","Data":"b7586e3e03b74148421348181c0f44c4a4b0ca80fa4e0f639a8175f440f118f7"}
Sep 08 16:35:21.697623 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:21.697590    2562 scope.go:117] "RemoveContainer" containerID="b7586e3e03b74148421348181c0f44c4a4b0ca80fa4e0f639a8175f440f118f7"
Sep 08 16:35:21.702124 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:21.701112    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:21.702124 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:21.701191    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:21.702124 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:21.701233    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:22.185045 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:22.184950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:22.410442 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:22.410406    2562 patch_prober.go:28] interesting pod/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 08 16:35:22.410629 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:22.410458    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 08 16:35:22.426946 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:22.426909    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:22.704924 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:22.704886    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" event={"ID":"641becdc-04cd-4d0f-827e-5f1a61e996b2","Type":"ContainerStarted","Data":"a93d8eb019bf51ced34371ad31bb3c69e14d98f1f567ebf14a1418aefbe450c5"}
Sep 08 16:35:22.788122 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:22.788083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:23.056160 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:23.056059    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:35:23.056532 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:23.056503    2562 patch_prober.go:28] interesting pod/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 08 16:35:23.056643 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:23.056571    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 08 16:35:23.414393 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:23.414310    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:35:23.414823 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:23.414589    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:35:23.415260 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:23.415244    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:35:23.897216 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:23.897177    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:24.056479 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:24.056445    2562 patch_prober.go:28] interesting pod/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 08 16:35:24.056690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:24.056501    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 08 16:35:24.529646 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:24.529593    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7"]
Sep 08 16:35:24.532687 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:24.532660    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7"
Sep 08 16:35:24.536726 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:24.536520    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:35:24.536726 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:24.536630    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzslb\""
Sep 08 16:35:24.545931 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:24.545904    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7"]
Sep 08 16:35:24.603359 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:24.603326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc464226-2264-49f7-8d99-17521d7dd88b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7\" (UID: \"bc464226-2264-49f7-8d99-17521d7dd88b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7"
Sep 08 16:35:24.704616 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:24.704574    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc464226-2264-49f7-8d99-17521d7dd88b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7\" (UID: \"bc464226-2264-49f7-8d99-17521d7dd88b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7"
Sep 08 16:35:24.705236 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:24.705217    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc464226-2264-49f7-8d99-17521d7dd88b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7\" (UID: \"bc464226-2264-49f7-8d99-17521d7dd88b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7"
Sep 08 16:35:24.849103 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:24.849007    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:24.849255 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:24.849124    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7"
Sep 08 16:35:25.056160 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:25.056121    2562 patch_prober.go:28] interesting pod/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 08 16:35:25.056362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:25.056183    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 08 16:35:25.154696 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:25.154553    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7"]
Sep 08 16:35:25.157481 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:35:25.157454    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc464226_2264_49f7_8d99_17521d7dd88b.slice/crio-f045291434a31589151e75008da316786617375b98ef7e16def1dd6b0f0cf4cb WatchSource:0}: Error finding container f045291434a31589151e75008da316786617375b98ef7e16def1dd6b0f0cf4cb: Status 404 returned error can't find the container with id f045291434a31589151e75008da316786617375b98ef7e16def1dd6b0f0cf4cb
Sep 08 16:35:25.494711 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:25.494671    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:25.494895 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:25.494724    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:25.507490 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:25.507459    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:25.722856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:25.722811    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7" event={"ID":"bc464226-2264-49f7-8d99-17521d7dd88b","Type":"ContainerStarted","Data":"f045291434a31589151e75008da316786617375b98ef7e16def1dd6b0f0cf4cb"}
Sep 08 16:35:25.733558 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:25.733518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:25.760533 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:25.760450    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:35:26.055771 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:26.055677    2562 patch_prober.go:28] interesting pod/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 08 16:35:26.055771 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:26.055736    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 08 16:35:27.056213 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:27.056167    2562 patch_prober.go:28] interesting pod/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 08 16:35:27.056709 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:27.056269    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 08 16:35:28.055588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:28.055554    2562 patch_prober.go:28] interesting pod/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 08 16:35:28.055764 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:28.055659    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 08 16:35:28.514425 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:28.514387    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:35:28.758243 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:28.758203    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7" event={"ID":"bc464226-2264-49f7-8d99-17521d7dd88b","Type":"ContainerStarted","Data":"a4ef4394240151b5ccc12b16b03dc6a9653b176af9754d3c5ad32ac9c29d158b"}
Sep 08 16:35:28.783641 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:28.783574    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7" podStartSLOduration=1.5715749909999999 podStartE2EDuration="4.783558935s" totalImagesPullingTime="3.211983944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:35:28.782736007 +0000 UTC m=+771.367297643" watchObservedRunningTime="2026-09-08 16:35:28.783558935 +0000 UTC m=+771.368120554"
Sep 08 16:35:29.059354 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:29.059326    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:35:29.060298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:29.060279    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:35:29.755985 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:29.755953    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:29.765569 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:29.765544    2562 generic.go:356] "Generic (PLEG): container finished" podID="bc464226-2264-49f7-8d99-17521d7dd88b" containerID="a4ef4394240151b5ccc12b16b03dc6a9653b176af9754d3c5ad32ac9c29d158b" exitCode=0
Sep 08 16:35:29.765745 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:29.765637    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7" event={"ID":"bc464226-2264-49f7-8d99-17521d7dd88b","Type":"ContainerDied","Data":"a4ef4394240151b5ccc12b16b03dc6a9653b176af9754d3c5ad32ac9c29d158b"}
Sep 08 16:35:30.932118 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:30.931782    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7"
Sep 08 16:35:30.987928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:30.987897    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc464226-2264-49f7-8d99-17521d7dd88b-maas-api-service-ca\") pod \"bc464226-2264-49f7-8d99-17521d7dd88b\" (UID: \"bc464226-2264-49f7-8d99-17521d7dd88b\") "
Sep 08 16:35:30.988337 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:30.988310    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc464226-2264-49f7-8d99-17521d7dd88b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bc464226-2264-49f7-8d99-17521d7dd88b" (UID: "bc464226-2264-49f7-8d99-17521d7dd88b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:35:31.089529 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:31.089434    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc464226-2264-49f7-8d99-17521d7dd88b-maas-api-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:35:31.778427 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:31.778391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7" event={"ID":"bc464226-2264-49f7-8d99-17521d7dd88b","Type":"ContainerDied","Data":"f045291434a31589151e75008da316786617375b98ef7e16def1dd6b0f0cf4cb"}
Sep 08 16:35:31.778658 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:31.778446    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f045291434a31589151e75008da316786617375b98ef7e16def1dd6b0f0cf4cb"
Sep 08 16:35:31.778658 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:31.778401    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7"
Sep 08 16:35:32.100377 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:32.100287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:32.190015 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:32.189982    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:36.812371 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:36.812334    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:35:39.830154 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:39.830123    2562 generic.go:356] "Generic (PLEG): container finished" podID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerID="651f0f288ad183bea0aa11b41368b4f0d66df9e2c243c03fb1311293822d546b" exitCode=0
Sep 08 16:35:39.830559 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:39.830203    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" event={"ID":"416a3ece-7fb6-4f4a-8d25-f65146013891","Type":"ContainerDied","Data":"651f0f288ad183bea0aa11b41368b4f0d66df9e2c243c03fb1311293822d546b"}
Sep 08 16:35:39.830627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:39.830561    2562 scope.go:117] "RemoveContainer" containerID="651f0f288ad183bea0aa11b41368b4f0d66df9e2c243c03fb1311293822d546b"
Sep 08 16:35:39.831621 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:39.831581    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:39.831681 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:39.831660    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:39.831717 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:39.831691    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:40.842950 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:40.842906    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" event={"ID":"416a3ece-7fb6-4f4a-8d25-f65146013891","Type":"ContainerStarted","Data":"55a3b518befee2e0e5af8429f175f7c52ab80ee7444c4eadb5037f35f9ab8c6b"}
Sep 08 16:35:41.402746 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:41.402713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:41.488932 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:41.488891    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:41.489126 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:41.489100    2562 patch_prober.go:28] interesting pod/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 08 16:35:41.489204 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:41.489155    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 08 16:35:42.240576 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:42.240533    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:42.488862 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:42.488828    2562 patch_prober.go:28] interesting pod/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 08 16:35:42.489022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:42.488883    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 08 16:35:42.988536 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:42.988497    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:43.189719 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:43.189683    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:43.295086 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:43.294998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:43.395806 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:43.395778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:43.489058 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:43.489024    2562 patch_prober.go:28] interesting pod/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 08 16:35:43.489227 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:43.489157    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 08 16:35:43.490003 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:43.489963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:43.538277 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:43.538235    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7"]
Sep 08 16:35:43.545510 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:43.545433    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7553b8c9-t8fw7"]
Sep 08 16:35:43.792746 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:43.792712    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"]
Sep 08 16:35:43.793101 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:43.792926    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" containerName="istio-proxy" containerID="cri-o://b980a94c2833a4f8a9e85416d8931b7201bbd2bf7bcba54b8393b3a796bd79fc" gracePeriod=30
Sep 08 16:35:43.858965 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:43.858895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:44.006645 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:44.006597    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc464226-2264-49f7-8d99-17521d7dd88b" path="/var/lib/kubelet/pods/bc464226-2264-49f7-8d99-17521d7dd88b/volumes"
Sep 08 16:35:44.055005 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:44.054980    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:44.357936 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:44.357895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:44.488860 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:44.488823    2562 patch_prober.go:28] interesting pod/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 08 16:35:44.489023 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:44.488876    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 08 16:35:44.567739 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:44.567689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:44.766382 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:44.766320    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:45.011290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.011257    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"]
Sep 08 16:35:45.011702 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.011685    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc464226-2264-49f7-8d99-17521d7dd88b" containerName="revoke-keys"
Sep 08 16:35:45.011825 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.011714    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc464226-2264-49f7-8d99-17521d7dd88b" containerName="revoke-keys"
Sep 08 16:35:45.011891 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.011879    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc464226-2264-49f7-8d99-17521d7dd88b" containerName="revoke-keys"
Sep 08 16:35:45.016499 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.016441    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.028636 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.023997    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-421f5bb0-gw-openshift-default-dockercfg-j8tzr\""
Sep 08 16:35:45.058824 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.058801    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"]
Sep 08 16:35:45.138287 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.138247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:45.160257 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.160226    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-token\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.160373 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.160334    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-workload-certs\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.160373 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.160368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-data\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.160452 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.160387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istiod-ca-cert\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.160487 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.160446    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gbdh\" (UniqueName: \"kubernetes.io/projected/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-kube-api-access-9gbdh\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.160550 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.160537    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-podinfo\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.160589 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.160559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-workload-socket\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.160589 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.160577    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-credential-socket\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.160692 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.160595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-envoy\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.261491 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.261457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-workload-socket\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.261737 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.261719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-credential-socket\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.261843 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.261832    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-envoy\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.261943 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.261934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-token\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.262025 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.262006    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-credential-socket\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.262063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.261794    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-workload-socket\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.262158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.262138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-workload-certs\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.262331 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.262319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-data\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.262417 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.262406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istiod-ca-cert\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.262503 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.262494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gbdh\" (UniqueName: \"kubernetes.io/projected/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-kube-api-access-9gbdh\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.262573 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.262565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-podinfo\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.262650 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.262629    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-data\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.262694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.262447    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-workload-certs\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.262895 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.262876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istiod-ca-cert\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.263879 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.263839    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-envoy\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.265284 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.265255    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-podinfo\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.283185 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.283128    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-token\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.286433 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.286412    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gbdh\" (UniqueName: \"kubernetes.io/projected/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-kube-api-access-9gbdh\") pod \"e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") " pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.341583 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.341544    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:45.441727 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.441627    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:45.488720 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.488689    2562 patch_prober.go:28] interesting pod/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 08 16:35:45.488899 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.488744    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 08 16:35:45.638958 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.638930    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"]
Sep 08 16:35:45.639395 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.639359    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:45.639567 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.639545    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:45.639747 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.639727    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:35:45.877090 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.877051    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" event={"ID":"712dce1f-e1bf-4a9b-b117-40c498a1d6d7","Type":"ContainerStarted","Data":"273d9907cd3df6bd2629e449cfe25fbbc603ee56d71260b8c21cad2fa20bd477"}
Sep 08 16:35:45.877232 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.877149    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" event={"ID":"712dce1f-e1bf-4a9b-b117-40c498a1d6d7","Type":"ContainerStarted","Data":"35e431dc677d85deecb180a05f320518c30cf56fba8fe7c8c8dd69fb89739a9d"}
Sep 08 16:35:45.927825 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:45.927725    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" podStartSLOduration=1.9277077889999998 podStartE2EDuration="1.927707789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:35:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:35:45.925938027 +0000 UTC m=+788.510499658" watchObservedRunningTime="2026-09-08 16:35:45.927707789 +0000 UTC m=+788.512269411"
Sep 08 16:35:46.342326 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:46.342293    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:46.347649 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:46.347599    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:46.493270 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:46.493242    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:46.493694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:46.493537    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:46.494342 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:46.494320    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:35:46.882777 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:46.882737    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:46.883418 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:46.883393    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:35:47.276992 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:47.276944    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:47.542074 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:47.541981    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:47.710512 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:47.710473    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:47.986025 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:47.985991    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:48.289959 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:48.289874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:48.492116 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:48.492086    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:48.846250 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:48.846223    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:48.933917 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:48.933879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:49.039712 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.039686    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:35:49.100579 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.100511    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df091143-c904-4160-95fe-01fd2d06f1cf-istio-token\") pod \"df091143-c904-4160-95fe-01fd2d06f1cf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") "
Sep 08 16:35:49.100579 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.100551    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-istio-envoy\") pod \"df091143-c904-4160-95fe-01fd2d06f1cf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") "
Sep 08 16:35:49.100749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.100597    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfbmd\" (UniqueName: \"kubernetes.io/projected/df091143-c904-4160-95fe-01fd2d06f1cf-kube-api-access-pfbmd\") pod \"df091143-c904-4160-95fe-01fd2d06f1cf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") "
Sep 08 16:35:49.100749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.100663    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-workload-socket\") pod \"df091143-c904-4160-95fe-01fd2d06f1cf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") "
Sep 08 16:35:49.100749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.100689    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-credential-socket\") pod \"df091143-c904-4160-95fe-01fd2d06f1cf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") "
Sep 08 16:35:49.100749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.100706    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df091143-c904-4160-95fe-01fd2d06f1cf-istio-podinfo\") pod \"df091143-c904-4160-95fe-01fd2d06f1cf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") "
Sep 08 16:35:49.100749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.100729    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df091143-c904-4160-95fe-01fd2d06f1cf-istiod-ca-cert\") pod \"df091143-c904-4160-95fe-01fd2d06f1cf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") "
Sep 08 16:35:49.101007 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.100760    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-workload-certs\") pod \"df091143-c904-4160-95fe-01fd2d06f1cf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") "
Sep 08 16:35:49.101007 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.100818    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-istio-data\") pod \"df091143-c904-4160-95fe-01fd2d06f1cf\" (UID: \"df091143-c904-4160-95fe-01fd2d06f1cf\") "
Sep 08 16:35:49.101007 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.100980    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "df091143-c904-4160-95fe-01fd2d06f1cf" (UID: "df091143-c904-4160-95fe-01fd2d06f1cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:35:49.101203 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.101177    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-istio-data" (OuterVolumeSpecName: "istio-data") pod "df091143-c904-4160-95fe-01fd2d06f1cf" (UID: "df091143-c904-4160-95fe-01fd2d06f1cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:35:49.101203 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.101193    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "df091143-c904-4160-95fe-01fd2d06f1cf" (UID: "df091143-c904-4160-95fe-01fd2d06f1cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:35:49.101310 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.101199    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:35:49.101310 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.101225    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df091143-c904-4160-95fe-01fd2d06f1cf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "df091143-c904-4160-95fe-01fd2d06f1cf" (UID: "df091143-c904-4160-95fe-01fd2d06f1cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:35:49.101399 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.101346    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "df091143-c904-4160-95fe-01fd2d06f1cf" (UID: "df091143-c904-4160-95fe-01fd2d06f1cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:35:49.103433 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.103406    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df091143-c904-4160-95fe-01fd2d06f1cf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "df091143-c904-4160-95fe-01fd2d06f1cf" (UID: "df091143-c904-4160-95fe-01fd2d06f1cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:35:49.103543 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.103429    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "df091143-c904-4160-95fe-01fd2d06f1cf" (UID: "df091143-c904-4160-95fe-01fd2d06f1cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:35:49.103543 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.103449    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df091143-c904-4160-95fe-01fd2d06f1cf-kube-api-access-pfbmd" (OuterVolumeSpecName: "kube-api-access-pfbmd") pod "df091143-c904-4160-95fe-01fd2d06f1cf" (UID: "df091143-c904-4160-95fe-01fd2d06f1cf"). InnerVolumeSpecName "kube-api-access-pfbmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:35:49.103543 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.103468    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df091143-c904-4160-95fe-01fd2d06f1cf-istio-token" (OuterVolumeSpecName: "istio-token") pod "df091143-c904-4160-95fe-01fd2d06f1cf" (UID: "df091143-c904-4160-95fe-01fd2d06f1cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:35:49.201883 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.201848    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfbmd\" (UniqueName: \"kubernetes.io/projected/df091143-c904-4160-95fe-01fd2d06f1cf-kube-api-access-pfbmd\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:35:49.201883 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.201876    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:35:49.201883 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.201887    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df091143-c904-4160-95fe-01fd2d06f1cf-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:35:49.202119 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.201895    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df091143-c904-4160-95fe-01fd2d06f1cf-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:35:49.202119 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.201903    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:35:49.202119 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.201910    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:35:49.202119 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.201917    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df091143-c904-4160-95fe-01fd2d06f1cf-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:35:49.202119 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.201924    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df091143-c904-4160-95fe-01fd2d06f1cf-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:35:49.901846 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.901813    2562 generic.go:356] "Generic (PLEG): container finished" podID="df091143-c904-4160-95fe-01fd2d06f1cf" containerID="b980a94c2833a4f8a9e85416d8931b7201bbd2bf7bcba54b8393b3a796bd79fc" exitCode=0
Sep 08 16:35:49.902225 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.901860    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"
Sep 08 16:35:49.902225 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.901890    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" event={"ID":"df091143-c904-4160-95fe-01fd2d06f1cf","Type":"ContainerDied","Data":"b980a94c2833a4f8a9e85416d8931b7201bbd2bf7bcba54b8393b3a796bd79fc"}
Sep 08 16:35:49.902225 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.901959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf" event={"ID":"df091143-c904-4160-95fe-01fd2d06f1cf","Type":"ContainerDied","Data":"48fafdae31a15031d75d9e135ce606e025676f175cbd015b1380ac6698e0277a"}
Sep 08 16:35:49.902225 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.901981    2562 scope.go:117] "RemoveContainer" containerID="b980a94c2833a4f8a9e85416d8931b7201bbd2bf7bcba54b8393b3a796bd79fc"
Sep 08 16:35:49.912254 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.912136    2562 scope.go:117] "RemoveContainer" containerID="6d366f1e035f73c6542b71bbc1bb70d06e4f2a133f2fa96ea9bff65e82e10187"
Sep 08 16:35:49.920998 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.920981    2562 scope.go:117] "RemoveContainer" containerID="b980a94c2833a4f8a9e85416d8931b7201bbd2bf7bcba54b8393b3a796bd79fc"
Sep 08 16:35:49.921248 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:35:49.921225    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b980a94c2833a4f8a9e85416d8931b7201bbd2bf7bcba54b8393b3a796bd79fc\": container with ID starting with b980a94c2833a4f8a9e85416d8931b7201bbd2bf7bcba54b8393b3a796bd79fc not found: ID does not exist" containerID="b980a94c2833a4f8a9e85416d8931b7201bbd2bf7bcba54b8393b3a796bd79fc"
Sep 08 16:35:49.921310 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.921255    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b980a94c2833a4f8a9e85416d8931b7201bbd2bf7bcba54b8393b3a796bd79fc"} err="failed to get container status \"b980a94c2833a4f8a9e85416d8931b7201bbd2bf7bcba54b8393b3a796bd79fc\": rpc error: code = NotFound desc = could not find container \"b980a94c2833a4f8a9e85416d8931b7201bbd2bf7bcba54b8393b3a796bd79fc\": container with ID starting with b980a94c2833a4f8a9e85416d8931b7201bbd2bf7bcba54b8393b3a796bd79fc not found: ID does not exist"
Sep 08 16:35:49.921310 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.921271    2562 scope.go:117] "RemoveContainer" containerID="6d366f1e035f73c6542b71bbc1bb70d06e4f2a133f2fa96ea9bff65e82e10187"
Sep 08 16:35:49.921517 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:35:49.921499    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d366f1e035f73c6542b71bbc1bb70d06e4f2a133f2fa96ea9bff65e82e10187\": container with ID starting with 6d366f1e035f73c6542b71bbc1bb70d06e4f2a133f2fa96ea9bff65e82e10187 not found: ID does not exist" containerID="6d366f1e035f73c6542b71bbc1bb70d06e4f2a133f2fa96ea9bff65e82e10187"
Sep 08 16:35:49.921566 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.921523    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d366f1e035f73c6542b71bbc1bb70d06e4f2a133f2fa96ea9bff65e82e10187"} err="failed to get container status \"6d366f1e035f73c6542b71bbc1bb70d06e4f2a133f2fa96ea9bff65e82e10187\": rpc error: code = NotFound desc = could not find container \"6d366f1e035f73c6542b71bbc1bb70d06e4f2a133f2fa96ea9bff65e82e10187\": container with ID starting with 6d366f1e035f73c6542b71bbc1bb70d06e4f2a133f2fa96ea9bff65e82e10187 not found: ID does not exist"
Sep 08 16:35:49.941885 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.941862    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"]
Sep 08 16:35:49.951763 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:49.951742    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf"]
Sep 08 16:35:50.006074 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:50.006055    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" path="/var/lib/kubelet/pods/df091143-c904-4160-95fe-01fd2d06f1cf/volumes"
Sep 08 16:35:54.174428 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:35:54.174389    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:36:02.923784 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:02.923733    2562 patch_prober.go:28] interesting pod/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:36:02.924158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:02.923824    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:36:04.900297 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.900257    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"]
Sep 08 16:36:04.900695 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.900657    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" containerName="istio-proxy"
Sep 08 16:36:04.900695 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.900669    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" containerName="istio-proxy"
Sep 08 16:36:04.900773 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.900743    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" containerName="istio-proxy"
Sep 08 16:36:04.903043 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.903027    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:04.907504 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.907486    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-616972\"/\"kube-root-ca.crt\""
Sep 08 16:36:04.908037 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.908013    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-616972\"/\"openshift-service-ca.crt\""
Sep 08 16:36:04.908037 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.908027    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-616972\"/\"autores-model-616972-kserve-self-signed-certs\""
Sep 08 16:36:04.908183 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.908018    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-616972\"/\"default-dockercfg-8wcbw\""
Sep 08 16:36:04.921895 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.921869    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"]
Sep 08 16:36:04.941684 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.941662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk579\" (UniqueName: \"kubernetes.io/projected/a86c56a4-e459-4619-9e4a-61122a3a43ab-kube-api-access-sk579\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:04.941774 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.941702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-model-cache\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:04.941820 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.941765    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-home\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:04.941855 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.941832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-tmp-dir\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:04.941889 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.941855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-dshm\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:04.941922 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.941888    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a86c56a4-e459-4619-9e4a-61122a3a43ab-tls-certs\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:04.962049 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.962024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:04.991389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.991364    2562 generic.go:356] "Generic (PLEG): container finished" podID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerID="273d9907cd3df6bd2629e449cfe25fbbc603ee56d71260b8c21cad2fa20bd477" exitCode=0
Sep 08 16:36:04.991496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.991434    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" event={"ID":"712dce1f-e1bf-4a9b-b117-40c498a1d6d7","Type":"ContainerDied","Data":"273d9907cd3df6bd2629e449cfe25fbbc603ee56d71260b8c21cad2fa20bd477"}
Sep 08 16:36:04.991894 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.991879    2562 scope.go:117] "RemoveContainer" containerID="273d9907cd3df6bd2629e449cfe25fbbc603ee56d71260b8c21cad2fa20bd477"
Sep 08 16:36:04.992952 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.992925    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:36:04.993005 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.992989    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:36:04.993042 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:04.993020    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:36:05.042632 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.042596    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a86c56a4-e459-4619-9e4a-61122a3a43ab-tls-certs\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:05.042755 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.042690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk579\" (UniqueName: \"kubernetes.io/projected/a86c56a4-e459-4619-9e4a-61122a3a43ab-kube-api-access-sk579\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:05.042818 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.042762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-model-cache\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:05.042871 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.042821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-home\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:05.043312 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.042922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-tmp-dir\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:05.043312 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.042990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-dshm\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:05.043312 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.043242    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-model-cache\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:05.043312 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.043272    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-home\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:05.043813 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.043796    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-tmp-dir\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:05.045216 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.045147    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a86c56a4-e459-4619-9e4a-61122a3a43ab-tls-certs\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:05.045343 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.045324    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-dshm\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:05.053989 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.053968    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk579\" (UniqueName: \"kubernetes.io/projected/a86c56a4-e459-4619-9e4a-61122a3a43ab-kube-api-access-sk579\") pod \"autores-model-616972-kserve-574f5bd45f-nqzsz\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") " pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:05.212846 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.212811    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:05.495201 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:05.495171    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"]
Sep 08 16:36:05.496410 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:36:05.496380    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda86c56a4_e459_4619_9e4a_61122a3a43ab.slice/crio-0fe95f9df5ee077324145622c5c5c9b78b72ce24d1b8774333d351cd25aacab9 WatchSource:0}: Error finding container 0fe95f9df5ee077324145622c5c5c9b78b72ce24d1b8774333d351cd25aacab9: Status 404 returned error can't find the container with id 0fe95f9df5ee077324145622c5c5c9b78b72ce24d1b8774333d351cd25aacab9
Sep 08 16:36:06.006388 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:06.006349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" event={"ID":"712dce1f-e1bf-4a9b-b117-40c498a1d6d7","Type":"ContainerStarted","Data":"02c2b5eb664d918067828e646082fc52c4ff2c51392fdf731e32f532549ca4a3"}
Sep 08 16:36:06.007882 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:06.007856    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz" event={"ID":"a86c56a4-e459-4619-9e4a-61122a3a43ab","Type":"ContainerStarted","Data":"238d371493bad28c2b6f7cbc5772a27a2e466113f12d21cf0c8cbe13e9f91577"}
Sep 08 16:36:06.007882 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:06.007886    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz" event={"ID":"a86c56a4-e459-4619-9e4a-61122a3a43ab","Type":"ContainerStarted","Data":"0fe95f9df5ee077324145622c5c5c9b78b72ce24d1b8774333d351cd25aacab9"}
Sep 08 16:36:06.055103 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:06.055045    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz" podStartSLOduration=2.05502758 podStartE2EDuration="2.05502758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:36:06.053377625 +0000 UTC m=+808.637939267" watchObservedRunningTime="2026-09-08 16:36:06.05502758 +0000 UTC m=+808.639589198"
Sep 08 16:36:06.342538 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:06.342434    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:36:06.342748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:06.342569    2562 patch_prober.go:28] interesting pod/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 08 16:36:06.342748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:06.342651    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 08 16:36:07.343002 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:07.342952    2562 patch_prober.go:28] interesting pod/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 08 16:36:07.343455 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:07.343048    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 08 16:36:08.342839 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:08.342795    2562 patch_prober.go:28] interesting pod/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 08 16:36:08.343043 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:08.342873    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 08 16:36:09.230175 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:09.230139    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:09.342702 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:09.342666    2562 patch_prober.go:28] interesting pod/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 08 16:36:09.342982 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:09.342951    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 08 16:36:10.343025 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:10.342978    2562 patch_prober.go:28] interesting pod/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 08 16:36:10.343507 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:10.343051    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 08 16:36:10.485483 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:10.485447    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:36:11.346239 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:11.346203    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:36:11.346595 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:11.346508    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:36:11.347279 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:11.347262    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:36:12.633031 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:12.633000    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z"]
Sep 08 16:36:12.633691 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:12.633374    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" containerName="istio-proxy"
Sep 08 16:36:12.633691 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:12.633384    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" containerName="istio-proxy"
Sep 08 16:36:12.633691 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:12.633441    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="df091143-c904-4160-95fe-01fd2d06f1cf" containerName="istio-proxy"
Sep 08 16:36:12.635417 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:12.635402    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z"
Sep 08 16:36:12.639693 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:12.639674    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzslb\""
Sep 08 16:36:12.651364 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:12.651348    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:36:12.669339 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:12.669280    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z"]
Sep 08 16:36:12.728047 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:12.728009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1f30d07-410f-437c-8eb5-78a7ec42c9af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z\" (UID: \"e1f30d07-410f-437c-8eb5-78a7ec42c9af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z"
Sep 08 16:36:12.828678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:12.828638    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1f30d07-410f-437c-8eb5-78a7ec42c9af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z\" (UID: \"e1f30d07-410f-437c-8eb5-78a7ec42c9af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z"
Sep 08 16:36:12.829339 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:12.829312    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1f30d07-410f-437c-8eb5-78a7ec42c9af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z\" (UID: \"e1f30d07-410f-437c-8eb5-78a7ec42c9af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z"
Sep 08 16:36:12.945516 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:12.945488    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z"
Sep 08 16:36:13.226597 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:13.226570    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z"]
Sep 08 16:36:13.227697 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:36:13.227664    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f30d07_410f_437c_8eb5_78a7ec42c9af.slice/crio-8f466093feb3d28a3d0963703253fc2a9e8eff359747e7cd6dcfedf93005a8e4 WatchSource:0}: Error finding container 8f466093feb3d28a3d0963703253fc2a9e8eff359747e7cd6dcfedf93005a8e4: Status 404 returned error can't find the container with id 8f466093feb3d28a3d0963703253fc2a9e8eff359747e7cd6dcfedf93005a8e4
Sep 08 16:36:14.066503 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:14.066471    2562 generic.go:356] "Generic (PLEG): container finished" podID="e1f30d07-410f-437c-8eb5-78a7ec42c9af" containerID="676659d0bfb79897cca8e99b5f44a14ead0f3bcabf479f2ad5529d0441d6d0bf" exitCode=0
Sep 08 16:36:14.066864 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:14.066554    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z" event={"ID":"e1f30d07-410f-437c-8eb5-78a7ec42c9af","Type":"ContainerDied","Data":"676659d0bfb79897cca8e99b5f44a14ead0f3bcabf479f2ad5529d0441d6d0bf"}
Sep 08 16:36:14.066864 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:14.066619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z" event={"ID":"e1f30d07-410f-437c-8eb5-78a7ec42c9af","Type":"ContainerStarted","Data":"8f466093feb3d28a3d0963703253fc2a9e8eff359747e7cd6dcfedf93005a8e4"}
Sep 08 16:36:15.201075 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:15.201051    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z"
Sep 08 16:36:15.213155 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:15.213131    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:15.213264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:15.213177    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:15.227029 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:15.227008    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:15.350406 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:15.350328    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1f30d07-410f-437c-8eb5-78a7ec42c9af-maas-api-service-ca\") pod \"e1f30d07-410f-437c-8eb5-78a7ec42c9af\" (UID: \"e1f30d07-410f-437c-8eb5-78a7ec42c9af\") "
Sep 08 16:36:15.350688 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:15.350666    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1f30d07-410f-437c-8eb5-78a7ec42c9af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e1f30d07-410f-437c-8eb5-78a7ec42c9af" (UID: "e1f30d07-410f-437c-8eb5-78a7ec42c9af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:36:15.451828 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:15.451801    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1f30d07-410f-437c-8eb5-78a7ec42c9af-maas-api-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:16.077961 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:16.077934    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z"
Sep 08 16:36:16.078093 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:16.077979    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z" event={"ID":"e1f30d07-410f-437c-8eb5-78a7ec42c9af","Type":"ContainerDied","Data":"8f466093feb3d28a3d0963703253fc2a9e8eff359747e7cd6dcfedf93005a8e4"}
Sep 08 16:36:16.078093 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:16.078025    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f466093feb3d28a3d0963703253fc2a9e8eff359747e7cd6dcfedf93005a8e4"
Sep 08 16:36:16.089573 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:16.089552    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:19.041155 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:19.041116    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z"]
Sep 08 16:36:19.045729 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:19.045701    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-421f5bb0-m8d8z"]
Sep 08 16:36:19.194392 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:19.194360    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"]
Sep 08 16:36:19.194642 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:19.194554    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerName="istio-proxy" containerID="cri-o://02c2b5eb664d918067828e646082fc52c4ff2c51392fdf731e32f532549ca4a3" gracePeriod=30
Sep 08 16:36:19.481858 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:19.481817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:19.554312 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:19.554279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:19.707772 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:19.707739    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:20.006692 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.006657    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1f30d07-410f-437c-8eb5-78a7ec42c9af" path="/var/lib/kubelet/pods/e1f30d07-410f-437c-8eb5-78a7ec42c9af/volumes"
Sep 08 16:36:20.018270 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.018240    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"]
Sep 08 16:36:20.018591 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.018578    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1f30d07-410f-437c-8eb5-78a7ec42c9af" containerName="revoke-keys"
Sep 08 16:36:20.018678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.018592    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1f30d07-410f-437c-8eb5-78a7ec42c9af" containerName="revoke-keys"
Sep 08 16:36:20.018678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.018663    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1f30d07-410f-437c-8eb5-78a7ec42c9af" containerName="revoke-keys"
Sep 08 16:36:20.020666 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.020650    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.024587 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.024570    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6dd85108-openshift-default-dockercfg-c9xdd\""
Sep 08 16:36:20.042704 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.042675    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"]
Sep 08 16:36:20.044515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.044490    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:20.091156 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.091120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-workload-certs\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.091408 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.091391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-token\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.091547 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.091534    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-envoy\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.091686 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.091673    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-data\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.091818 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.091806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-podinfo\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.092003 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.091988    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-credential-socket\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.092134 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.092122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6blvx\" (UniqueName: \"kubernetes.io/projected/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-kube-api-access-6blvx\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.092274 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.092261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istiod-ca-cert\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.092440 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.092427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-workload-socket\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.193976 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.193940    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-workload-socket\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.193976 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.193987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-workload-certs\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.194218 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.194010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-token\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.194218 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.194044    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-envoy\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.194218 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.194068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-data\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.194218 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.194105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-podinfo\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.194218 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.194193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-credential-socket\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.194472 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.194234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6blvx\" (UniqueName: \"kubernetes.io/projected/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-kube-api-access-6blvx\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.194472 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.194262    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istiod-ca-cert\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.194472 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.194367    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-workload-socket\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.194472 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.194393    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-workload-certs\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.194472 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.194457    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-data\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.194746 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.194589    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-credential-socket\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.195009 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.194989    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istiod-ca-cert\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.196280 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.196259    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-envoy\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.196874 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.196852    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-podinfo\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.202722 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.202699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-token\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.202830 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.202810    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6blvx\" (UniqueName: \"kubernetes.io/projected/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-kube-api-access-6blvx\") pod \"e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") " pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.331330 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.331253    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:20.344525 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.344473    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:20.501658 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.501602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:20.609760 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.609730    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"]
Sep 08 16:36:20.610926 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:36:20.610899    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51e3b5eb_0a5d_44d0_ba24_c3fa1ebf16ed.slice/crio-7ba01ff9f5aa0e7240e6b7bbc7748f3e5177c206876c1cf1e329435295c38417 WatchSource:0}: Error finding container 7ba01ff9f5aa0e7240e6b7bbc7748f3e5177c206876c1cf1e329435295c38417: Status 404 returned error can't find the container with id 7ba01ff9f5aa0e7240e6b7bbc7748f3e5177c206876c1cf1e329435295c38417
Sep 08 16:36:20.613875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.613842    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:36:20.613982 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.613908    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:36:20.613982 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:20.613940    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:36:21.109974 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:21.109934    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69" event={"ID":"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed","Type":"ContainerStarted","Data":"b17312a861b0241dc7dcbe2c058075398a19ba49472ce5f40880f051db5c4ebc"}
Sep 08 16:36:21.110439 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:21.109990    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69" event={"ID":"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed","Type":"ContainerStarted","Data":"7ba01ff9f5aa0e7240e6b7bbc7748f3e5177c206876c1cf1e329435295c38417"}
Sep 08 16:36:21.138979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:21.138923    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69" podStartSLOduration=2.138907718 podStartE2EDuration="2.138907718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:36:21.13573297 +0000 UTC m=+823.720294588" watchObservedRunningTime="2026-09-08 16:36:21.138907718 +0000 UTC m=+823.723469336"
Sep 08 16:36:21.331754 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:21.331721    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:21.336896 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:21.336871    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:22.115798 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:22.115771    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:22.116703 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:22.116681    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:22.535852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:22.535809    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:22.626346 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:22.626305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:23.701322 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:23.701291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:23.811276 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:23.811238    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:23.902087 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:23.902057    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:24.436572 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.436548    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:36:24.442676 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.442646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:24.534222 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.534149    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-podinfo\") pod \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") "
Sep 08 16:36:24.534375 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.534238    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-credential-socket\") pod \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") "
Sep 08 16:36:24.534375 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.534274    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-workload-certs\") pod \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") "
Sep 08 16:36:24.534375 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.534302    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-token\") pod \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") "
Sep 08 16:36:24.534375 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.534325    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istiod-ca-cert\") pod \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") "
Sep 08 16:36:24.534589 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.534392    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-workload-socket\") pod \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") "
Sep 08 16:36:24.534589 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.534445    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gbdh\" (UniqueName: \"kubernetes.io/projected/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-kube-api-access-9gbdh\") pod \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") "
Sep 08 16:36:24.534589 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.534486    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-envoy\") pod \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") "
Sep 08 16:36:24.534589 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.534508    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-data\") pod \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\" (UID: \"712dce1f-e1bf-4a9b-b117-40c498a1d6d7\") "
Sep 08 16:36:24.534589 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.534563    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "712dce1f-e1bf-4a9b-b117-40c498a1d6d7" (UID: "712dce1f-e1bf-4a9b-b117-40c498a1d6d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:24.534877 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.534579    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "712dce1f-e1bf-4a9b-b117-40c498a1d6d7" (UID: "712dce1f-e1bf-4a9b-b117-40c498a1d6d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:24.534877 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.534728    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "712dce1f-e1bf-4a9b-b117-40c498a1d6d7" (UID: "712dce1f-e1bf-4a9b-b117-40c498a1d6d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:36:24.535038 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.534872    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "712dce1f-e1bf-4a9b-b117-40c498a1d6d7" (UID: "712dce1f-e1bf-4a9b-b117-40c498a1d6d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:24.535118 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.535096    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:24.535177 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.535121    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:24.535177 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.535135    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:24.535177 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.535153    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:24.535177 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.535123    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "712dce1f-e1bf-4a9b-b117-40c498a1d6d7" (UID: "712dce1f-e1bf-4a9b-b117-40c498a1d6d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:24.536436 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.536411    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "712dce1f-e1bf-4a9b-b117-40c498a1d6d7" (UID: "712dce1f-e1bf-4a9b-b117-40c498a1d6d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:36:24.536566 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.536543    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "712dce1f-e1bf-4a9b-b117-40c498a1d6d7" (UID: "712dce1f-e1bf-4a9b-b117-40c498a1d6d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:24.536652 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.536557    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "712dce1f-e1bf-4a9b-b117-40c498a1d6d7" (UID: "712dce1f-e1bf-4a9b-b117-40c498a1d6d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:36:24.536652 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.536602    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-kube-api-access-9gbdh" (OuterVolumeSpecName: "kube-api-access-9gbdh") pod "712dce1f-e1bf-4a9b-b117-40c498a1d6d7" (UID: "712dce1f-e1bf-4a9b-b117-40c498a1d6d7"). InnerVolumeSpecName "kube-api-access-9gbdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:36:24.541172 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.541149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:24.636373 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.636343    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gbdh\" (UniqueName: \"kubernetes.io/projected/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-kube-api-access-9gbdh\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:24.636373 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.636370    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:24.636536 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.636381    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:24.636536 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.636389    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:24.636536 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:24.636397    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/712dce1f-e1bf-4a9b-b117-40c498a1d6d7-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:25.133742 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:25.133704    2562 generic.go:356] "Generic (PLEG): container finished" podID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerID="02c2b5eb664d918067828e646082fc52c4ff2c51392fdf731e32f532549ca4a3" exitCode=0
Sep 08 16:36:25.134120 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:25.133770    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"
Sep 08 16:36:25.134120 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:25.133784    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" event={"ID":"712dce1f-e1bf-4a9b-b117-40c498a1d6d7","Type":"ContainerDied","Data":"02c2b5eb664d918067828e646082fc52c4ff2c51392fdf731e32f532549ca4a3"}
Sep 08 16:36:25.134120 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:25.133837    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s" event={"ID":"712dce1f-e1bf-4a9b-b117-40c498a1d6d7","Type":"ContainerDied","Data":"35e431dc677d85deecb180a05f320518c30cf56fba8fe7c8c8dd69fb89739a9d"}
Sep 08 16:36:25.134120 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:25.133860    2562 scope.go:117] "RemoveContainer" containerID="02c2b5eb664d918067828e646082fc52c4ff2c51392fdf731e32f532549ca4a3"
Sep 08 16:36:25.143788 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:25.143762    2562 scope.go:117] "RemoveContainer" containerID="273d9907cd3df6bd2629e449cfe25fbbc603ee56d71260b8c21cad2fa20bd477"
Sep 08 16:36:25.152534 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:25.152516    2562 scope.go:117] "RemoveContainer" containerID="02c2b5eb664d918067828e646082fc52c4ff2c51392fdf731e32f532549ca4a3"
Sep 08 16:36:25.152800 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:36:25.152781    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02c2b5eb664d918067828e646082fc52c4ff2c51392fdf731e32f532549ca4a3\": container with ID starting with 02c2b5eb664d918067828e646082fc52c4ff2c51392fdf731e32f532549ca4a3 not found: ID does not exist" containerID="02c2b5eb664d918067828e646082fc52c4ff2c51392fdf731e32f532549ca4a3"
Sep 08 16:36:25.152881 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:25.152811    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02c2b5eb664d918067828e646082fc52c4ff2c51392fdf731e32f532549ca4a3"} err="failed to get container status \"02c2b5eb664d918067828e646082fc52c4ff2c51392fdf731e32f532549ca4a3\": rpc error: code = NotFound desc = could not find container \"02c2b5eb664d918067828e646082fc52c4ff2c51392fdf731e32f532549ca4a3\": container with ID starting with 02c2b5eb664d918067828e646082fc52c4ff2c51392fdf731e32f532549ca4a3 not found: ID does not exist"
Sep 08 16:36:25.152881 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:25.152835    2562 scope.go:117] "RemoveContainer" containerID="273d9907cd3df6bd2629e449cfe25fbbc603ee56d71260b8c21cad2fa20bd477"
Sep 08 16:36:25.153092 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:36:25.153075    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"273d9907cd3df6bd2629e449cfe25fbbc603ee56d71260b8c21cad2fa20bd477\": container with ID starting with 273d9907cd3df6bd2629e449cfe25fbbc603ee56d71260b8c21cad2fa20bd477 not found: ID does not exist" containerID="273d9907cd3df6bd2629e449cfe25fbbc603ee56d71260b8c21cad2fa20bd477"
Sep 08 16:36:25.153130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:25.153097    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"273d9907cd3df6bd2629e449cfe25fbbc603ee56d71260b8c21cad2fa20bd477"} err="failed to get container status \"273d9907cd3df6bd2629e449cfe25fbbc603ee56d71260b8c21cad2fa20bd477\": rpc error: code = NotFound desc = could not find container \"273d9907cd3df6bd2629e449cfe25fbbc603ee56d71260b8c21cad2fa20bd477\": container with ID starting with 273d9907cd3df6bd2629e449cfe25fbbc603ee56d71260b8c21cad2fa20bd477 not found: ID does not exist"
Sep 08 16:36:25.163748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:25.163727    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"]
Sep 08 16:36:25.166102 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:25.166082    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s"]
Sep 08 16:36:26.006393 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:26.006363    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" path="/var/lib/kubelet/pods/712dce1f-e1bf-4a9b-b117-40c498a1d6d7/volumes"
Sep 08 16:36:30.506451 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:30.506420    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:36:31.882777 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:31.882745    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"]
Sep 08 16:36:31.958499 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:31.958454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:32.014750 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.014720    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs"]
Sep 08 16:36:32.015070 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.015058    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerName="istio-proxy"
Sep 08 16:36:32.015112 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.015072    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerName="istio-proxy"
Sep 08 16:36:32.015112 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.015083    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerName="istio-proxy"
Sep 08 16:36:32.015112 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.015089    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerName="istio-proxy"
Sep 08 16:36:32.015206 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.015149    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerName="istio-proxy"
Sep 08 16:36:32.015206 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.015157    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="712dce1f-e1bf-4a9b-b117-40c498a1d6d7" containerName="istio-proxy"
Sep 08 16:36:32.018966 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.018947    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs"
Sep 08 16:36:32.022313 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.022130    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzslb\""
Sep 08 16:36:32.025398 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.025226    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:36:32.043260 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.043217    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs"]
Sep 08 16:36:32.208273 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.208239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b99f1be-26ca-493f-8182-e6bb697d7047-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-616972-4gwqs\" (UID: \"7b99f1be-26ca-493f-8182-e6bb697d7047\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs"
Sep 08 16:36:32.278704 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.278672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:32.308870 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.308835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b99f1be-26ca-493f-8182-e6bb697d7047-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-616972-4gwqs\" (UID: \"7b99f1be-26ca-493f-8182-e6bb697d7047\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs"
Sep 08 16:36:32.309476 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.309452    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b99f1be-26ca-493f-8182-e6bb697d7047-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-616972-4gwqs\" (UID: \"7b99f1be-26ca-493f-8182-e6bb697d7047\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs"
Sep 08 16:36:32.336175 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.336111    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs"
Sep 08 16:36:32.637795 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:32.637686    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs"]
Sep 08 16:36:32.651391 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:36:32.651354    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b99f1be_26ca_493f_8182_e6bb697d7047.slice/crio-76685bbd6b971c27a7be50fada11222c99cc0e24588451ae1583237af0e848ee WatchSource:0}: Error finding container 76685bbd6b971c27a7be50fada11222c99cc0e24588451ae1583237af0e848ee: Status 404 returned error can't find the container with id 76685bbd6b971c27a7be50fada11222c99cc0e24588451ae1583237af0e848ee
Sep 08 16:36:33.183918 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:33.183879    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs" event={"ID":"7b99f1be-26ca-493f-8182-e6bb697d7047","Type":"ContainerStarted","Data":"55fc0384f4f34466720c8319164df558bc03b930a7124a1004f6aecc854a4cb9"}
Sep 08 16:36:33.184325 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:33.183958    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs" event={"ID":"7b99f1be-26ca-493f-8182-e6bb697d7047","Type":"ContainerStarted","Data":"76685bbd6b971c27a7be50fada11222c99cc0e24588451ae1583237af0e848ee"}
Sep 08 16:36:33.206557 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:33.206465    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs" podStartSLOduration=2.2064507349999998 podStartE2EDuration="2.206450735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:36:33.20418916 +0000 UTC m=+835.788750779" watchObservedRunningTime="2026-09-08 16:36:33.206450735 +0000 UTC m=+835.791012392"
Sep 08 16:36:33.614023 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:33.613990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:33.686856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:33.686820    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:34.191468 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:34.191434    2562 generic.go:356] "Generic (PLEG): container finished" podID="7b99f1be-26ca-493f-8182-e6bb697d7047" containerID="55fc0384f4f34466720c8319164df558bc03b930a7124a1004f6aecc854a4cb9" exitCode=0
Sep 08 16:36:34.191870 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:34.191526    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs" event={"ID":"7b99f1be-26ca-493f-8182-e6bb697d7047","Type":"ContainerDied","Data":"55fc0384f4f34466720c8319164df558bc03b930a7124a1004f6aecc854a4cb9"}
Sep 08 16:36:35.370266 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:35.370242    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs"
Sep 08 16:36:35.447028 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:35.446994    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b99f1be-26ca-493f-8182-e6bb697d7047-maas-api-service-ca\") pod \"7b99f1be-26ca-493f-8182-e6bb697d7047\" (UID: \"7b99f1be-26ca-493f-8182-e6bb697d7047\") "
Sep 08 16:36:35.447304 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:35.447281    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b99f1be-26ca-493f-8182-e6bb697d7047-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7b99f1be-26ca-493f-8182-e6bb697d7047" (UID: "7b99f1be-26ca-493f-8182-e6bb697d7047"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:36:35.548149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:35.548057    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b99f1be-26ca-493f-8182-e6bb697d7047-maas-api-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:36.207958 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:36.207930    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs"
Sep 08 16:36:36.208110 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:36.207930    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs" event={"ID":"7b99f1be-26ca-493f-8182-e6bb697d7047","Type":"ContainerDied","Data":"76685bbd6b971c27a7be50fada11222c99cc0e24588451ae1583237af0e848ee"}
Sep 08 16:36:36.208110 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:36.208058    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76685bbd6b971c27a7be50fada11222c99cc0e24588451ae1583237af0e848ee"
Sep 08 16:36:41.239601 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:41.239568    2562 generic.go:356] "Generic (PLEG): container finished" podID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerID="b17312a861b0241dc7dcbe2c058075398a19ba49472ce5f40880f051db5c4ebc" exitCode=0
Sep 08 16:36:41.240023 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:41.239640    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69" event={"ID":"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed","Type":"ContainerDied","Data":"b17312a861b0241dc7dcbe2c058075398a19ba49472ce5f40880f051db5c4ebc"}
Sep 08 16:36:41.240069 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:41.240035    2562 scope.go:117] "RemoveContainer" containerID="b17312a861b0241dc7dcbe2c058075398a19ba49472ce5f40880f051db5c4ebc"
Sep 08 16:36:41.241099 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:41.241073    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:36:41.241153 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:41.241139    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:36:41.241186 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:41.241171    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:36:42.252136 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:42.252101    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69" event={"ID":"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed","Type":"ContainerStarted","Data":"7808eeceecfd30e2335272bfd29fde7a036605ace0b6e2cf3c82a379581fc844"}
Sep 08 16:36:42.332236 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:42.331780    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:42.332236 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:42.331913    2562 patch_prober.go:28] interesting pod/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 08 16:36:42.332236 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:42.331974    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69" podUID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 08 16:36:42.795196 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:42.795143    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:42.888503 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:42.888466    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:42.971991 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:42.971949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:43.071522 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:43.071442    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs"]
Sep 08 16:36:43.074341 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:43.074314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:43.075442 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:43.075419    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-616972-4gwqs"]
Sep 08 16:36:43.165975 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:43.165940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:43.332790 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:43.332702    2562 patch_prober.go:28] interesting pod/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 08 16:36:43.333301 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:43.333267    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69" podUID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 08 16:36:43.468795 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:43.468758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:44.006081 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:44.006049    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b99f1be-26ca-493f-8182-e6bb697d7047" path="/var/lib/kubelet/pods/7b99f1be-26ca-493f-8182-e6bb697d7047/volumes"
Sep 08 16:36:44.332522 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:44.332429    2562 patch_prober.go:28] interesting pod/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 08 16:36:44.332810 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:44.332781    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69" podUID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 08 16:36:45.332224 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:45.332172    2562 patch_prober.go:28] interesting pod/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 08 16:36:45.332431 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:45.332263    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69" podUID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 08 16:36:46.301513 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:46.301478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:46.332408 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:46.331972    2562 patch_prober.go:28] interesting pod/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 08 16:36:46.332408 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:46.332038    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69" podUID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 08 16:36:46.902053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:46.902015    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz" podUID="a86c56a4-e459-4619-9e4a-61122a3a43ab" containerName="main" containerID="cri-o://238d371493bad28c2b6f7cbc5772a27a2e466113f12d21cf0c8cbe13e9f91577" gracePeriod=45
Sep 08 16:36:47.179008 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.178979    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:47.266266 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.266235    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a86c56a4-e459-4619-9e4a-61122a3a43ab-tls-certs\") pod \"a86c56a4-e459-4619-9e4a-61122a3a43ab\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") "
Sep 08 16:36:47.266456 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.266271    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sk579\" (UniqueName: \"kubernetes.io/projected/a86c56a4-e459-4619-9e4a-61122a3a43ab-kube-api-access-sk579\") pod \"a86c56a4-e459-4619-9e4a-61122a3a43ab\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") "
Sep 08 16:36:47.266456 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.266325    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-tmp-dir\") pod \"a86c56a4-e459-4619-9e4a-61122a3a43ab\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") "
Sep 08 16:36:47.266456 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.266374    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-model-cache\") pod \"a86c56a4-e459-4619-9e4a-61122a3a43ab\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") "
Sep 08 16:36:47.266658 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.266508    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-dshm\") pod \"a86c56a4-e459-4619-9e4a-61122a3a43ab\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") "
Sep 08 16:36:47.266658 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.266628    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-home\") pod \"a86c56a4-e459-4619-9e4a-61122a3a43ab\" (UID: \"a86c56a4-e459-4619-9e4a-61122a3a43ab\") "
Sep 08 16:36:47.266852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.266685    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-model-cache" (OuterVolumeSpecName: "model-cache") pod "a86c56a4-e459-4619-9e4a-61122a3a43ab" (UID: "a86c56a4-e459-4619-9e4a-61122a3a43ab"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:47.266852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.266797    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-home" (OuterVolumeSpecName: "home") pod "a86c56a4-e459-4619-9e4a-61122a3a43ab" (UID: "a86c56a4-e459-4619-9e4a-61122a3a43ab"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:47.267022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.266998    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a86c56a4-e459-4619-9e4a-61122a3a43ab" (UID: "a86c56a4-e459-4619-9e4a-61122a3a43ab"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:47.267085 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.267021    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:47.267085 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.267040    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:47.268682 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.268658    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a86c56a4-e459-4619-9e4a-61122a3a43ab-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a86c56a4-e459-4619-9e4a-61122a3a43ab" (UID: "a86c56a4-e459-4619-9e4a-61122a3a43ab"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:36:47.268793 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.268718    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a86c56a4-e459-4619-9e4a-61122a3a43ab-kube-api-access-sk579" (OuterVolumeSpecName: "kube-api-access-sk579") pod "a86c56a4-e459-4619-9e4a-61122a3a43ab" (UID: "a86c56a4-e459-4619-9e4a-61122a3a43ab"). InnerVolumeSpecName "kube-api-access-sk579". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:36:47.268982 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.268968    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-dshm" (OuterVolumeSpecName: "dshm") pod "a86c56a4-e459-4619-9e4a-61122a3a43ab" (UID: "a86c56a4-e459-4619-9e4a-61122a3a43ab"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:47.287043 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.287002    2562 generic.go:356] "Generic (PLEG): container finished" podID="a86c56a4-e459-4619-9e4a-61122a3a43ab" containerID="238d371493bad28c2b6f7cbc5772a27a2e466113f12d21cf0c8cbe13e9f91577" exitCode=0
Sep 08 16:36:47.287166 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.287085    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"
Sep 08 16:36:47.287242 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.287209    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz" event={"ID":"a86c56a4-e459-4619-9e4a-61122a3a43ab","Type":"ContainerDied","Data":"238d371493bad28c2b6f7cbc5772a27a2e466113f12d21cf0c8cbe13e9f91577"}
Sep 08 16:36:47.287298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.287247    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz" event={"ID":"a86c56a4-e459-4619-9e4a-61122a3a43ab","Type":"ContainerDied","Data":"0fe95f9df5ee077324145622c5c5c9b78b72ce24d1b8774333d351cd25aacab9"}
Sep 08 16:36:47.287298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.287267    2562 scope.go:117] "RemoveContainer" containerID="238d371493bad28c2b6f7cbc5772a27a2e466113f12d21cf0c8cbe13e9f91577"
Sep 08 16:36:47.298716 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.298694    2562 scope.go:117] "RemoveContainer" containerID="238d371493bad28c2b6f7cbc5772a27a2e466113f12d21cf0c8cbe13e9f91577"
Sep 08 16:36:47.299031 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:36:47.299007    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"238d371493bad28c2b6f7cbc5772a27a2e466113f12d21cf0c8cbe13e9f91577\": container with ID starting with 238d371493bad28c2b6f7cbc5772a27a2e466113f12d21cf0c8cbe13e9f91577 not found: ID does not exist" containerID="238d371493bad28c2b6f7cbc5772a27a2e466113f12d21cf0c8cbe13e9f91577"
Sep 08 16:36:47.299120 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.299044    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238d371493bad28c2b6f7cbc5772a27a2e466113f12d21cf0c8cbe13e9f91577"} err="failed to get container status \"238d371493bad28c2b6f7cbc5772a27a2e466113f12d21cf0c8cbe13e9f91577\": rpc error: code = NotFound desc = could not find container \"238d371493bad28c2b6f7cbc5772a27a2e466113f12d21cf0c8cbe13e9f91577\": container with ID starting with 238d371493bad28c2b6f7cbc5772a27a2e466113f12d21cf0c8cbe13e9f91577 not found: ID does not exist"
Sep 08 16:36:47.317163 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.317138    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"]
Sep 08 16:36:47.321728 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.321707    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-616972/autores-model-616972-kserve-574f5bd45f-nqzsz"]
Sep 08 16:36:47.368490 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.368451    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a86c56a4-e459-4619-9e4a-61122a3a43ab-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:47.368490 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.368489    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk579\" (UniqueName: \"kubernetes.io/projected/a86c56a4-e459-4619-9e4a-61122a3a43ab-kube-api-access-sk579\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:47.368725 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.368504    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:47.368725 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.368518    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a86c56a4-e459-4619-9e4a-61122a3a43ab-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:47.446946 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.446907    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:47.447370 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.447343    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:47.449086 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.449036    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:36:47.471718 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:47.471688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:48.006016 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:48.005984    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a86c56a4-e459-4619-9e4a-61122a3a43ab" path="/var/lib/kubelet/pods/a86c56a4-e459-4619-9e4a-61122a3a43ab/volumes"
Sep 08 16:36:48.573762 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:48.573730    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:49.072576 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:49.072544    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"]
Sep 08 16:36:49.100735 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:49.100705    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:50.033321 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:50.033285    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:36:50.741186 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:50.741151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:50.840371 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:50.840334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:51.025688 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.024139    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"]
Sep 08 16:36:51.025688 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.024448    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerName="istio-proxy" containerID="cri-o://a93d8eb019bf51ced34371ad31bb3c69e14d98f1f567ebf14a1418aefbe450c5" gracePeriod=30
Sep 08 16:36:51.061091 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.061047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:51.528856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.528816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:51.897399 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.897310    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"]
Sep 08 16:36:51.897792 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.897773    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a86c56a4-e459-4619-9e4a-61122a3a43ab" containerName="main"
Sep 08 16:36:51.897895 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.897795    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a86c56a4-e459-4619-9e4a-61122a3a43ab" containerName="main"
Sep 08 16:36:51.897895 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.897819    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b99f1be-26ca-493f-8182-e6bb697d7047" containerName="revoke-keys"
Sep 08 16:36:51.897895 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.897828    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b99f1be-26ca-493f-8182-e6bb697d7047" containerName="revoke-keys"
Sep 08 16:36:51.898053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.897918    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a86c56a4-e459-4619-9e4a-61122a3a43ab" containerName="main"
Sep 08 16:36:51.898053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.897930    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b99f1be-26ca-493f-8182-e6bb697d7047" containerName="revoke-keys"
Sep 08 16:36:51.900653 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.900634    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:51.903563 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.903544    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-384f4f-openshift-default-dockercfg-kfzbs\""
Sep 08 16:36:51.934533 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:51.934493    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"]
Sep 08 16:36:52.012472 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.012431    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-token\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.012695 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.012488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-data\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.012695 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.012523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-workload-socket\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.012695 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.012552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvn77\" (UniqueName: \"kubernetes.io/projected/2c023d74-bdb5-490b-a18e-e87552f4d653-kube-api-access-wvn77\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.012695 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.012589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-credential-socket\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.012695 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.012644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-podinfo\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.012695 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.012686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-envoy\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.013046 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.012720    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-workload-certs\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.013046 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.012766    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c023d74-bdb5-490b-a18e-e87552f4d653-istiod-ca-cert\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.032267 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.032229    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:52.113651 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.113589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-data\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.113651 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.113652    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-workload-socket\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.114149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.113671    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvn77\" (UniqueName: \"kubernetes.io/projected/2c023d74-bdb5-490b-a18e-e87552f4d653-kube-api-access-wvn77\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.114149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.113699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-credential-socket\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.114149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.113724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-podinfo\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.114149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.113777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-envoy\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.114149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.113810    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-workload-certs\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.114149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.113853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c023d74-bdb5-490b-a18e-e87552f4d653-istiod-ca-cert\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.114149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.113960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-token\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.114149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.114019    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-data\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.114149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.114087    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-credential-socket\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.114149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.114101    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-workload-socket\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.114535 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.114264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-workload-certs\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.114576 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.114545    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c023d74-bdb5-490b-a18e-e87552f4d653-istiod-ca-cert\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.116075 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.116055    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-envoy\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.116351 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.116329    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-podinfo\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.123304 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.123276    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-token\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.124599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.124578    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvn77\" (UniqueName: \"kubernetes.io/projected/2c023d74-bdb5-490b-a18e-e87552f4d653-kube-api-access-wvn77\") pod \"e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") " pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.160422 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.160336    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:52.213634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.213561    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:52.489578 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.489551    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"]
Sep 08 16:36:52.496008 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.495969    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:36:52.496099 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.496061    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:36:52.496139 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:52.496104    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:36:53.321769 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:53.321730    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln" event={"ID":"2c023d74-bdb5-490b-a18e-e87552f4d653","Type":"ContainerStarted","Data":"1ad8ba68cc698afa7e64081027f355a45f863e630d1e3f22aee12df924c64d95"}
Sep 08 16:36:53.322160 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:53.321795    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln" event={"ID":"2c023d74-bdb5-490b-a18e-e87552f4d653","Type":"ContainerStarted","Data":"c83493823798c282cc28f5c58f6d59c4b4ddecc0951348095f2b4b933138cbcb"}
Sep 08 16:36:53.344062 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:53.344012    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln" podStartSLOduration=2.343997477 podStartE2EDuration="2.343997477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:36:53.341737469 +0000 UTC m=+855.926299088" watchObservedRunningTime="2026-09-08 16:36:53.343997477 +0000 UTC m=+855.928559096"
Sep 08 16:36:54.214460 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:54.214424    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:54.219054 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:54.219030    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:54.333335 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:54.333298    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:54.334297 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:54.334278    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:36:55.303997 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:55.303958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:55.401574 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:55.401535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:56.266549 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.266524    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:36:56.346273 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.346205    2562 generic.go:356] "Generic (PLEG): container finished" podID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerID="a93d8eb019bf51ced34371ad31bb3c69e14d98f1f567ebf14a1418aefbe450c5" exitCode=0
Sep 08 16:36:56.346273 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.346252    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"
Sep 08 16:36:56.346454 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.346296    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" event={"ID":"641becdc-04cd-4d0f-827e-5f1a61e996b2","Type":"ContainerDied","Data":"a93d8eb019bf51ced34371ad31bb3c69e14d98f1f567ebf14a1418aefbe450c5"}
Sep 08 16:36:56.346454 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.346352    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd" event={"ID":"641becdc-04cd-4d0f-827e-5f1a61e996b2","Type":"ContainerDied","Data":"feba5a434c5bd56c9c123f8da14648f38378500aa9cd5431c13714f3610097c7"}
Sep 08 16:36:56.346454 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.346385    2562 scope.go:117] "RemoveContainer" containerID="a93d8eb019bf51ced34371ad31bb3c69e14d98f1f567ebf14a1418aefbe450c5"
Sep 08 16:36:56.355408 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.355389    2562 scope.go:117] "RemoveContainer" containerID="b7586e3e03b74148421348181c0f44c4a4b0ca80fa4e0f639a8175f440f118f7"
Sep 08 16:36:56.357431 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.357413    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-credential-socket\") pod \"641becdc-04cd-4d0f-827e-5f1a61e996b2\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") "
Sep 08 16:36:56.357516 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.357452    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-workload-certs\") pod \"641becdc-04cd-4d0f-827e-5f1a61e996b2\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") "
Sep 08 16:36:56.357516 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.357484    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/641becdc-04cd-4d0f-827e-5f1a61e996b2-istiod-ca-cert\") pod \"641becdc-04cd-4d0f-827e-5f1a61e996b2\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") "
Sep 08 16:36:56.357599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.357516    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-token\") pod \"641becdc-04cd-4d0f-827e-5f1a61e996b2\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") "
Sep 08 16:36:56.357599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.357556    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-podinfo\") pod \"641becdc-04cd-4d0f-827e-5f1a61e996b2\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") "
Sep 08 16:36:56.357768 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.357642    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knlsn\" (UniqueName: \"kubernetes.io/projected/641becdc-04cd-4d0f-827e-5f1a61e996b2-kube-api-access-knlsn\") pod \"641becdc-04cd-4d0f-827e-5f1a61e996b2\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") "
Sep 08 16:36:56.357768 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.357711    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-envoy\") pod \"641becdc-04cd-4d0f-827e-5f1a61e996b2\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") "
Sep 08 16:36:56.357768 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.357735    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "641becdc-04cd-4d0f-827e-5f1a61e996b2" (UID: "641becdc-04cd-4d0f-827e-5f1a61e996b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:56.357768 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.357765    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-workload-socket\") pod \"641becdc-04cd-4d0f-827e-5f1a61e996b2\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") "
Sep 08 16:36:56.357989 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.357800    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-data\") pod \"641becdc-04cd-4d0f-827e-5f1a61e996b2\" (UID: \"641becdc-04cd-4d0f-827e-5f1a61e996b2\") "
Sep 08 16:36:56.358046 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.357998    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/641becdc-04cd-4d0f-827e-5f1a61e996b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "641becdc-04cd-4d0f-827e-5f1a61e996b2" (UID: "641becdc-04cd-4d0f-827e-5f1a61e996b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:36:56.358100 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.358049    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "641becdc-04cd-4d0f-827e-5f1a61e996b2" (UID: "641becdc-04cd-4d0f-827e-5f1a61e996b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:56.358272 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.358244    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "641becdc-04cd-4d0f-827e-5f1a61e996b2" (UID: "641becdc-04cd-4d0f-827e-5f1a61e996b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:56.358342 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.358258    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "641becdc-04cd-4d0f-827e-5f1a61e996b2" (UID: "641becdc-04cd-4d0f-827e-5f1a61e996b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:56.358342 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.358254    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:56.358342 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.358302    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:56.358342 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.358317    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/641becdc-04cd-4d0f-827e-5f1a61e996b2-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:56.359854 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.359823    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "641becdc-04cd-4d0f-827e-5f1a61e996b2" (UID: "641becdc-04cd-4d0f-827e-5f1a61e996b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:36:56.360071 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.360047    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/641becdc-04cd-4d0f-827e-5f1a61e996b2-kube-api-access-knlsn" (OuterVolumeSpecName: "kube-api-access-knlsn") pod "641becdc-04cd-4d0f-827e-5f1a61e996b2" (UID: "641becdc-04cd-4d0f-827e-5f1a61e996b2"). InnerVolumeSpecName "kube-api-access-knlsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:36:56.360195 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.360094    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "641becdc-04cd-4d0f-827e-5f1a61e996b2" (UID: "641becdc-04cd-4d0f-827e-5f1a61e996b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:36:56.360453 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.360434    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "641becdc-04cd-4d0f-827e-5f1a61e996b2" (UID: "641becdc-04cd-4d0f-827e-5f1a61e996b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:56.363983 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.363964    2562 scope.go:117] "RemoveContainer" containerID="a93d8eb019bf51ced34371ad31bb3c69e14d98f1f567ebf14a1418aefbe450c5"
Sep 08 16:36:56.364256 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:36:56.364235    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a93d8eb019bf51ced34371ad31bb3c69e14d98f1f567ebf14a1418aefbe450c5\": container with ID starting with a93d8eb019bf51ced34371ad31bb3c69e14d98f1f567ebf14a1418aefbe450c5 not found: ID does not exist" containerID="a93d8eb019bf51ced34371ad31bb3c69e14d98f1f567ebf14a1418aefbe450c5"
Sep 08 16:36:56.364325 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.364265    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a93d8eb019bf51ced34371ad31bb3c69e14d98f1f567ebf14a1418aefbe450c5"} err="failed to get container status \"a93d8eb019bf51ced34371ad31bb3c69e14d98f1f567ebf14a1418aefbe450c5\": rpc error: code = NotFound desc = could not find container \"a93d8eb019bf51ced34371ad31bb3c69e14d98f1f567ebf14a1418aefbe450c5\": container with ID starting with a93d8eb019bf51ced34371ad31bb3c69e14d98f1f567ebf14a1418aefbe450c5 not found: ID does not exist"
Sep 08 16:36:56.364325 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.364284    2562 scope.go:117] "RemoveContainer" containerID="b7586e3e03b74148421348181c0f44c4a4b0ca80fa4e0f639a8175f440f118f7"
Sep 08 16:36:56.364544 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:36:56.364527    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7586e3e03b74148421348181c0f44c4a4b0ca80fa4e0f639a8175f440f118f7\": container with ID starting with b7586e3e03b74148421348181c0f44c4a4b0ca80fa4e0f639a8175f440f118f7 not found: ID does not exist" containerID="b7586e3e03b74148421348181c0f44c4a4b0ca80fa4e0f639a8175f440f118f7"
Sep 08 16:36:56.364624 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.364549    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7586e3e03b74148421348181c0f44c4a4b0ca80fa4e0f639a8175f440f118f7"} err="failed to get container status \"b7586e3e03b74148421348181c0f44c4a4b0ca80fa4e0f639a8175f440f118f7\": rpc error: code = NotFound desc = could not find container \"b7586e3e03b74148421348181c0f44c4a4b0ca80fa4e0f639a8175f440f118f7\": container with ID starting with b7586e3e03b74148421348181c0f44c4a4b0ca80fa4e0f639a8175f440f118f7 not found: ID does not exist"
Sep 08 16:36:56.459562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.459520    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:56.459562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.459557    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:56.459562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.459571    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:56.460053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.459586    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:56.460053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.459598    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/641becdc-04cd-4d0f-827e-5f1a61e996b2-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:56.460053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.459635    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knlsn\" (UniqueName: \"kubernetes.io/projected/641becdc-04cd-4d0f-827e-5f1a61e996b2-kube-api-access-knlsn\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:36:56.676767 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.676733    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"]
Sep 08 16:36:56.681890 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.681863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:56.687802 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.687780    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd"]
Sep 08 16:36:56.769498 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.769465    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:56.972054 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:56.972017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:57.297835 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:57.297755    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:57.431158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:57.431120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:58.005618 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:36:58.005576    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" path="/var/lib/kubelet/pods/641becdc-04cd-4d0f-827e-5f1a61e996b2/volumes"
Sep 08 16:37:03.961076 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:03.961036    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:04.091986 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.091927    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm" podUID="f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a" containerName="main" containerID="cri-o://39a27964802d6692440fb5e5eb134ca37cae220a3f81d85a663436dbd42e6324" gracePeriod=45
Sep 08 16:37:04.346279 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.346250    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:37:04.399562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.399524    2562 generic.go:356] "Generic (PLEG): container finished" podID="f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a" containerID="39a27964802d6692440fb5e5eb134ca37cae220a3f81d85a663436dbd42e6324" exitCode=0
Sep 08 16:37:04.399747 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.399567    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"
Sep 08 16:37:04.399747 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.399634    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm" event={"ID":"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a","Type":"ContainerDied","Data":"39a27964802d6692440fb5e5eb134ca37cae220a3f81d85a663436dbd42e6324"}
Sep 08 16:37:04.399747 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.399685    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm" event={"ID":"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a","Type":"ContainerDied","Data":"87ba78d64d1ae8b76c76fcc892f8732e7fbf57b5ba026032272e0524814ce0ab"}
Sep 08 16:37:04.399747 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.399709    2562 scope.go:117] "RemoveContainer" containerID="39a27964802d6692440fb5e5eb134ca37cae220a3f81d85a663436dbd42e6324"
Sep 08 16:37:04.408603 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.408584    2562 scope.go:117] "RemoveContainer" containerID="39a27964802d6692440fb5e5eb134ca37cae220a3f81d85a663436dbd42e6324"
Sep 08 16:37:04.408894 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:37:04.408878    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39a27964802d6692440fb5e5eb134ca37cae220a3f81d85a663436dbd42e6324\": container with ID starting with 39a27964802d6692440fb5e5eb134ca37cae220a3f81d85a663436dbd42e6324 not found: ID does not exist" containerID="39a27964802d6692440fb5e5eb134ca37cae220a3f81d85a663436dbd42e6324"
Sep 08 16:37:04.408950 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.408901    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a27964802d6692440fb5e5eb134ca37cae220a3f81d85a663436dbd42e6324"} err="failed to get container status \"39a27964802d6692440fb5e5eb134ca37cae220a3f81d85a663436dbd42e6324\": rpc error: code = NotFound desc = could not find container \"39a27964802d6692440fb5e5eb134ca37cae220a3f81d85a663436dbd42e6324\": container with ID starting with 39a27964802d6692440fb5e5eb134ca37cae220a3f81d85a663436dbd42e6324 not found: ID does not exist"
Sep 08 16:37:04.534446 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.534372    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-home\") pod \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") "
Sep 08 16:37:04.534446 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.534412    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-dshm\") pod \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") "
Sep 08 16:37:04.534641 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.534458    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-tmp-dir\") pod \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") "
Sep 08 16:37:04.534641 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.534585    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-tls-certs\") pod \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") "
Sep 08 16:37:04.534765 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.534642    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-model-cache\") pod \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") "
Sep 08 16:37:04.534765 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.534685    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psvkp\" (UniqueName: \"kubernetes.io/projected/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-kube-api-access-psvkp\") pod \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\" (UID: \"f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a\") "
Sep 08 16:37:04.534765 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.534690    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-home" (OuterVolumeSpecName: "home") pod "f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a" (UID: "f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:04.534916 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.534842    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a" (UID: "f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:04.534960 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.534914    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-model-cache" (OuterVolumeSpecName: "model-cache") pod "f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a" (UID: "f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:04.535088 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.535048    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:04.535088 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.535067    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:04.535088 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.535075    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:04.536679 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.536659    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-dshm" (OuterVolumeSpecName: "dshm") pod "f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a" (UID: "f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:04.536808 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.536785    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a" (UID: "f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:37:04.536931 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.536910    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-kube-api-access-psvkp" (OuterVolumeSpecName: "kube-api-access-psvkp") pod "f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a" (UID: "f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a"). InnerVolumeSpecName "kube-api-access-psvkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:37:04.604952 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.604908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:04.636343 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.636310    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:04.636343 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.636347    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psvkp\" (UniqueName: \"kubernetes.io/projected/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-kube-api-access-psvkp\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:04.636513 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.636361    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:04.721905 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.721873    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"]
Sep 08 16:37:04.725109 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.725087    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-04ecbe44-kserve-7467fc8db-dmlbm"]
Sep 08 16:37:04.814875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.814783    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:04.911520 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:04.911488    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:05.987940 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:05.987905    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"]
Sep 08 16:37:05.988308 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:05.988170    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69" podUID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerName="istio-proxy" containerID="cri-o://7808eeceecfd30e2335272bfd29fde7a036605ace0b6e2cf3c82a379581fc844" gracePeriod=30
Sep 08 16:37:06.006510 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.006481    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a" path="/var/lib/kubelet/pods/f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a/volumes"
Sep 08 16:37:06.009953 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.009925    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:06.444223 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.444178    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:06.736035 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.735961    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"]
Sep 08 16:37:06.736371 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.736357    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerName="istio-proxy"
Sep 08 16:37:06.736428 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.736374    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerName="istio-proxy"
Sep 08 16:37:06.736428 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.736385    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a" containerName="main"
Sep 08 16:37:06.736428 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.736390    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a" containerName="main"
Sep 08 16:37:06.736428 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.736397    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerName="istio-proxy"
Sep 08 16:37:06.736428 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.736402    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerName="istio-proxy"
Sep 08 16:37:06.736649 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.736471    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9c5d225-ad9d-4d74-b0c5-9a52e09b0f1a" containerName="main"
Sep 08 16:37:06.736649 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.736485    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerName="istio-proxy"
Sep 08 16:37:06.736649 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.736493    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="641becdc-04cd-4d0f-827e-5f1a61e996b2" containerName="istio-proxy"
Sep 08 16:37:06.741165 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.741140    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.743815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.743794    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2fb1f7b7-openshift-default-dockercfg-sn4zd\""
Sep 08 16:37:06.752583 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.752562    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"]
Sep 08 16:37:06.758836 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.758803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-istio-data\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.758941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.758843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-workload-certs\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.758941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.758894    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94d4c570-2840-4765-a653-024f2b30a7e8-istio-podinfo\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.758941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.758920    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-credential-socket\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.759045 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.758963    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94d4c570-2840-4765-a653-024f2b30a7e8-istiod-ca-cert\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.759045 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.758992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxp4w\" (UniqueName: \"kubernetes.io/projected/94d4c570-2840-4765-a653-024f2b30a7e8-kube-api-access-xxp4w\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.759117 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.759093    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94d4c570-2840-4765-a653-024f2b30a7e8-istio-token\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.759165 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.759149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-istio-envoy\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.759200 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.759180    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-workload-socket\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.816470 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.816439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:06.860733 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.860690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-credential-socket\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.860982 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.860755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94d4c570-2840-4765-a653-024f2b30a7e8-istiod-ca-cert\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.860982 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.860796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxp4w\" (UniqueName: \"kubernetes.io/projected/94d4c570-2840-4765-a653-024f2b30a7e8-kube-api-access-xxp4w\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.860982 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.860853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94d4c570-2840-4765-a653-024f2b30a7e8-istio-token\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.860982 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.860892    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-istio-envoy\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.860982 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.860916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-workload-socket\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.860982 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.860963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-istio-data\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.861465 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.860988    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-workload-certs\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.861465 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.861029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94d4c570-2840-4765-a653-024f2b30a7e8-istio-podinfo\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.862131 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.862049    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-workload-socket\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.862131 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.862055    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-istio-data\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.862324 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.862147    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-credential-socket\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.862324 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.862283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94d4c570-2840-4765-a653-024f2b30a7e8-istiod-ca-cert\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.862647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.862624    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-workload-certs\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.865076 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.865035    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-istio-envoy\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.865177 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.865096    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94d4c570-2840-4765-a653-024f2b30a7e8-istio-podinfo\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.869537 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.869513    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94d4c570-2840-4765-a653-024f2b30a7e8-istio-token\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:06.869885 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:06.869864    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxp4w\" (UniqueName: \"kubernetes.io/projected/94d4c570-2840-4765-a653-024f2b30a7e8-kube-api-access-xxp4w\") pod \"e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") " pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:07.031203 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:07.031117    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:07.052980 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:07.052959    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:07.334557 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:07.334530    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"]
Sep 08 16:37:07.338078 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:37:07.337970    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d4c570_2840_4765_a653_024f2b30a7e8.slice/crio-ec64f467f1c3b05031e02db96ba180f386131cf3437497e07d4741067fae1219 WatchSource:0}: Error finding container ec64f467f1c3b05031e02db96ba180f386131cf3437497e07d4741067fae1219: Status 404 returned error can't find the container with id ec64f467f1c3b05031e02db96ba180f386131cf3437497e07d4741067fae1219
Sep 08 16:37:07.340020 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:07.339986    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:37:07.340107 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:07.340068    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:37:07.340143 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:07.340105    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:37:07.405784 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:07.405757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:07.420761 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:07.420729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt" event={"ID":"94d4c570-2840-4765-a653-024f2b30a7e8","Type":"ContainerStarted","Data":"ce3c6c65ede40fe81143caf95eae0fa94607a063ac8e15f7abc13b1bcff29a49"}
Sep 08 16:37:07.420905 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:07.420792    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt" event={"ID":"94d4c570-2840-4765-a653-024f2b30a7e8","Type":"ContainerStarted","Data":"ec64f467f1c3b05031e02db96ba180f386131cf3437497e07d4741067fae1219"}
Sep 08 16:37:07.444043 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:07.443995    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt" podStartSLOduration=1.4439791180000001 podStartE2EDuration="1.443979118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:37:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:37:07.441322514 +0000 UTC m=+870.025884133" watchObservedRunningTime="2026-09-08 16:37:07.443979118 +0000 UTC m=+870.028540788"
Sep 08 16:37:07.811311 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:07.811275    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:37:08.053677 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:08.053647    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:08.058720 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:08.058697    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:08.426622 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:08.426590    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:08.427957 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:08.427940    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:08.871506 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:08.871460    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:08.961191 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:08.961149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:10.112645 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:10.112594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:10.228480 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:10.228439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:10.372149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:10.372052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:10.790025 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:10.789992    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:10.926465 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:10.926432    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:11.275991 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.275968    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:37:11.313918 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.313889    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-token\") pod \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") "
Sep 08 16:37:11.314088 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.313924    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-podinfo\") pod \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") "
Sep 08 16:37:11.314088 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.313947    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-workload-socket\") pod \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") "
Sep 08 16:37:11.314088 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.313977    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-credential-socket\") pod \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") "
Sep 08 16:37:11.314088 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314012    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-data\") pod \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") "
Sep 08 16:37:11.314088 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314063    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istiod-ca-cert\") pod \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") "
Sep 08 16:37:11.314362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314090    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-envoy\") pod \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") "
Sep 08 16:37:11.314362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314177    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6blvx\" (UniqueName: \"kubernetes.io/projected/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-kube-api-access-6blvx\") pod \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") "
Sep 08 16:37:11.314362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314239    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-workload-certs\") pod \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\" (UID: \"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed\") "
Sep 08 16:37:11.314362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314289    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" (UID: "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:11.314362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314338    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" (UID: "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:11.314653 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314353    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" (UID: "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:11.314653 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314566    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" (UID: "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:11.314777 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314665    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" (UID: "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:37:11.314777 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314684    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:11.314777 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314703    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:11.314777 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314716    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:11.314777 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.314728    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:11.316062 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.316038    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" (UID: "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:37:11.316312 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.316293    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-kube-api-access-6blvx" (OuterVolumeSpecName: "kube-api-access-6blvx") pod "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" (UID: "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed"). InnerVolumeSpecName "kube-api-access-6blvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:37:11.316487 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.316469    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" (UID: "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:37:11.316648 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.316593    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" (UID: "51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:11.415852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.415772    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:11.415852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.415799    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:11.415852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.415809    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:11.415852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.415818    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:11.415852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.415826    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6blvx\" (UniqueName: \"kubernetes.io/projected/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed-kube-api-access-6blvx\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:11.452280 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.452247    2562 generic.go:356] "Generic (PLEG): container finished" podID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerID="7808eeceecfd30e2335272bfd29fde7a036605ace0b6e2cf3c82a379581fc844" exitCode=0
Sep 08 16:37:11.452420 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.452299    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"
Sep 08 16:37:11.452420 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.452331    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69" event={"ID":"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed","Type":"ContainerDied","Data":"7808eeceecfd30e2335272bfd29fde7a036605ace0b6e2cf3c82a379581fc844"}
Sep 08 16:37:11.452420 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.452384    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69" event={"ID":"51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed","Type":"ContainerDied","Data":"7ba01ff9f5aa0e7240e6b7bbc7748f3e5177c206876c1cf1e329435295c38417"}
Sep 08 16:37:11.452420 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.452406    2562 scope.go:117] "RemoveContainer" containerID="7808eeceecfd30e2335272bfd29fde7a036605ace0b6e2cf3c82a379581fc844"
Sep 08 16:37:11.462027 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.462011    2562 scope.go:117] "RemoveContainer" containerID="b17312a861b0241dc7dcbe2c058075398a19ba49472ce5f40880f051db5c4ebc"
Sep 08 16:37:11.470001 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.469983    2562 scope.go:117] "RemoveContainer" containerID="7808eeceecfd30e2335272bfd29fde7a036605ace0b6e2cf3c82a379581fc844"
Sep 08 16:37:11.470247 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:37:11.470226    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7808eeceecfd30e2335272bfd29fde7a036605ace0b6e2cf3c82a379581fc844\": container with ID starting with 7808eeceecfd30e2335272bfd29fde7a036605ace0b6e2cf3c82a379581fc844 not found: ID does not exist" containerID="7808eeceecfd30e2335272bfd29fde7a036605ace0b6e2cf3c82a379581fc844"
Sep 08 16:37:11.470320 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.470259    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7808eeceecfd30e2335272bfd29fde7a036605ace0b6e2cf3c82a379581fc844"} err="failed to get container status \"7808eeceecfd30e2335272bfd29fde7a036605ace0b6e2cf3c82a379581fc844\": rpc error: code = NotFound desc = could not find container \"7808eeceecfd30e2335272bfd29fde7a036605ace0b6e2cf3c82a379581fc844\": container with ID starting with 7808eeceecfd30e2335272bfd29fde7a036605ace0b6e2cf3c82a379581fc844 not found: ID does not exist"
Sep 08 16:37:11.470320 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.470284    2562 scope.go:117] "RemoveContainer" containerID="b17312a861b0241dc7dcbe2c058075398a19ba49472ce5f40880f051db5c4ebc"
Sep 08 16:37:11.470549 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:37:11.470531    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b17312a861b0241dc7dcbe2c058075398a19ba49472ce5f40880f051db5c4ebc\": container with ID starting with b17312a861b0241dc7dcbe2c058075398a19ba49472ce5f40880f051db5c4ebc not found: ID does not exist" containerID="b17312a861b0241dc7dcbe2c058075398a19ba49472ce5f40880f051db5c4ebc"
Sep 08 16:37:11.470599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.470556    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b17312a861b0241dc7dcbe2c058075398a19ba49472ce5f40880f051db5c4ebc"} err="failed to get container status \"b17312a861b0241dc7dcbe2c058075398a19ba49472ce5f40880f051db5c4ebc\": rpc error: code = NotFound desc = could not find container \"b17312a861b0241dc7dcbe2c058075398a19ba49472ce5f40880f051db5c4ebc\": container with ID starting with b17312a861b0241dc7dcbe2c058075398a19ba49472ce5f40880f051db5c4ebc not found: ID does not exist"
Sep 08 16:37:11.475798 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.475779    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"]
Sep 08 16:37:11.480262 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:11.480243    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69"]
Sep 08 16:37:12.010469 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:12.010432    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" path="/var/lib/kubelet/pods/51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed/volumes"
Sep 08 16:37:17.952040 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:17.952006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:18.665566 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:18.665527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:18.765866 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:18.765824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:19.504668 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:19.504636    2562 generic.go:356] "Generic (PLEG): container finished" podID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerID="1ad8ba68cc698afa7e64081027f355a45f863e630d1e3f22aee12df924c64d95" exitCode=0
Sep 08 16:37:19.505145 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:19.504641    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln" event={"ID":"2c023d74-bdb5-490b-a18e-e87552f4d653","Type":"ContainerDied","Data":"1ad8ba68cc698afa7e64081027f355a45f863e630d1e3f22aee12df924c64d95"}
Sep 08 16:37:19.505145 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:19.505121    2562 scope.go:117] "RemoveContainer" containerID="1ad8ba68cc698afa7e64081027f355a45f863e630d1e3f22aee12df924c64d95"
Sep 08 16:37:19.506190 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:19.506165    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:37:19.506245 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:19.506232    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:37:19.506286 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:19.506268    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:37:20.297247 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:20.297212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:20.513089 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:20.513049    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln" event={"ID":"2c023d74-bdb5-490b-a18e-e87552f4d653","Type":"ContainerStarted","Data":"ac42c426a5fe24e1eedb67b4e210813b73698ced66ff3607b730ace9859f2756"}
Sep 08 16:37:21.213816 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:21.213774    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:37:21.214760 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:21.214736    2562 patch_prober.go:28] interesting pod/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 08 16:37:21.214829 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:21.214812    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln" podUID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 08 16:37:22.214336 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:22.214301    2562 patch_prober.go:28] interesting pod/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 08 16:37:22.214763 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:22.214733    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln" podUID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 08 16:37:23.214112 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:23.214076    2562 patch_prober.go:28] interesting pod/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 08 16:37:23.214289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:23.214131    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln" podUID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 08 16:37:24.214058 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:24.214018    2562 patch_prober.go:28] interesting pod/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 08 16:37:24.214543 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:24.214083    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln" podUID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 08 16:37:24.334090 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:24.334050    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:37:25.213983 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:25.213944    2562 patch_prober.go:28] interesting pod/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 08 16:37:25.214158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:25.214009    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln" podUID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 08 16:37:26.218444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:26.218414    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:37:26.219486 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:26.219467    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:37:26.252452 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:26.252424    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:37:28.584944 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:28.584912    2562 generic.go:356] "Generic (PLEG): container finished" podID="94d4c570-2840-4765-a653-024f2b30a7e8" containerID="ce3c6c65ede40fe81143caf95eae0fa94607a063ac8e15f7abc13b1bcff29a49" exitCode=0
Sep 08 16:37:28.585348 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:28.584949    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt" event={"ID":"94d4c570-2840-4765-a653-024f2b30a7e8","Type":"ContainerDied","Data":"ce3c6c65ede40fe81143caf95eae0fa94607a063ac8e15f7abc13b1bcff29a49"}
Sep 08 16:37:28.585348 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:28.585274    2562 scope.go:117] "RemoveContainer" containerID="ce3c6c65ede40fe81143caf95eae0fa94607a063ac8e15f7abc13b1bcff29a49"
Sep 08 16:37:28.586312 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:28.586285    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:37:28.586375 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:28.586356    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:37:28.586414 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:28.586387    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:37:29.592637 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:29.592586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt" event={"ID":"94d4c570-2840-4765-a653-024f2b30a7e8","Type":"ContainerStarted","Data":"0c02ea3820000d7ba942274f71ba3f539add77b44936911040ec6c8b3c269876"}
Sep 08 16:37:30.053439 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.053351    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:30.053595 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.053539    2562 patch_prober.go:28] interesting pod/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 16:37:30.053663 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.053635    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt" podUID="94d4c570-2840-4765-a653-024f2b30a7e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 16:37:30.761149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.761111    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"]
Sep 08 16:37:30.761676 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.761657    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerName="istio-proxy"
Sep 08 16:37:30.761676 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.761677    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerName="istio-proxy"
Sep 08 16:37:30.761767 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.761687    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerName="istio-proxy"
Sep 08 16:37:30.761767 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.761693    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerName="istio-proxy"
Sep 08 16:37:30.761767 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.761759    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerName="istio-proxy"
Sep 08 16:37:30.764305 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.764288    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.767229 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.767209    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-870dc0\"/\"openshift-service-ca.crt\""
Sep 08 16:37:30.767335 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.767209    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-870dc0\"/\"kube-root-ca.crt\""
Sep 08 16:37:30.768136 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.768120    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-870dc0\"/\"test-model-870dc0-kserve-self-signed-certs\""
Sep 08 16:37:30.768236 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.768151    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-870dc0\"/\"default-dockercfg-r6pn7\""
Sep 08 16:37:30.777385 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.777365    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"]
Sep 08 16:37:30.853795 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.853760    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:30.867909 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.867882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-home\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.868033 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.867927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-tmp-dir\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.868033 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.867983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khl9n\" (UniqueName: \"kubernetes.io/projected/9cfd5504-ebc1-4439-8963-a4aceff84acb-kube-api-access-khl9n\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.868033 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.868013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-dshm\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.868165 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.868045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-model-cache\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.868165 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.868119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cfd5504-ebc1-4439-8963-a4aceff84acb-tls-certs\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.968981 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.968944    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-tmp-dir\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.969185 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.969004    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khl9n\" (UniqueName: \"kubernetes.io/projected/9cfd5504-ebc1-4439-8963-a4aceff84acb-kube-api-access-khl9n\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.969185 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.969052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-dshm\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.969185 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.969086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-model-cache\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.969185 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.969156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cfd5504-ebc1-4439-8963-a4aceff84acb-tls-certs\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.969185 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.969180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-home\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.969493 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.969453    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-tmp-dir\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.969561 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.969496    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-model-cache\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.969561 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.969527    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-home\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.971425 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.971406    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-dshm\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.971554 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.971537    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cfd5504-ebc1-4439-8963-a4aceff84acb-tls-certs\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:30.978070 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:30.978046    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khl9n\" (UniqueName: \"kubernetes.io/projected/9cfd5504-ebc1-4439-8963-a4aceff84acb-kube-api-access-khl9n\") pod \"test-model-870dc0-kserve-754b649969-lr4n2\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") " pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:31.053395 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:31.053306    2562 patch_prober.go:28] interesting pod/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 16:37:31.053395 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:31.053365    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt" podUID="94d4c570-2840-4765-a653-024f2b30a7e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 16:37:31.075116 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:31.075090    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:31.367957 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:31.367929    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"]
Sep 08 16:37:31.369951 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:37:31.369911    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cfd5504_ebc1_4439_8963_a4aceff84acb.slice/crio-0242f9afb9d9ddb8c67a7ab8f9bd25c20e080f4e168d98bc0ab4a14e235a00db WatchSource:0}: Error finding container 0242f9afb9d9ddb8c67a7ab8f9bd25c20e080f4e168d98bc0ab4a14e235a00db: Status 404 returned error can't find the container with id 0242f9afb9d9ddb8c67a7ab8f9bd25c20e080f4e168d98bc0ab4a14e235a00db
Sep 08 16:37:31.390755 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:31.390725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:31.605456 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:31.605420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2" event={"ID":"9cfd5504-ebc1-4439-8963-a4aceff84acb","Type":"ContainerStarted","Data":"13ddea215a8716205f085ee183e3c139c53c794ed7561841303177c041078d5d"}
Sep 08 16:37:31.605456 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:31.605466    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2" event={"ID":"9cfd5504-ebc1-4439-8963-a4aceff84acb","Type":"ContainerStarted","Data":"0242f9afb9d9ddb8c67a7ab8f9bd25c20e080f4e168d98bc0ab4a14e235a00db"}
Sep 08 16:37:32.053852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:32.053816    2562 patch_prober.go:28] interesting pod/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 16:37:32.054240 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:32.053869    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt" podUID="94d4c570-2840-4765-a653-024f2b30a7e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 16:37:33.053513 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:33.053475    2562 patch_prober.go:28] interesting pod/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 16:37:33.053710 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:33.053547    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt" podUID="94d4c570-2840-4765-a653-024f2b30a7e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 16:37:34.054179 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:34.054144    2562 patch_prober.go:28] interesting pod/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 16:37:34.054557 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:34.054203    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt" podUID="94d4c570-2840-4765-a653-024f2b30a7e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 16:37:35.057426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:35.057398    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:35.057808 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:35.057675    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:35.058340 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:35.058322    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:35.080925 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:35.080885    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2" podStartSLOduration=5.080869612 podStartE2EDuration="5.080869612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:37:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:37:31.629280593 +0000 UTC m=+894.213842213" watchObservedRunningTime="2026-09-08 16:37:35.080869612 +0000 UTC m=+897.665431231"
Sep 08 16:37:40.896425 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:40.896389    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:40.995808 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:40.995766    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:41.068324 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:41.068287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:41.075533 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:41.075509    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:41.075672 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:41.075646    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:41.088244 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:41.088224    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:41.171408 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:41.171338    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:41.287690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:41.287658    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"]
Sep 08 16:37:41.287901 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:41.287878    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt" podUID="94d4c570-2840-4765-a653-024f2b30a7e8" containerName="istio-proxy" containerID="cri-o://0c02ea3820000d7ba942274f71ba3f539add77b44936911040ec6c8b3c269876" gracePeriod=30
Sep 08 16:37:41.330050 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:41.330024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:41.678468 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:41.678437    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:37:42.045787 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:42.045751    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:42.138542 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:42.138510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:42.233961 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:42.233926    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:43.639917 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:43.639882    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:45.661119 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:45.661085    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:37:46.540808 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.540777    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:46.618389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.618317    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxp4w\" (UniqueName: \"kubernetes.io/projected/94d4c570-2840-4765-a653-024f2b30a7e8-kube-api-access-xxp4w\") pod \"94d4c570-2840-4765-a653-024f2b30a7e8\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") "
Sep 08 16:37:46.618389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.618370    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-workload-certs\") pod \"94d4c570-2840-4765-a653-024f2b30a7e8\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") "
Sep 08 16:37:46.618389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.618388    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94d4c570-2840-4765-a653-024f2b30a7e8-istio-token\") pod \"94d4c570-2840-4765-a653-024f2b30a7e8\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") "
Sep 08 16:37:46.618704 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.618407    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94d4c570-2840-4765-a653-024f2b30a7e8-istio-podinfo\") pod \"94d4c570-2840-4765-a653-024f2b30a7e8\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") "
Sep 08 16:37:46.618704 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.618431    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94d4c570-2840-4765-a653-024f2b30a7e8-istiod-ca-cert\") pod \"94d4c570-2840-4765-a653-024f2b30a7e8\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") "
Sep 08 16:37:46.618704 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.618446    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-istio-envoy\") pod \"94d4c570-2840-4765-a653-024f2b30a7e8\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") "
Sep 08 16:37:46.618704 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.618481    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-istio-data\") pod \"94d4c570-2840-4765-a653-024f2b30a7e8\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") "
Sep 08 16:37:46.618704 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.618636    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-credential-socket\") pod \"94d4c570-2840-4765-a653-024f2b30a7e8\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") "
Sep 08 16:37:46.618961 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.618736    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-workload-socket\") pod \"94d4c570-2840-4765-a653-024f2b30a7e8\" (UID: \"94d4c570-2840-4765-a653-024f2b30a7e8\") "
Sep 08 16:37:46.618961 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.618920    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94d4c570-2840-4765-a653-024f2b30a7e8" (UID: "94d4c570-2840-4765-a653-024f2b30a7e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:46.618961 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.618932    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d4c570-2840-4765-a653-024f2b30a7e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94d4c570-2840-4765-a653-024f2b30a7e8" (UID: "94d4c570-2840-4765-a653-024f2b30a7e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:37:46.619132 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.619110    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "94d4c570-2840-4765-a653-024f2b30a7e8" (UID: "94d4c570-2840-4765-a653-024f2b30a7e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:46.619193 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.619124    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94d4c570-2840-4765-a653-024f2b30a7e8-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:46.619193 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.619158    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:46.619193 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.619157    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94d4c570-2840-4765-a653-024f2b30a7e8" (UID: "94d4c570-2840-4765-a653-024f2b30a7e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:46.619355 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.619243    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94d4c570-2840-4765-a653-024f2b30a7e8" (UID: "94d4c570-2840-4765-a653-024f2b30a7e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:46.620652 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.620596    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94d4c570-2840-4765-a653-024f2b30a7e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94d4c570-2840-4765-a653-024f2b30a7e8" (UID: "94d4c570-2840-4765-a653-024f2b30a7e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:37:46.620787 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.620739    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94d4c570-2840-4765-a653-024f2b30a7e8-kube-api-access-xxp4w" (OuterVolumeSpecName: "kube-api-access-xxp4w") pod "94d4c570-2840-4765-a653-024f2b30a7e8" (UID: "94d4c570-2840-4765-a653-024f2b30a7e8"). InnerVolumeSpecName "kube-api-access-xxp4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:37:46.620977 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.620958    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94d4c570-2840-4765-a653-024f2b30a7e8" (UID: "94d4c570-2840-4765-a653-024f2b30a7e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:37:46.621188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.621163    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94d4c570-2840-4765-a653-024f2b30a7e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "94d4c570-2840-4765-a653-024f2b30a7e8" (UID: "94d4c570-2840-4765-a653-024f2b30a7e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:37:46.695962 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.695933    2562 generic.go:356] "Generic (PLEG): container finished" podID="94d4c570-2840-4765-a653-024f2b30a7e8" containerID="0c02ea3820000d7ba942274f71ba3f539add77b44936911040ec6c8b3c269876" exitCode=0
Sep 08 16:37:46.696279 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.695992    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"
Sep 08 16:37:46.696279 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.696029    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt" event={"ID":"94d4c570-2840-4765-a653-024f2b30a7e8","Type":"ContainerDied","Data":"0c02ea3820000d7ba942274f71ba3f539add77b44936911040ec6c8b3c269876"}
Sep 08 16:37:46.696279 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.696129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt" event={"ID":"94d4c570-2840-4765-a653-024f2b30a7e8","Type":"ContainerDied","Data":"ec64f467f1c3b05031e02db96ba180f386131cf3437497e07d4741067fae1219"}
Sep 08 16:37:46.696279 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.696165    2562 scope.go:117] "RemoveContainer" containerID="0c02ea3820000d7ba942274f71ba3f539add77b44936911040ec6c8b3c269876"
Sep 08 16:37:46.705720 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.705698    2562 scope.go:117] "RemoveContainer" containerID="ce3c6c65ede40fe81143caf95eae0fa94607a063ac8e15f7abc13b1bcff29a49"
Sep 08 16:37:46.713674 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.713657    2562 scope.go:117] "RemoveContainer" containerID="0c02ea3820000d7ba942274f71ba3f539add77b44936911040ec6c8b3c269876"
Sep 08 16:37:46.713988 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:37:46.713969    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c02ea3820000d7ba942274f71ba3f539add77b44936911040ec6c8b3c269876\": container with ID starting with 0c02ea3820000d7ba942274f71ba3f539add77b44936911040ec6c8b3c269876 not found: ID does not exist" containerID="0c02ea3820000d7ba942274f71ba3f539add77b44936911040ec6c8b3c269876"
Sep 08 16:37:46.714042 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.713996    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c02ea3820000d7ba942274f71ba3f539add77b44936911040ec6c8b3c269876"} err="failed to get container status \"0c02ea3820000d7ba942274f71ba3f539add77b44936911040ec6c8b3c269876\": rpc error: code = NotFound desc = could not find container \"0c02ea3820000d7ba942274f71ba3f539add77b44936911040ec6c8b3c269876\": container with ID starting with 0c02ea3820000d7ba942274f71ba3f539add77b44936911040ec6c8b3c269876 not found: ID does not exist"
Sep 08 16:37:46.714042 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.714013    2562 scope.go:117] "RemoveContainer" containerID="ce3c6c65ede40fe81143caf95eae0fa94607a063ac8e15f7abc13b1bcff29a49"
Sep 08 16:37:46.714259 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:37:46.714239    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce3c6c65ede40fe81143caf95eae0fa94607a063ac8e15f7abc13b1bcff29a49\": container with ID starting with ce3c6c65ede40fe81143caf95eae0fa94607a063ac8e15f7abc13b1bcff29a49 not found: ID does not exist" containerID="ce3c6c65ede40fe81143caf95eae0fa94607a063ac8e15f7abc13b1bcff29a49"
Sep 08 16:37:46.714313 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.714268    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce3c6c65ede40fe81143caf95eae0fa94607a063ac8e15f7abc13b1bcff29a49"} err="failed to get container status \"ce3c6c65ede40fe81143caf95eae0fa94607a063ac8e15f7abc13b1bcff29a49\": rpc error: code = NotFound desc = could not find container \"ce3c6c65ede40fe81143caf95eae0fa94607a063ac8e15f7abc13b1bcff29a49\": container with ID starting with ce3c6c65ede40fe81143caf95eae0fa94607a063ac8e15f7abc13b1bcff29a49 not found: ID does not exist"
Sep 08 16:37:46.718874 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.718854    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"]
Sep 08 16:37:46.719913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.719851    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:46.719913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.719875    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94d4c570-2840-4765-a653-024f2b30a7e8-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:46.719913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.719895    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94d4c570-2840-4765-a653-024f2b30a7e8-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:46.719913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.719908    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:46.719913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.719916    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:46.720259 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.719923    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d4c570-2840-4765-a653-024f2b30a7e8-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:46.720259 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.719932    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxp4w\" (UniqueName: \"kubernetes.io/projected/94d4c570-2840-4765-a653-024f2b30a7e8-kube-api-access-xxp4w\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:37:46.722889 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:46.722870    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt"]
Sep 08 16:37:48.005981 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:48.005951    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94d4c570-2840-4765-a653-024f2b30a7e8" path="/var/lib/kubelet/pods/94d4c570-2840-4765-a653-024f2b30a7e8/volumes"
Sep 08 16:37:49.374324 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.374294    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"]
Sep 08 16:37:49.374697 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.374687    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d4c570-2840-4765-a653-024f2b30a7e8" containerName="istio-proxy"
Sep 08 16:37:49.374748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.374700    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d4c570-2840-4765-a653-024f2b30a7e8" containerName="istio-proxy"
Sep 08 16:37:49.374785 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.374768    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d4c570-2840-4765-a653-024f2b30a7e8" containerName="istio-proxy"
Sep 08 16:37:49.374785 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.374777    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="51e3b5eb-0a5d-44d0-ba24-c3fa1ebf16ed" containerName="istio-proxy"
Sep 08 16:37:49.374847 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.374786    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d4c570-2840-4765-a653-024f2b30a7e8" containerName="istio-proxy"
Sep 08 16:37:49.377648 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.377630    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.380317 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.380296    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-384f4f\"/\"kube-root-ca.crt\""
Sep 08 16:37:49.381238 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.381218    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-384f4f\"/\"default-dockercfg-xb5lc\""
Sep 08 16:37:49.381544 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.381526    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-384f4f\"/\"explicit-model-384f4f-kserve-self-signed-certs\""
Sep 08 16:37:49.381749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.381733    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-384f4f\"/\"openshift-service-ca.crt\""
Sep 08 16:37:49.389133 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.389113    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"]
Sep 08 16:37:49.400732 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.400706    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:49.541796 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.541760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-dshm\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.541796 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.541801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-home\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.542004 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.541838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-model-cache\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.542004 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.541869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d6a2312-efda-4669-a790-9fb3c3638a38-tls-certs\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.542004 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.541888    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqzct\" (UniqueName: \"kubernetes.io/projected/9d6a2312-efda-4669-a790-9fb3c3638a38-kube-api-access-fqzct\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.542004 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.541930    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-tmp-dir\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.643830 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.643452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-model-cache\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.643830 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.643518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d6a2312-efda-4669-a790-9fb3c3638a38-tls-certs\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.643830 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.643550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqzct\" (UniqueName: \"kubernetes.io/projected/9d6a2312-efda-4669-a790-9fb3c3638a38-kube-api-access-fqzct\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.643830 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.643629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-tmp-dir\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.643830 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.643733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-dshm\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.643830 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.643768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-home\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.644290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.644209    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-home\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.644809 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.644449    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-model-cache\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.644809 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.644704    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-tmp-dir\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.649004 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.648968    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d6a2312-efda-4669-a790-9fb3c3638a38-tls-certs\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.651752 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.651725    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-dshm\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.657171 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.657148    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqzct\" (UniqueName: \"kubernetes.io/projected/9d6a2312-efda-4669-a790-9fb3c3638a38-kube-api-access-fqzct\") pod \"explicit-model-384f4f-kserve-6c9cd4b47f-cggph\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") " pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.687147 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.687126    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:49.883380 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.883348    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:49.969142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.969116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"]
Sep 08 16:37:49.970962 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:37:49.970935    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d6a2312_efda_4669_a790_9fb3c3638a38.slice/crio-2b3e8f5bc419c5ca820df7541d85345f8fd0ecc269b6379174bc68bff677a0c3 WatchSource:0}: Error finding container 2b3e8f5bc419c5ca820df7541d85345f8fd0ecc269b6379174bc68bff677a0c3: Status 404 returned error can't find the container with id 2b3e8f5bc419c5ca820df7541d85345f8fd0ecc269b6379174bc68bff677a0c3
Sep 08 16:37:49.976851 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:49.976753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:50.066068 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:50.066038    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:50.163068 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:50.163035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:50.613191 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:50.613157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:50.726012 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:50.725980    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph" event={"ID":"9d6a2312-efda-4669-a790-9fb3c3638a38","Type":"ContainerStarted","Data":"f49165c9dc79399b9227baa56b3f7bba338544c3fa894a50cc8fbeacf924853c"}
Sep 08 16:37:50.726149 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:50.726019    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph" event={"ID":"9d6a2312-efda-4669-a790-9fb3c3638a38","Type":"ContainerStarted","Data":"2b3e8f5bc419c5ca820df7541d85345f8fd0ecc269b6379174bc68bff677a0c3"}
Sep 08 16:37:50.761382 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:50.760925    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph" podStartSLOduration=1.7609073149999999 podStartE2EDuration="1.760907315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:37:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:37:50.760153379 +0000 UTC m=+913.344714998" watchObservedRunningTime="2026-09-08 16:37:50.760907315 +0000 UTC m=+913.345468935"
Sep 08 16:37:59.494809 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:59.494776    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"]
Sep 08 16:37:59.517696 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:59.517661    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:59.688208 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:59.688172    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:37:59.866672 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:37:59.866536    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:02.852143 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:02.852106    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:38:10.156432 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:10.156392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:11.289118 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:11.289081    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:14.514513 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.514477    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph" podUID="9d6a2312-efda-4669-a790-9fb3c3638a38" containerName="main" containerID="cri-o://f49165c9dc79399b9227baa56b3f7bba338544c3fa894a50cc8fbeacf924853c" gracePeriod=45
Sep 08 16:38:14.757985 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.757959    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:38:14.863855 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.863770    2562 generic.go:356] "Generic (PLEG): container finished" podID="9d6a2312-efda-4669-a790-9fb3c3638a38" containerID="f49165c9dc79399b9227baa56b3f7bba338544c3fa894a50cc8fbeacf924853c" exitCode=0
Sep 08 16:38:14.863855 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.863811    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"
Sep 08 16:38:14.864032 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.863862    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph" event={"ID":"9d6a2312-efda-4669-a790-9fb3c3638a38","Type":"ContainerDied","Data":"f49165c9dc79399b9227baa56b3f7bba338544c3fa894a50cc8fbeacf924853c"}
Sep 08 16:38:14.864032 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.863903    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph" event={"ID":"9d6a2312-efda-4669-a790-9fb3c3638a38","Type":"ContainerDied","Data":"2b3e8f5bc419c5ca820df7541d85345f8fd0ecc269b6379174bc68bff677a0c3"}
Sep 08 16:38:14.864032 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.863923    2562 scope.go:117] "RemoveContainer" containerID="f49165c9dc79399b9227baa56b3f7bba338544c3fa894a50cc8fbeacf924853c"
Sep 08 16:38:14.872684 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.872666    2562 scope.go:117] "RemoveContainer" containerID="f49165c9dc79399b9227baa56b3f7bba338544c3fa894a50cc8fbeacf924853c"
Sep 08 16:38:14.872965 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:38:14.872946    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f49165c9dc79399b9227baa56b3f7bba338544c3fa894a50cc8fbeacf924853c\": container with ID starting with f49165c9dc79399b9227baa56b3f7bba338544c3fa894a50cc8fbeacf924853c not found: ID does not exist" containerID="f49165c9dc79399b9227baa56b3f7bba338544c3fa894a50cc8fbeacf924853c"
Sep 08 16:38:14.873018 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.872973    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49165c9dc79399b9227baa56b3f7bba338544c3fa894a50cc8fbeacf924853c"} err="failed to get container status \"f49165c9dc79399b9227baa56b3f7bba338544c3fa894a50cc8fbeacf924853c\": rpc error: code = NotFound desc = could not find container \"f49165c9dc79399b9227baa56b3f7bba338544c3fa894a50cc8fbeacf924853c\": container with ID starting with f49165c9dc79399b9227baa56b3f7bba338544c3fa894a50cc8fbeacf924853c not found: ID does not exist"
Sep 08 16:38:14.875240 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.875224    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-tmp-dir\") pod \"9d6a2312-efda-4669-a790-9fb3c3638a38\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") "
Sep 08 16:38:14.875298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.875263    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-dshm\") pod \"9d6a2312-efda-4669-a790-9fb3c3638a38\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") "
Sep 08 16:38:14.875298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.875284    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-home\") pod \"9d6a2312-efda-4669-a790-9fb3c3638a38\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") "
Sep 08 16:38:14.875391 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.875367    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-model-cache\") pod \"9d6a2312-efda-4669-a790-9fb3c3638a38\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") "
Sep 08 16:38:14.875511 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.875412    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d6a2312-efda-4669-a790-9fb3c3638a38-tls-certs\") pod \"9d6a2312-efda-4669-a790-9fb3c3638a38\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") "
Sep 08 16:38:14.875511 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.875464    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9d6a2312-efda-4669-a790-9fb3c3638a38" (UID: "9d6a2312-efda-4669-a790-9fb3c3638a38"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:14.875511 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.875495    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqzct\" (UniqueName: \"kubernetes.io/projected/9d6a2312-efda-4669-a790-9fb3c3638a38-kube-api-access-fqzct\") pod \"9d6a2312-efda-4669-a790-9fb3c3638a38\" (UID: \"9d6a2312-efda-4669-a790-9fb3c3638a38\") "
Sep 08 16:38:14.875694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.875524    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-home" (OuterVolumeSpecName: "home") pod "9d6a2312-efda-4669-a790-9fb3c3638a38" (UID: "9d6a2312-efda-4669-a790-9fb3c3638a38"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:14.875694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.875570    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-model-cache" (OuterVolumeSpecName: "model-cache") pod "9d6a2312-efda-4669-a790-9fb3c3638a38" (UID: "9d6a2312-efda-4669-a790-9fb3c3638a38"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:14.875867 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.875850    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:14.875921 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.875873    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:14.875921 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.875888    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:14.877450 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.877428    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d6a2312-efda-4669-a790-9fb3c3638a38-kube-api-access-fqzct" (OuterVolumeSpecName: "kube-api-access-fqzct") pod "9d6a2312-efda-4669-a790-9fb3c3638a38" (UID: "9d6a2312-efda-4669-a790-9fb3c3638a38"). InnerVolumeSpecName "kube-api-access-fqzct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:38:14.877450 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.877434    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-dshm" (OuterVolumeSpecName: "dshm") pod "9d6a2312-efda-4669-a790-9fb3c3638a38" (UID: "9d6a2312-efda-4669-a790-9fb3c3638a38"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:14.877569 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.877428    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d6a2312-efda-4669-a790-9fb3c3638a38-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9d6a2312-efda-4669-a790-9fb3c3638a38" (UID: "9d6a2312-efda-4669-a790-9fb3c3638a38"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:38:14.976657 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.976630    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d6a2312-efda-4669-a790-9fb3c3638a38-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:14.976657 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.976653    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d6a2312-efda-4669-a790-9fb3c3638a38-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:14.976657 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:14.976663    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqzct\" (UniqueName: \"kubernetes.io/projected/9d6a2312-efda-4669-a790-9fb3c3638a38-kube-api-access-fqzct\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:15.188475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:15.188447    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"]
Sep 08 16:38:15.192052 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:15.192027    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-384f4f/explicit-model-384f4f-kserve-6c9cd4b47f-cggph"]
Sep 08 16:38:16.010771 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:16.007534    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d6a2312-efda-4669-a790-9fb3c3638a38" path="/var/lib/kubelet/pods/9d6a2312-efda-4669-a790-9fb3c3638a38/volumes"
Sep 08 16:38:16.589118 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:16.589077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:16.823932 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:16.823899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:16.924675 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:16.924576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:17.114091 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:17.114056    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"]
Sep 08 16:38:17.114494 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:17.114245    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln" podUID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerName="istio-proxy" containerID="cri-o://ac42c426a5fe24e1eedb67b4e210813b73698ced66ff3607b730ace9859f2756" gracePeriod=30
Sep 08 16:38:17.164238 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:17.164211    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:17.566118 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:17.566080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:17.870593 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:17.870501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:18.157301 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:18.157223    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:38:18.224522 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:18.224490    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:22.163387 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.163355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:22.263880 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.263839    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:22.370805 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.370782    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:38:22.391603 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.391535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:22.441867 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.441841    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-data\") pod \"2c023d74-bdb5-490b-a18e-e87552f4d653\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") "
Sep 08 16:38:22.441998 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.441883    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-credential-socket\") pod \"2c023d74-bdb5-490b-a18e-e87552f4d653\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") "
Sep 08 16:38:22.441998 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.441917    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-token\") pod \"2c023d74-bdb5-490b-a18e-e87552f4d653\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") "
Sep 08 16:38:22.441998 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.441952    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-envoy\") pod \"2c023d74-bdb5-490b-a18e-e87552f4d653\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") "
Sep 08 16:38:22.442136 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.441999    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c023d74-bdb5-490b-a18e-e87552f4d653-istiod-ca-cert\") pod \"2c023d74-bdb5-490b-a18e-e87552f4d653\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") "
Sep 08 16:38:22.442190 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.442128    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c023d74-bdb5-490b-a18e-e87552f4d653" (UID: "2c023d74-bdb5-490b-a18e-e87552f4d653"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:22.442190 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.442145    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c023d74-bdb5-490b-a18e-e87552f4d653" (UID: "2c023d74-bdb5-490b-a18e-e87552f4d653"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:22.442302 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.442233    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-podinfo\") pod \"2c023d74-bdb5-490b-a18e-e87552f4d653\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") "
Sep 08 16:38:22.442302 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.442292    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvn77\" (UniqueName: \"kubernetes.io/projected/2c023d74-bdb5-490b-a18e-e87552f4d653-kube-api-access-wvn77\") pod \"2c023d74-bdb5-490b-a18e-e87552f4d653\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") "
Sep 08 16:38:22.442461 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.442331    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-workload-certs\") pod \"2c023d74-bdb5-490b-a18e-e87552f4d653\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") "
Sep 08 16:38:22.442461 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.442346    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c023d74-bdb5-490b-a18e-e87552f4d653-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c023d74-bdb5-490b-a18e-e87552f4d653" (UID: "2c023d74-bdb5-490b-a18e-e87552f4d653"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:38:22.442461 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.442413    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-workload-socket\") pod \"2c023d74-bdb5-490b-a18e-e87552f4d653\" (UID: \"2c023d74-bdb5-490b-a18e-e87552f4d653\") "
Sep 08 16:38:22.442745 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.442685    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c023d74-bdb5-490b-a18e-e87552f4d653" (UID: "2c023d74-bdb5-490b-a18e-e87552f4d653"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:22.442877 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.442746    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c023d74-bdb5-490b-a18e-e87552f4d653" (UID: "2c023d74-bdb5-490b-a18e-e87552f4d653"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:22.442877 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.442774    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:22.442877 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.442793    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c023d74-bdb5-490b-a18e-e87552f4d653-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:22.442877 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.442807    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:22.444174 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.444145    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c023d74-bdb5-490b-a18e-e87552f4d653" (UID: "2c023d74-bdb5-490b-a18e-e87552f4d653"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:38:22.444337 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.444314    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c023d74-bdb5-490b-a18e-e87552f4d653" (UID: "2c023d74-bdb5-490b-a18e-e87552f4d653"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:22.444417 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.444396    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c023d74-bdb5-490b-a18e-e87552f4d653-kube-api-access-wvn77" (OuterVolumeSpecName: "kube-api-access-wvn77") pod "2c023d74-bdb5-490b-a18e-e87552f4d653" (UID: "2c023d74-bdb5-490b-a18e-e87552f4d653"). InnerVolumeSpecName "kube-api-access-wvn77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:38:22.444505 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.444463    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c023d74-bdb5-490b-a18e-e87552f4d653" (UID: "2c023d74-bdb5-490b-a18e-e87552f4d653"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:38:22.543650 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.543597    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:22.543650 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.543643    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvn77\" (UniqueName: \"kubernetes.io/projected/2c023d74-bdb5-490b-a18e-e87552f4d653-kube-api-access-wvn77\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:22.543650 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.543653    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:22.543878 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.543662    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:22.543878 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.543670    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:22.543878 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.543678    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c023d74-bdb5-490b-a18e-e87552f4d653-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:38:22.910169 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.910130    2562 generic.go:356] "Generic (PLEG): container finished" podID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerID="ac42c426a5fe24e1eedb67b4e210813b73698ced66ff3607b730ace9859f2756" exitCode=0
Sep 08 16:38:22.910169 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.910165    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln" event={"ID":"2c023d74-bdb5-490b-a18e-e87552f4d653","Type":"ContainerDied","Data":"ac42c426a5fe24e1eedb67b4e210813b73698ced66ff3607b730ace9859f2756"}
Sep 08 16:38:22.910437 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.910198    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"
Sep 08 16:38:22.910437 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.910244    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln" event={"ID":"2c023d74-bdb5-490b-a18e-e87552f4d653","Type":"ContainerDied","Data":"c83493823798c282cc28f5c58f6d59c4b4ddecc0951348095f2b4b933138cbcb"}
Sep 08 16:38:22.910437 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.910266    2562 scope.go:117] "RemoveContainer" containerID="ac42c426a5fe24e1eedb67b4e210813b73698ced66ff3607b730ace9859f2756"
Sep 08 16:38:22.919913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.919898    2562 scope.go:117] "RemoveContainer" containerID="1ad8ba68cc698afa7e64081027f355a45f863e630d1e3f22aee12df924c64d95"
Sep 08 16:38:22.927826 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.927808    2562 scope.go:117] "RemoveContainer" containerID="ac42c426a5fe24e1eedb67b4e210813b73698ced66ff3607b730ace9859f2756"
Sep 08 16:38:22.928077 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:38:22.928059    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac42c426a5fe24e1eedb67b4e210813b73698ced66ff3607b730ace9859f2756\": container with ID starting with ac42c426a5fe24e1eedb67b4e210813b73698ced66ff3607b730ace9859f2756 not found: ID does not exist" containerID="ac42c426a5fe24e1eedb67b4e210813b73698ced66ff3607b730ace9859f2756"
Sep 08 16:38:22.928127 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.928085    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac42c426a5fe24e1eedb67b4e210813b73698ced66ff3607b730ace9859f2756"} err="failed to get container status \"ac42c426a5fe24e1eedb67b4e210813b73698ced66ff3607b730ace9859f2756\": rpc error: code = NotFound desc = could not find container \"ac42c426a5fe24e1eedb67b4e210813b73698ced66ff3607b730ace9859f2756\": container with ID starting with ac42c426a5fe24e1eedb67b4e210813b73698ced66ff3607b730ace9859f2756 not found: ID does not exist"
Sep 08 16:38:22.928127 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.928103    2562 scope.go:117] "RemoveContainer" containerID="1ad8ba68cc698afa7e64081027f355a45f863e630d1e3f22aee12df924c64d95"
Sep 08 16:38:22.928323 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:38:22.928309    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ad8ba68cc698afa7e64081027f355a45f863e630d1e3f22aee12df924c64d95\": container with ID starting with 1ad8ba68cc698afa7e64081027f355a45f863e630d1e3f22aee12df924c64d95 not found: ID does not exist" containerID="1ad8ba68cc698afa7e64081027f355a45f863e630d1e3f22aee12df924c64d95"
Sep 08 16:38:22.928369 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.928326    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad8ba68cc698afa7e64081027f355a45f863e630d1e3f22aee12df924c64d95"} err="failed to get container status \"1ad8ba68cc698afa7e64081027f355a45f863e630d1e3f22aee12df924c64d95\": rpc error: code = NotFound desc = could not find container \"1ad8ba68cc698afa7e64081027f355a45f863e630d1e3f22aee12df924c64d95\": container with ID starting with 1ad8ba68cc698afa7e64081027f355a45f863e630d1e3f22aee12df924c64d95 not found: ID does not exist"
Sep 08 16:38:22.933173 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.933149    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"]
Sep 08 16:38:22.937483 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:22.937459    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln"]
Sep 08 16:38:23.288090 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:23.288042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:23.393263 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:23.393227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:23.495689 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:23.495649    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:24.005938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:24.005904    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c023d74-bdb5-490b-a18e-e87552f4d653" path="/var/lib/kubelet/pods/2c023d74-bdb5-490b-a18e-e87552f4d653/volumes"
Sep 08 16:38:27.162159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:27.162119    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:30.588874 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:30.588840    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:30.731854 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:30.731806    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:30.969849 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:30.969808    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:31.082217 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:31.082184    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:34.252505 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:34.252470    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:38:36.105377 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:36.105341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:39.381669 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:39.381632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:45.351917 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:45.351879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:45.455537 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:45.455508    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:45.551058 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:45.551024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:48.352160 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:48.352124    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:50.704980 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:50.704948    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:51.853044 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:51.853009    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"]
Sep 08 16:38:51.873309 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:51.873274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:52.095818 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:52.095776    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:55.047957 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:55.047919    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:38:56.092539 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:56.092510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:56.912844 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:38:56.912811    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:02.542768 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:02.542686    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:02.645438 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:02.645390    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:02.748031 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:02.748001    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:03.078035 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:03.077997    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:03.253581 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:03.253542    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:03.355161 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:03.355077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:03.456585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:03.456553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:03.531080 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:03.531053    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:04.289663 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:04.289603    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:04.457389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:04.457356    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:06.001450 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:06.001417    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:06.872008 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:06.871974    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2" podUID="9cfd5504-ebc1-4439-8963-a4aceff84acb" containerName="main" containerID="cri-o://13ddea215a8716205f085ee183e3c139c53c794ed7561841303177c041078d5d" gracePeriod=45
Sep 08 16:39:07.123961 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.123903    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:39:07.145896 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.145864    2562 generic.go:356] "Generic (PLEG): container finished" podID="9cfd5504-ebc1-4439-8963-a4aceff84acb" containerID="13ddea215a8716205f085ee183e3c139c53c794ed7561841303177c041078d5d" exitCode=0
Sep 08 16:39:07.146018 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.145903    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"
Sep 08 16:39:07.146018 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.145934    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2" event={"ID":"9cfd5504-ebc1-4439-8963-a4aceff84acb","Type":"ContainerDied","Data":"13ddea215a8716205f085ee183e3c139c53c794ed7561841303177c041078d5d"}
Sep 08 16:39:07.146018 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.145985    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2" event={"ID":"9cfd5504-ebc1-4439-8963-a4aceff84acb","Type":"ContainerDied","Data":"0242f9afb9d9ddb8c67a7ab8f9bd25c20e080f4e168d98bc0ab4a14e235a00db"}
Sep 08 16:39:07.146018 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.146006    2562 scope.go:117] "RemoveContainer" containerID="13ddea215a8716205f085ee183e3c139c53c794ed7561841303177c041078d5d"
Sep 08 16:39:07.156466 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.156449    2562 scope.go:117] "RemoveContainer" containerID="13ddea215a8716205f085ee183e3c139c53c794ed7561841303177c041078d5d"
Sep 08 16:39:07.156789 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:39:07.156762    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13ddea215a8716205f085ee183e3c139c53c794ed7561841303177c041078d5d\": container with ID starting with 13ddea215a8716205f085ee183e3c139c53c794ed7561841303177c041078d5d not found: ID does not exist" containerID="13ddea215a8716205f085ee183e3c139c53c794ed7561841303177c041078d5d"
Sep 08 16:39:07.156892 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.156793    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13ddea215a8716205f085ee183e3c139c53c794ed7561841303177c041078d5d"} err="failed to get container status \"13ddea215a8716205f085ee183e3c139c53c794ed7561841303177c041078d5d\": rpc error: code = NotFound desc = could not find container \"13ddea215a8716205f085ee183e3c139c53c794ed7561841303177c041078d5d\": container with ID starting with 13ddea215a8716205f085ee183e3c139c53c794ed7561841303177c041078d5d not found: ID does not exist"
Sep 08 16:39:07.242263 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.242234    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khl9n\" (UniqueName: \"kubernetes.io/projected/9cfd5504-ebc1-4439-8963-a4aceff84acb-kube-api-access-khl9n\") pod \"9cfd5504-ebc1-4439-8963-a4aceff84acb\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") "
Sep 08 16:39:07.242444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.242271    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-home\") pod \"9cfd5504-ebc1-4439-8963-a4aceff84acb\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") "
Sep 08 16:39:07.242444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.242294    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-tmp-dir\") pod \"9cfd5504-ebc1-4439-8963-a4aceff84acb\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") "
Sep 08 16:39:07.242444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.242318    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cfd5504-ebc1-4439-8963-a4aceff84acb-tls-certs\") pod \"9cfd5504-ebc1-4439-8963-a4aceff84acb\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") "
Sep 08 16:39:07.242634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.242448    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-model-cache\") pod \"9cfd5504-ebc1-4439-8963-a4aceff84acb\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") "
Sep 08 16:39:07.242634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.242530    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9cfd5504-ebc1-4439-8963-a4aceff84acb" (UID: "9cfd5504-ebc1-4439-8963-a4aceff84acb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:07.242634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.242541    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-home" (OuterVolumeSpecName: "home") pod "9cfd5504-ebc1-4439-8963-a4aceff84acb" (UID: "9cfd5504-ebc1-4439-8963-a4aceff84acb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:07.242634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.242627    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-dshm\") pod \"9cfd5504-ebc1-4439-8963-a4aceff84acb\" (UID: \"9cfd5504-ebc1-4439-8963-a4aceff84acb\") "
Sep 08 16:39:07.242844 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.242727    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-model-cache" (OuterVolumeSpecName: "model-cache") pod "9cfd5504-ebc1-4439-8963-a4aceff84acb" (UID: "9cfd5504-ebc1-4439-8963-a4aceff84acb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:07.242928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.242912    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:07.242991 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.242929    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:07.242991 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.242938    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:07.244575 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.244547    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-dshm" (OuterVolumeSpecName: "dshm") pod "9cfd5504-ebc1-4439-8963-a4aceff84acb" (UID: "9cfd5504-ebc1-4439-8963-a4aceff84acb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:07.244575 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.244563    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cfd5504-ebc1-4439-8963-a4aceff84acb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9cfd5504-ebc1-4439-8963-a4aceff84acb" (UID: "9cfd5504-ebc1-4439-8963-a4aceff84acb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:39:07.244796 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.244659    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cfd5504-ebc1-4439-8963-a4aceff84acb-kube-api-access-khl9n" (OuterVolumeSpecName: "kube-api-access-khl9n") pod "9cfd5504-ebc1-4439-8963-a4aceff84acb" (UID: "9cfd5504-ebc1-4439-8963-a4aceff84acb"). InnerVolumeSpecName "kube-api-access-khl9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:39:07.261158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.261134    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:39:07.344127 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.344102    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khl9n\" (UniqueName: \"kubernetes.io/projected/9cfd5504-ebc1-4439-8963-a4aceff84acb-kube-api-access-khl9n\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:07.344127 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.344125    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cfd5504-ebc1-4439-8963-a4aceff84acb-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:07.344290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.344136    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cfd5504-ebc1-4439-8963-a4aceff84acb-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:07.469141 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.469112    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"]
Sep 08 16:39:07.473359 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:07.473334    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-870dc0/test-model-870dc0-kserve-754b649969-lr4n2"]
Sep 08 16:39:08.005726 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:08.005694    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cfd5504-ebc1-4439-8963-a4aceff84acb" path="/var/lib/kubelet/pods/9cfd5504-ebc1-4439-8963-a4aceff84acb/volumes"
Sep 08 16:39:09.082749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:09.082712    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:09.184173 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:09.184131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:09.324455 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:09.324422    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"]
Sep 08 16:39:09.324749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:09.324721    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerName="istio-proxy" containerID="cri-o://74a6b10ab49575efc689102daa4da0e533ee406103e313013c3de0c037958558" gracePeriod=30
Sep 08 16:39:09.398329 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:09.398244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:09.903151 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:09.903121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:12.667806 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:12.667766    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:12.769024 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:12.768990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:13.350536 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:13.350505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:14.118048 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.118014    2562 patch_prober.go:28] interesting pod/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 16:39:14.118403 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.118083    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 16:39:14.575541 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.575515    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:39:14.710083 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710003    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bn8x\" (UniqueName: \"kubernetes.io/projected/849698a2-7cad-4e55-a7f8-2beeb0708f02-kube-api-access-5bn8x\") pod \"849698a2-7cad-4e55-a7f8-2beeb0708f02\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") "
Sep 08 16:39:14.710083 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710051    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-podinfo\") pod \"849698a2-7cad-4e55-a7f8-2beeb0708f02\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") "
Sep 08 16:39:14.710300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710089    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-token\") pod \"849698a2-7cad-4e55-a7f8-2beeb0708f02\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") "
Sep 08 16:39:14.710300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710114    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849698a2-7cad-4e55-a7f8-2beeb0708f02-istiod-ca-cert\") pod \"849698a2-7cad-4e55-a7f8-2beeb0708f02\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") "
Sep 08 16:39:14.710300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710153    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-workload-socket\") pod \"849698a2-7cad-4e55-a7f8-2beeb0708f02\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") "
Sep 08 16:39:14.710300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710184    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-data\") pod \"849698a2-7cad-4e55-a7f8-2beeb0708f02\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") "
Sep 08 16:39:14.710300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710234    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-envoy\") pod \"849698a2-7cad-4e55-a7f8-2beeb0708f02\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") "
Sep 08 16:39:14.710300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710260    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-credential-socket\") pod \"849698a2-7cad-4e55-a7f8-2beeb0708f02\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") "
Sep 08 16:39:14.710300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710290    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-workload-certs\") pod \"849698a2-7cad-4e55-a7f8-2beeb0708f02\" (UID: \"849698a2-7cad-4e55-a7f8-2beeb0708f02\") "
Sep 08 16:39:14.710696 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710448    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "849698a2-7cad-4e55-a7f8-2beeb0708f02" (UID: "849698a2-7cad-4e55-a7f8-2beeb0708f02"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:14.710696 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710524    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-data" (OuterVolumeSpecName: "istio-data") pod "849698a2-7cad-4e55-a7f8-2beeb0708f02" (UID: "849698a2-7cad-4e55-a7f8-2beeb0708f02"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:14.710696 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710543    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/849698a2-7cad-4e55-a7f8-2beeb0708f02-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "849698a2-7cad-4e55-a7f8-2beeb0708f02" (UID: "849698a2-7cad-4e55-a7f8-2beeb0708f02"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:39:14.710696 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710674    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:14.710696 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710689    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "849698a2-7cad-4e55-a7f8-2beeb0708f02" (UID: "849698a2-7cad-4e55-a7f8-2beeb0708f02"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:14.710967 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710697    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:14.710967 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.710852    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "849698a2-7cad-4e55-a7f8-2beeb0708f02" (UID: "849698a2-7cad-4e55-a7f8-2beeb0708f02"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:14.712359 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.712329    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-token" (OuterVolumeSpecName: "istio-token") pod "849698a2-7cad-4e55-a7f8-2beeb0708f02" (UID: "849698a2-7cad-4e55-a7f8-2beeb0708f02"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:39:14.712359 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.712334    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "849698a2-7cad-4e55-a7f8-2beeb0708f02" (UID: "849698a2-7cad-4e55-a7f8-2beeb0708f02"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:39:14.712359 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.712342    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/849698a2-7cad-4e55-a7f8-2beeb0708f02-kube-api-access-5bn8x" (OuterVolumeSpecName: "kube-api-access-5bn8x") pod "849698a2-7cad-4e55-a7f8-2beeb0708f02" (UID: "849698a2-7cad-4e55-a7f8-2beeb0708f02"). InnerVolumeSpecName "kube-api-access-5bn8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:39:14.712543 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.712411    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "849698a2-7cad-4e55-a7f8-2beeb0708f02" (UID: "849698a2-7cad-4e55-a7f8-2beeb0708f02"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:14.811285 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.811255    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:14.811285 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.811284    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:14.811444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.811299    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849698a2-7cad-4e55-a7f8-2beeb0708f02-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:14.811444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.811311    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bn8x\" (UniqueName: \"kubernetes.io/projected/849698a2-7cad-4e55-a7f8-2beeb0708f02-kube-api-access-5bn8x\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:14.811444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.811323    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:14.811444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.811334    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849698a2-7cad-4e55-a7f8-2beeb0708f02-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:14.811444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:14.811345    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849698a2-7cad-4e55-a7f8-2beeb0708f02-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:15.196424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:15.196395    2562 generic.go:356] "Generic (PLEG): container finished" podID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerID="74a6b10ab49575efc689102daa4da0e533ee406103e313013c3de0c037958558" exitCode=0
Sep 08 16:39:15.196815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:15.196469    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"
Sep 08 16:39:15.196815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:15.196471    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" event={"ID":"849698a2-7cad-4e55-a7f8-2beeb0708f02","Type":"ContainerDied","Data":"74a6b10ab49575efc689102daa4da0e533ee406103e313013c3de0c037958558"}
Sep 08 16:39:15.196815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:15.196624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt" event={"ID":"849698a2-7cad-4e55-a7f8-2beeb0708f02","Type":"ContainerDied","Data":"7b83e352e0550d19a1b3c04fe49ba955884bf157df3afee8ff8e2bb3bad7285c"}
Sep 08 16:39:15.196815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:15.196655    2562 scope.go:117] "RemoveContainer" containerID="74a6b10ab49575efc689102daa4da0e533ee406103e313013c3de0c037958558"
Sep 08 16:39:15.206118 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:15.206101    2562 scope.go:117] "RemoveContainer" containerID="9cc5601894c7387c37b343eb44e96ece27c3479c32cba90ed2c3d9269a28a5cc"
Sep 08 16:39:15.214099 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:15.214084    2562 scope.go:117] "RemoveContainer" containerID="74a6b10ab49575efc689102daa4da0e533ee406103e313013c3de0c037958558"
Sep 08 16:39:15.214378 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:39:15.214355    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74a6b10ab49575efc689102daa4da0e533ee406103e313013c3de0c037958558\": container with ID starting with 74a6b10ab49575efc689102daa4da0e533ee406103e313013c3de0c037958558 not found: ID does not exist" containerID="74a6b10ab49575efc689102daa4da0e533ee406103e313013c3de0c037958558"
Sep 08 16:39:15.214458 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:15.214387    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a6b10ab49575efc689102daa4da0e533ee406103e313013c3de0c037958558"} err="failed to get container status \"74a6b10ab49575efc689102daa4da0e533ee406103e313013c3de0c037958558\": rpc error: code = NotFound desc = could not find container \"74a6b10ab49575efc689102daa4da0e533ee406103e313013c3de0c037958558\": container with ID starting with 74a6b10ab49575efc689102daa4da0e533ee406103e313013c3de0c037958558 not found: ID does not exist"
Sep 08 16:39:15.214458 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:15.214410    2562 scope.go:117] "RemoveContainer" containerID="9cc5601894c7387c37b343eb44e96ece27c3479c32cba90ed2c3d9269a28a5cc"
Sep 08 16:39:15.214731 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:39:15.214713    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cc5601894c7387c37b343eb44e96ece27c3479c32cba90ed2c3d9269a28a5cc\": container with ID starting with 9cc5601894c7387c37b343eb44e96ece27c3479c32cba90ed2c3d9269a28a5cc not found: ID does not exist" containerID="9cc5601894c7387c37b343eb44e96ece27c3479c32cba90ed2c3d9269a28a5cc"
Sep 08 16:39:15.214778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:15.214736    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc5601894c7387c37b343eb44e96ece27c3479c32cba90ed2c3d9269a28a5cc"} err="failed to get container status \"9cc5601894c7387c37b343eb44e96ece27c3479c32cba90ed2c3d9269a28a5cc\": rpc error: code = NotFound desc = could not find container \"9cc5601894c7387c37b343eb44e96ece27c3479c32cba90ed2c3d9269a28a5cc\": container with ID starting with 9cc5601894c7387c37b343eb44e96ece27c3479c32cba90ed2c3d9269a28a5cc not found: ID does not exist"
Sep 08 16:39:15.223264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:15.223239    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"]
Sep 08 16:39:15.232033 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:15.232011    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt"]
Sep 08 16:39:16.006260 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:16.006231    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" path="/var/lib/kubelet/pods/849698a2-7cad-4e55-a7f8-2beeb0708f02/volumes"
Sep 08 16:39:16.153590 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:16.153556    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:39:19.127185 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.127151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:19.232334 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.232304    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:19.356935 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.356898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:19.644597 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.644561    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"]
Sep 08 16:39:19.644983 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.644964    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerName="istio-proxy"
Sep 08 16:39:19.645065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.644986    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerName="istio-proxy"
Sep 08 16:39:19.645065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645005    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerName="istio-proxy"
Sep 08 16:39:19.645065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645012    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerName="istio-proxy"
Sep 08 16:39:19.645065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645026    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cfd5504-ebc1-4439-8963-a4aceff84acb" containerName="main"
Sep 08 16:39:19.645065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645034    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cfd5504-ebc1-4439-8963-a4aceff84acb" containerName="main"
Sep 08 16:39:19.645065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645059    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerName="istio-proxy"
Sep 08 16:39:19.645065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645066    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerName="istio-proxy"
Sep 08 16:39:19.645410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645083    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d6a2312-efda-4669-a790-9fb3c3638a38" containerName="main"
Sep 08 16:39:19.645410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645092    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d6a2312-efda-4669-a790-9fb3c3638a38" containerName="main"
Sep 08 16:39:19.645410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645102    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d4c570-2840-4765-a653-024f2b30a7e8" containerName="istio-proxy"
Sep 08 16:39:19.645410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645111    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d4c570-2840-4765-a653-024f2b30a7e8" containerName="istio-proxy"
Sep 08 16:39:19.645410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645192    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerName="istio-proxy"
Sep 08 16:39:19.645410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645203    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerName="istio-proxy"
Sep 08 16:39:19.645410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645215    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cfd5504-ebc1-4439-8963-a4aceff84acb" containerName="main"
Sep 08 16:39:19.645410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645225    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d6a2312-efda-4669-a790-9fb3c3638a38" containerName="main"
Sep 08 16:39:19.645410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.645234    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerName="istio-proxy"
Sep 08 16:39:19.649657 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.649635    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.651825 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.651806    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a69d4afb-openshift-default-dockercfg-6klm6\""
Sep 08 16:39:19.662822 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.662793    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"]
Sep 08 16:39:19.689018 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.688992    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:19.751883 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.751853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-podinfo\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.752065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.751891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-data\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.752065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.751930    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-workload-certs\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.752065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.751953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-envoy\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.752065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.751986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-token\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.752065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.752024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-workload-socket\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.752354 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.752116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4hrv\" (UniqueName: \"kubernetes.io/projected/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-kube-api-access-q4hrv\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.752354 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.752156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-credential-socket\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.752354 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.752204    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istiod-ca-cert\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.840218 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.840180    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:19.853690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.853658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-podinfo\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.853826 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.853700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-data\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.853826 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.853744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-workload-certs\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.853826 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.853767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-envoy\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.853979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.853901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-token\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.853979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.853956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-workload-socket\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.854075 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.854019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4hrv\" (UniqueName: \"kubernetes.io/projected/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-kube-api-access-q4hrv\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.854075 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.854051    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-credential-socket\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.854182 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.854090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istiod-ca-cert\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.854598 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.854574    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-workload-certs\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.854810 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.854634    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-workload-socket\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.855097 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.854164    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-data\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.855319 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.855295    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-credential-socket\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.855636 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.855592    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istiod-ca-cert\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.862259 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.862218    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-envoy\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.862657 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.862635    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-podinfo\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.864049 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.864029    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-token\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.864687 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.864670    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4hrv\" (UniqueName: \"kubernetes.io/projected/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-kube-api-access-q4hrv\") pod \"e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") " pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:19.960408 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:19.960375    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:20.241818 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:20.241782    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"]
Sep 08 16:39:20.243174 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:39:20.243145    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae8bac6_8fd4_4bea_aaa3_95521a8a532a.slice/crio-f183d8c2e37159a419d245e9644dcf1350a06bf572a891e0ae8c3ea7a33d1f86 WatchSource:0}: Error finding container f183d8c2e37159a419d245e9644dcf1350a06bf572a891e0ae8c3ea7a33d1f86: Status 404 returned error can't find the container with id f183d8c2e37159a419d245e9644dcf1350a06bf572a891e0ae8c3ea7a33d1f86
Sep 08 16:39:20.245270 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:20.245240    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:39:20.245366 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:20.245318    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:39:20.245443 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:20.245362    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:39:20.417274 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:20.417225    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:20.507281 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:20.507188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:20.589191 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:20.589154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:20.655146 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:20.655107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:20.729293 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:20.729250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:21.109411 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:21.109375    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:21.231473 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:21.231445    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" event={"ID":"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a","Type":"ContainerStarted","Data":"948bb3bb6874155d4b1a3a43364b9b33503ff2b46a0a3f5725a5ee0eb5801531"}
Sep 08 16:39:21.231631 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:21.231519    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" event={"ID":"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a","Type":"ContainerStarted","Data":"f183d8c2e37159a419d245e9644dcf1350a06bf572a891e0ae8c3ea7a33d1f86"}
Sep 08 16:39:21.260370 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:21.260328    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" podStartSLOduration=2.260313058 podStartE2EDuration="2.260313058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:39:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:39:21.258447678 +0000 UTC m=+1003.843009320" watchObservedRunningTime="2026-09-08 16:39:21.260313058 +0000 UTC m=+1003.844874676"
Sep 08 16:39:21.960508 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:21.960471    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:21.965521 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:21.965497    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:22.237204 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:22.237109    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:22.238110 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:22.238093    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:23.291208 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:23.291171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:23.403271 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:23.403238    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:23.781382 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:23.781343    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:39:24.517604 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:24.517569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:24.620735 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:24.620702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:25.150490 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:25.150459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:25.251254 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:25.251220    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:27.174545 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:27.174500    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:27.247254 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:27.247213    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:27.435013 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:27.434934    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"]
Sep 08 16:39:27.435215 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:27.435188    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerName="istio-proxy" containerID="cri-o://55a3b518befee2e0e5af8429f175f7c52ab80ee7444c4eadb5037f35f9ab8c6b" gracePeriod=30
Sep 08 16:39:27.460284 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:27.460253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:28.064854 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:28.064823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:28.382636 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:28.382529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:28.483862 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:28.483823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:31.368070 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:31.368041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:31.467194 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:31.467151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:31.496275 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:31.496238    2562 patch_prober.go:28] interesting pod/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 16:39:31.496424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:31.496296    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 16:39:32.548337 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.548293    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:32.654384 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.654351    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:32.749909 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.749824    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:39:32.871624 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.871564    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-workload-certs\") pod \"416a3ece-7fb6-4f4a-8d25-f65146013891\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") "
Sep 08 16:39:32.871814 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.871634    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-data\") pod \"416a3ece-7fb6-4f4a-8d25-f65146013891\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") "
Sep 08 16:39:32.871814 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.871691    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-envoy\") pod \"416a3ece-7fb6-4f4a-8d25-f65146013891\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") "
Sep 08 16:39:32.871948 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.871831    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "416a3ece-7fb6-4f4a-8d25-f65146013891" (UID: "416a3ece-7fb6-4f4a-8d25-f65146013891"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:32.871948 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.871891    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-data" (OuterVolumeSpecName: "istio-data") pod "416a3ece-7fb6-4f4a-8d25-f65146013891" (UID: "416a3ece-7fb6-4f4a-8d25-f65146013891"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:32.872165 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.872136    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfsjz\" (UniqueName: \"kubernetes.io/projected/416a3ece-7fb6-4f4a-8d25-f65146013891-kube-api-access-sfsjz\") pod \"416a3ece-7fb6-4f4a-8d25-f65146013891\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") "
Sep 08 16:39:32.872297 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.872176    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-workload-socket\") pod \"416a3ece-7fb6-4f4a-8d25-f65146013891\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") "
Sep 08 16:39:32.872297 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.872200    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-token\") pod \"416a3ece-7fb6-4f4a-8d25-f65146013891\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") "
Sep 08 16:39:32.872297 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.872252    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-credential-socket\") pod \"416a3ece-7fb6-4f4a-8d25-f65146013891\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") "
Sep 08 16:39:32.872297 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.872271    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/416a3ece-7fb6-4f4a-8d25-f65146013891-istiod-ca-cert\") pod \"416a3ece-7fb6-4f4a-8d25-f65146013891\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") "
Sep 08 16:39:32.872524 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.872305    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-podinfo\") pod \"416a3ece-7fb6-4f4a-8d25-f65146013891\" (UID: \"416a3ece-7fb6-4f4a-8d25-f65146013891\") "
Sep 08 16:39:32.872524 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.872463    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "416a3ece-7fb6-4f4a-8d25-f65146013891" (UID: "416a3ece-7fb6-4f4a-8d25-f65146013891"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:32.872676 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.872657    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:32.872734 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.872683    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:32.872734 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.872698    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:32.872860 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.872834    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/416a3ece-7fb6-4f4a-8d25-f65146013891-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "416a3ece-7fb6-4f4a-8d25-f65146013891" (UID: "416a3ece-7fb6-4f4a-8d25-f65146013891"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:39:32.873041 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.872998    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "416a3ece-7fb6-4f4a-8d25-f65146013891" (UID: "416a3ece-7fb6-4f4a-8d25-f65146013891"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:32.874452 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.874414    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "416a3ece-7fb6-4f4a-8d25-f65146013891" (UID: "416a3ece-7fb6-4f4a-8d25-f65146013891"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:32.874666 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.874637    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "416a3ece-7fb6-4f4a-8d25-f65146013891" (UID: "416a3ece-7fb6-4f4a-8d25-f65146013891"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:39:32.875296 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.875200    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-token" (OuterVolumeSpecName: "istio-token") pod "416a3ece-7fb6-4f4a-8d25-f65146013891" (UID: "416a3ece-7fb6-4f4a-8d25-f65146013891"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:39:32.875736 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.875713    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/416a3ece-7fb6-4f4a-8d25-f65146013891-kube-api-access-sfsjz" (OuterVolumeSpecName: "kube-api-access-sfsjz") pod "416a3ece-7fb6-4f4a-8d25-f65146013891" (UID: "416a3ece-7fb6-4f4a-8d25-f65146013891"). InnerVolumeSpecName "kube-api-access-sfsjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:39:32.969430 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.969334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:32.973937 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.973911    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:32.973937 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.973935    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:32.973937 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.973944    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/416a3ece-7fb6-4f4a-8d25-f65146013891-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:32.974132 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.973951    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:32.974132 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.973959    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/416a3ece-7fb6-4f4a-8d25-f65146013891-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:32.974132 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:32.973986    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfsjz\" (UniqueName: \"kubernetes.io/projected/416a3ece-7fb6-4f4a-8d25-f65146013891-kube-api-access-sfsjz\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:39:33.068818 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.068786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:33.182803 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.182757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:33.296493 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.296412    2562 generic.go:356] "Generic (PLEG): container finished" podID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerID="55a3b518befee2e0e5af8429f175f7c52ab80ee7444c4eadb5037f35f9ab8c6b" exitCode=0
Sep 08 16:39:33.296493 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.296483    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"
Sep 08 16:39:33.296780 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.296486    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" event={"ID":"416a3ece-7fb6-4f4a-8d25-f65146013891","Type":"ContainerDied","Data":"55a3b518befee2e0e5af8429f175f7c52ab80ee7444c4eadb5037f35f9ab8c6b"}
Sep 08 16:39:33.296780 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.296547    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v" event={"ID":"416a3ece-7fb6-4f4a-8d25-f65146013891","Type":"ContainerDied","Data":"4f5917ec1a4cd4e0e7d506f60d85e4cc3ed0d5b9bede53e457d3bf8ef9febae3"}
Sep 08 16:39:33.296780 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.296578    2562 scope.go:117] "RemoveContainer" containerID="55a3b518befee2e0e5af8429f175f7c52ab80ee7444c4eadb5037f35f9ab8c6b"
Sep 08 16:39:33.306582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.306522    2562 scope.go:117] "RemoveContainer" containerID="651f0f288ad183bea0aa11b41368b4f0d66df9e2c243c03fb1311293822d546b"
Sep 08 16:39:33.314751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.314734    2562 scope.go:117] "RemoveContainer" containerID="55a3b518befee2e0e5af8429f175f7c52ab80ee7444c4eadb5037f35f9ab8c6b"
Sep 08 16:39:33.315166 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:39:33.315143    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55a3b518befee2e0e5af8429f175f7c52ab80ee7444c4eadb5037f35f9ab8c6b\": container with ID starting with 55a3b518befee2e0e5af8429f175f7c52ab80ee7444c4eadb5037f35f9ab8c6b not found: ID does not exist" containerID="55a3b518befee2e0e5af8429f175f7c52ab80ee7444c4eadb5037f35f9ab8c6b"
Sep 08 16:39:33.315255 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.315172    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55a3b518befee2e0e5af8429f175f7c52ab80ee7444c4eadb5037f35f9ab8c6b"} err="failed to get container status \"55a3b518befee2e0e5af8429f175f7c52ab80ee7444c4eadb5037f35f9ab8c6b\": rpc error: code = NotFound desc = could not find container \"55a3b518befee2e0e5af8429f175f7c52ab80ee7444c4eadb5037f35f9ab8c6b\": container with ID starting with 55a3b518befee2e0e5af8429f175f7c52ab80ee7444c4eadb5037f35f9ab8c6b not found: ID does not exist"
Sep 08 16:39:33.315255 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.315188    2562 scope.go:117] "RemoveContainer" containerID="651f0f288ad183bea0aa11b41368b4f0d66df9e2c243c03fb1311293822d546b"
Sep 08 16:39:33.315523 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:39:33.315504    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"651f0f288ad183bea0aa11b41368b4f0d66df9e2c243c03fb1311293822d546b\": container with ID starting with 651f0f288ad183bea0aa11b41368b4f0d66df9e2c243c03fb1311293822d546b not found: ID does not exist" containerID="651f0f288ad183bea0aa11b41368b4f0d66df9e2c243c03fb1311293822d546b"
Sep 08 16:39:33.315583 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.315527    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651f0f288ad183bea0aa11b41368b4f0d66df9e2c243c03fb1311293822d546b"} err="failed to get container status \"651f0f288ad183bea0aa11b41368b4f0d66df9e2c243c03fb1311293822d546b\": rpc error: code = NotFound desc = could not find container \"651f0f288ad183bea0aa11b41368b4f0d66df9e2c243c03fb1311293822d546b\": container with ID starting with 651f0f288ad183bea0aa11b41368b4f0d66df9e2c243c03fb1311293822d546b not found: ID does not exist"
Sep 08 16:39:33.320569 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.320547    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"]
Sep 08 16:39:33.338739 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.338709    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v"]
Sep 08 16:39:33.576514 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:33.576437    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:39:34.005270 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:34.005238    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" path="/var/lib/kubelet/pods/416a3ece-7fb6-4f4a-8d25-f65146013891/volumes"
Sep 08 16:39:38.278796 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:38.278712    2562 patch_prober.go:28] interesting pod/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:39:38.278796 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:38.278764    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:39:40.338038 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:40.338000    2562 generic.go:356] "Generic (PLEG): container finished" podID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerID="948bb3bb6874155d4b1a3a43364b9b33503ff2b46a0a3f5725a5ee0eb5801531" exitCode=0
Sep 08 16:39:40.338472 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:40.338071    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" event={"ID":"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a","Type":"ContainerDied","Data":"948bb3bb6874155d4b1a3a43364b9b33503ff2b46a0a3f5725a5ee0eb5801531"}
Sep 08 16:39:40.338472 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:40.338418    2562 scope.go:117] "RemoveContainer" containerID="948bb3bb6874155d4b1a3a43364b9b33503ff2b46a0a3f5725a5ee0eb5801531"
Sep 08 16:39:40.339393 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:40.339368    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:39:40.339450 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:40.339437    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:39:40.339490 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:40.339471    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:39:40.994539 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:40.994502    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:39:41.349433 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:41.349340    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" event={"ID":"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a","Type":"ContainerStarted","Data":"802753af9337bdad7d85d879cab5a6f52bb7003dcbe9531365118fb5a3fa54a0"}
Sep 08 16:39:41.961051 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:41.961013    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:41.961258 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:41.961233    2562 patch_prober.go:28] interesting pod/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 08 16:39:41.961339 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:41.961291    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 08 16:39:42.961026 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:42.960991    2562 patch_prober.go:28] interesting pod/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 08 16:39:42.961397 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:42.961060    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 08 16:39:43.961071 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:43.961033    2562 patch_prober.go:28] interesting pod/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 08 16:39:43.961548 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:43.961108    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 08 16:39:44.960904 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:44.960866    2562 patch_prober.go:28] interesting pod/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 08 16:39:44.961084 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:44.960935    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 08 16:39:45.633414 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:45.633375    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:45.961067 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:45.961031    2562 patch_prober.go:28] interesting pod/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 08 16:39:45.961239 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:45.961097    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 08 16:39:46.964971 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:46.964939    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:46.965367 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:46.965180    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:46.965919 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:46.965904    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:39:48.310891 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:48.310850    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:49.037638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:49.037584    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:49.162855 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:49.162812    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:49.530547 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:49.530496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:53.540426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:53.540389    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:55.690778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:55.690749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:55.791721 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:55.791688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:56.290220 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.290185    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp"]
Sep 08 16:39:56.290536 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.290523    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerName="istio-proxy"
Sep 08 16:39:56.290582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.290539    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c023d74-bdb5-490b-a18e-e87552f4d653" containerName="istio-proxy"
Sep 08 16:39:56.290582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.290556    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerName="istio-proxy"
Sep 08 16:39:56.290582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.290561    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerName="istio-proxy"
Sep 08 16:39:56.290582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.290570    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerName="istio-proxy"
Sep 08 16:39:56.290582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.290575    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerName="istio-proxy"
Sep 08 16:39:56.290775 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.290650    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerName="istio-proxy"
Sep 08 16:39:56.290775 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.290663    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="416a3ece-7fb6-4f4a-8d25-f65146013891" containerName="istio-proxy"
Sep 08 16:39:56.290775 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.290671    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="849698a2-7cad-4e55-a7f8-2beeb0708f02" containerName="istio-proxy"
Sep 08 16:39:56.292842 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.292826    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp"
Sep 08 16:39:56.295480 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.295450    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:39:56.295582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.295508    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzslb\""
Sep 08 16:39:56.305955 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.305934    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp"]
Sep 08 16:39:56.370480 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.370445    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b97137f2-6192-4719-9a01-bd261befb57a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp\" (UID: \"b97137f2-6192-4719-9a01-bd261befb57a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp"
Sep 08 16:39:56.444919 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.444884    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:56.471702 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.471675    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b97137f2-6192-4719-9a01-bd261befb57a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp\" (UID: \"b97137f2-6192-4719-9a01-bd261befb57a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp"
Sep 08 16:39:56.472262 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.472244    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b97137f2-6192-4719-9a01-bd261befb57a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp\" (UID: \"b97137f2-6192-4719-9a01-bd261befb57a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp"
Sep 08 16:39:56.548838 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.548749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:56.602945 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.602907    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp"
Sep 08 16:39:56.777859 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.777822    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:56.876841 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:56.876815    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp"]
Sep 08 16:39:56.879588 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:39:56.879553    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97137f2_6192_4719_9a01_bd261befb57a.slice/crio-b17dac3571223bdd0d549b19465fa1f013928f29c78afbdfce60478331414b9b WatchSource:0}: Error finding container b17dac3571223bdd0d549b19465fa1f013928f29c78afbdfce60478331414b9b: Status 404 returned error can't find the container with id b17dac3571223bdd0d549b19465fa1f013928f29c78afbdfce60478331414b9b
Sep 08 16:39:57.130538 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.130474    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"]
Sep 08 16:39:57.132662 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.132646    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.135558 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.135537    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-823397-openshift-default-dockercfg-9f8h6\""
Sep 08 16:39:57.160667 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.160645    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"]
Sep 08 16:39:57.177347 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.177319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-istio-envoy\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.177450 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.177361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-credential-socket\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.177450 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.177409    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd64f\" (UniqueName: \"kubernetes.io/projected/34239daa-57e1-47d2-b785-6919adfac141-kube-api-access-jd64f\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.177450 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.177435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34239daa-57e1-47d2-b785-6919adfac141-istiod-ca-cert\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.177638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.177510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-workload-certs\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.177638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.177553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-istio-data\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.177638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.177591    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34239daa-57e1-47d2-b785-6919adfac141-istio-podinfo\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.177808 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.177666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-workload-socket\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.177808 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.177682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34239daa-57e1-47d2-b785-6919adfac141-istio-token\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.183680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.183655    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:57.278505 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.278471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-credential-socket\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.278505 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.278513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd64f\" (UniqueName: \"kubernetes.io/projected/34239daa-57e1-47d2-b785-6919adfac141-kube-api-access-jd64f\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.278793 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.278535    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34239daa-57e1-47d2-b785-6919adfac141-istiod-ca-cert\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.278793 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.278567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-workload-certs\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.278793 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.278588    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-istio-data\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.278793 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.278638    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34239daa-57e1-47d2-b785-6919adfac141-istio-podinfo\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.278793 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.278706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-workload-socket\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.279063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.278945    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-credential-socket\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.279063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.278999    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-workload-certs\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.279063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.279018    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-istio-data\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.279220 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.279067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34239daa-57e1-47d2-b785-6919adfac141-istio-token\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.279220 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.279087    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-workload-socket\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.279220 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.279106    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-istio-envoy\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.279585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.279559    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34239daa-57e1-47d2-b785-6919adfac141-istiod-ca-cert\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.281093 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.281074    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-istio-envoy\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.281196 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.281177    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34239daa-57e1-47d2-b785-6919adfac141-istio-podinfo\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.287490 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.287470    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34239daa-57e1-47d2-b785-6919adfac141-istio-token\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.287691 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.287674    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd64f\" (UniqueName: \"kubernetes.io/projected/34239daa-57e1-47d2-b785-6919adfac141-kube-api-access-jd64f\") pod \"e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") " pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.437402 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.437317    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp" event={"ID":"b97137f2-6192-4719-9a01-bd261befb57a","Type":"ContainerStarted","Data":"c562afaa6218bb58d152212085a87786a7d1b9aa0e8ff73d8e2821d000d44ab4"}
Sep 08 16:39:57.437402 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.437365    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp" event={"ID":"b97137f2-6192-4719-9a01-bd261befb57a","Type":"ContainerStarted","Data":"b17dac3571223bdd0d549b19465fa1f013928f29c78afbdfce60478331414b9b"}
Sep 08 16:39:57.442401 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.442383    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:57.455862 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.455817    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp" podStartSLOduration=1.45580402 podStartE2EDuration="1.45580402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:39:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:39:57.454720581 +0000 UTC m=+1040.039282201" watchObservedRunningTime="2026-09-08 16:39:57.45580402 +0000 UTC m=+1040.040365638"
Sep 08 16:39:57.579511 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.579478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:57.721529 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.721502    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"]
Sep 08 16:39:57.722782 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:39:57.722755    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34239daa_57e1_47d2_b785_6919adfac141.slice/crio-1e5941bcdb81da7afba469a0f71b0c343ab15f70ef0b5050ce712b1d4308b260 WatchSource:0}: Error finding container 1e5941bcdb81da7afba469a0f71b0c343ab15f70ef0b5050ce712b1d4308b260: Status 404 returned error can't find the container with id 1e5941bcdb81da7afba469a0f71b0c343ab15f70ef0b5050ce712b1d4308b260
Sep 08 16:39:57.725394 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.725362    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:39:57.725477 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.725446    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:39:57.725521 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:57.725475    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:39:58.445517 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:58.445487    2562 generic.go:356] "Generic (PLEG): container finished" podID="b97137f2-6192-4719-9a01-bd261befb57a" containerID="c562afaa6218bb58d152212085a87786a7d1b9aa0e8ff73d8e2821d000d44ab4" exitCode=0
Sep 08 16:39:58.445946 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:58.445571    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp" event={"ID":"b97137f2-6192-4719-9a01-bd261befb57a","Type":"ContainerDied","Data":"c562afaa6218bb58d152212085a87786a7d1b9aa0e8ff73d8e2821d000d44ab4"}
Sep 08 16:39:58.447178 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:58.447156    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" event={"ID":"34239daa-57e1-47d2-b785-6919adfac141","Type":"ContainerStarted","Data":"976131cb050272b9db4f88c0ce9dee1355348a6863668c69dee92f29a33a1d0d"}
Sep 08 16:39:58.447293 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:58.447198    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" event={"ID":"34239daa-57e1-47d2-b785-6919adfac141","Type":"ContainerStarted","Data":"1e5941bcdb81da7afba469a0f71b0c343ab15f70ef0b5050ce712b1d4308b260"}
Sep 08 16:39:58.497932 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:58.497878    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" podStartSLOduration=1.497861246 podStartE2EDuration="1.497861246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:39:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:39:58.492115522 +0000 UTC m=+1041.076677141" watchObservedRunningTime="2026-09-08 16:39:58.497861246 +0000 UTC m=+1041.082422866"
Sep 08 16:39:59.442842 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:59.442805    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:59.448085 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:59.448059    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:59.452330 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:59.452306    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:59.453110 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:59.453088    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:39:59.584026 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:59.584004    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp"
Sep 08 16:39:59.698143 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:59.698069    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b97137f2-6192-4719-9a01-bd261befb57a-maas-api-service-ca\") pod \"b97137f2-6192-4719-9a01-bd261befb57a\" (UID: \"b97137f2-6192-4719-9a01-bd261befb57a\") "
Sep 08 16:39:59.698448 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:59.698429    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b97137f2-6192-4719-9a01-bd261befb57a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b97137f2-6192-4719-9a01-bd261befb57a" (UID: "b97137f2-6192-4719-9a01-bd261befb57a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:39:59.799287 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:39:59.799259    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b97137f2-6192-4719-9a01-bd261befb57a-maas-api-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:40:00.458754 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:00.458730    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp"
Sep 08 16:40:00.459191 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:00.458772    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp" event={"ID":"b97137f2-6192-4719-9a01-bd261befb57a","Type":"ContainerDied","Data":"b17dac3571223bdd0d549b19465fa1f013928f29c78afbdfce60478331414b9b"}
Sep 08 16:40:00.459191 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:00.458816    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b17dac3571223bdd0d549b19465fa1f013928f29c78afbdfce60478331414b9b"
Sep 08 16:40:00.490565 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:00.490535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:00.604306 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:00.604274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:01.702324 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:01.702284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:01.801532 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:01.801480    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:01.964887 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:01.964800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:02.352502 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:02.352400    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:02.435941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:02.435908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:06.451285 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:06.451247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:07.176357 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:07.176324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:07.276109 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:07.276072    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:07.363734 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:07.363702    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:40:07.367969 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:07.367941    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:07.382501 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:07.382472    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp"]
Sep 08 16:40:07.385703 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:07.385681    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a69d4afb-bnnhp"]
Sep 08 16:40:07.448121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:07.448096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:07.792899 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:07.792806    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:08.006218 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:08.006182    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b97137f2-6192-4719-9a01-bd261befb57a" path="/var/lib/kubelet/pods/b97137f2-6192-4719-9a01-bd261befb57a/volumes"
Sep 08 16:40:13.641900 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:13.641861    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:13.742212 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:13.742168    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:13.999102 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:13.999062    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:14.098210 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:14.098178    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:14.177335 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:14.177306    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"]
Sep 08 16:40:14.177527 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:14.177507    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy" containerID="cri-o://802753af9337bdad7d85d879cab5a6f52bb7003dcbe9531365118fb5a3fa54a0" gracePeriod=30
Sep 08 16:40:14.199332 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:14.199304    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:14.546791 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:14.546753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:14.646879 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:14.646848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:14.763804 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:14.763771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:16.857584 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:16.857546    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:40:16.967861 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:16.967825    2562 patch_prober.go:28] interesting pod/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 16:40:16.968019 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:16.967897    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 16:40:17.554557 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:17.554525    2562 generic.go:356] "Generic (PLEG): container finished" podID="34239daa-57e1-47d2-b785-6919adfac141" containerID="976131cb050272b9db4f88c0ce9dee1355348a6863668c69dee92f29a33a1d0d" exitCode=0
Sep 08 16:40:17.554778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:17.554626    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" event={"ID":"34239daa-57e1-47d2-b785-6919adfac141","Type":"ContainerDied","Data":"976131cb050272b9db4f88c0ce9dee1355348a6863668c69dee92f29a33a1d0d"}
Sep 08 16:40:17.555081 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:17.555063    2562 scope.go:117] "RemoveContainer" containerID="976131cb050272b9db4f88c0ce9dee1355348a6863668c69dee92f29a33a1d0d"
Sep 08 16:40:17.556100 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:17.556072    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:40:17.556189 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:17.556144    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:40:17.556189 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:17.556181    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:40:18.561997 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:18.561962    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" event={"ID":"34239daa-57e1-47d2-b785-6919adfac141","Type":"ContainerStarted","Data":"494209fa44c28c8e2baa61f9393957fe4e6482c35df802c365ce4c941e5d970d"}
Sep 08 16:40:19.446638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.445170    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:40:19.446638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.445444    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:40:19.446638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.445497    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" podUID="34239daa-57e1-47d2-b785-6919adfac141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 16:40:19.456900 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.456883    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:40:19.569243 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.569212    2562 generic.go:356] "Generic (PLEG): container finished" podID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerID="802753af9337bdad7d85d879cab5a6f52bb7003dcbe9531365118fb5a3fa54a0" exitCode=0
Sep 08 16:40:19.569678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.569251    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" event={"ID":"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a","Type":"ContainerDied","Data":"802753af9337bdad7d85d879cab5a6f52bb7003dcbe9531365118fb5a3fa54a0"}
Sep 08 16:40:19.569678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.569260    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"
Sep 08 16:40:19.569678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.569308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s" event={"ID":"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a","Type":"ContainerDied","Data":"f183d8c2e37159a419d245e9644dcf1350a06bf572a891e0ae8c3ea7a33d1f86"}
Sep 08 16:40:19.569678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.569337    2562 scope.go:117] "RemoveContainer" containerID="802753af9337bdad7d85d879cab5a6f52bb7003dcbe9531365118fb5a3fa54a0"
Sep 08 16:40:19.578151 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.578134    2562 scope.go:117] "RemoveContainer" containerID="948bb3bb6874155d4b1a3a43364b9b33503ff2b46a0a3f5725a5ee0eb5801531"
Sep 08 16:40:19.583205 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583181    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-credential-socket\") pod \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") "
Sep 08 16:40:19.583310 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583219    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-podinfo\") pod \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") "
Sep 08 16:40:19.583310 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583243    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istiod-ca-cert\") pod \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") "
Sep 08 16:40:19.583310 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583265    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-envoy\") pod \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") "
Sep 08 16:40:19.583310 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583291    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-token\") pod \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") "
Sep 08 16:40:19.583542 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583327    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-data\") pod \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") "
Sep 08 16:40:19.583542 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583465    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" (UID: "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:40:19.583674 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583540    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4hrv\" (UniqueName: \"kubernetes.io/projected/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-kube-api-access-q4hrv\") pod \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") "
Sep 08 16:40:19.583674 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583548    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" (UID: "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:40:19.583674 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583577    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-workload-certs\") pod \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") "
Sep 08 16:40:19.583674 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583597    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" (UID: "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:40:19.583885 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583678    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-workload-socket\") pod \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\" (UID: \"0ae8bac6-8fd4-4bea-aaa3-95521a8a532a\") "
Sep 08 16:40:19.583972 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583953    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:40:19.584033 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583982    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:40:19.584033 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583997    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:40:19.584033 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583955    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" (UID: "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:40:19.584033 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.583979    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" (UID: "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:40:19.585392 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.585370    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" (UID: "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:40:19.585967 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.585943    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-kube-api-access-q4hrv" (OuterVolumeSpecName: "kube-api-access-q4hrv") pod "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" (UID: "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a"). InnerVolumeSpecName "kube-api-access-q4hrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:40:19.586049 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.585953    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" (UID: "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:40:19.586142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.586120    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" (UID: "0ae8bac6-8fd4-4bea-aaa3-95521a8a532a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:40:19.587429 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.587411    2562 scope.go:117] "RemoveContainer" containerID="802753af9337bdad7d85d879cab5a6f52bb7003dcbe9531365118fb5a3fa54a0"
Sep 08 16:40:19.587696 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:40:19.587680    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"802753af9337bdad7d85d879cab5a6f52bb7003dcbe9531365118fb5a3fa54a0\": container with ID starting with 802753af9337bdad7d85d879cab5a6f52bb7003dcbe9531365118fb5a3fa54a0 not found: ID does not exist" containerID="802753af9337bdad7d85d879cab5a6f52bb7003dcbe9531365118fb5a3fa54a0"
Sep 08 16:40:19.587779 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.587703    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"802753af9337bdad7d85d879cab5a6f52bb7003dcbe9531365118fb5a3fa54a0"} err="failed to get container status \"802753af9337bdad7d85d879cab5a6f52bb7003dcbe9531365118fb5a3fa54a0\": rpc error: code = NotFound desc = could not find container \"802753af9337bdad7d85d879cab5a6f52bb7003dcbe9531365118fb5a3fa54a0\": container with ID starting with 802753af9337bdad7d85d879cab5a6f52bb7003dcbe9531365118fb5a3fa54a0 not found: ID does not exist"
Sep 08 16:40:19.587779 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.587722    2562 scope.go:117] "RemoveContainer" containerID="948bb3bb6874155d4b1a3a43364b9b33503ff2b46a0a3f5725a5ee0eb5801531"
Sep 08 16:40:19.587952 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:40:19.587932    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"948bb3bb6874155d4b1a3a43364b9b33503ff2b46a0a3f5725a5ee0eb5801531\": container with ID starting with 948bb3bb6874155d4b1a3a43364b9b33503ff2b46a0a3f5725a5ee0eb5801531 not found: ID does not exist" containerID="948bb3bb6874155d4b1a3a43364b9b33503ff2b46a0a3f5725a5ee0eb5801531"
Sep 08 16:40:19.588024 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.587957    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"948bb3bb6874155d4b1a3a43364b9b33503ff2b46a0a3f5725a5ee0eb5801531"} err="failed to get container status \"948bb3bb6874155d4b1a3a43364b9b33503ff2b46a0a3f5725a5ee0eb5801531\": rpc error: code = NotFound desc = could not find container \"948bb3bb6874155d4b1a3a43364b9b33503ff2b46a0a3f5725a5ee0eb5801531\": container with ID starting with 948bb3bb6874155d4b1a3a43364b9b33503ff2b46a0a3f5725a5ee0eb5801531 not found: ID does not exist"
Sep 08 16:40:19.685495 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.685462    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4hrv\" (UniqueName: \"kubernetes.io/projected/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-kube-api-access-q4hrv\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:40:19.685495 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.685498    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:40:19.685719 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.685515    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:40:19.685719 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.685528    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:40:19.685719 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.685552    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:40:19.685719 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.685562    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:40:19.891396 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.891363    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"]
Sep 08 16:40:19.897940 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:19.897918    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s"]
Sep 08 16:40:20.005774 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:20.005741    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" path="/var/lib/kubelet/pods/0ae8bac6-8fd4-4bea-aaa3-95521a8a532a/volumes"
Sep 08 16:40:20.443033 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:20.442987    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:40:20.443238 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:20.443054    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" podUID="34239daa-57e1-47d2-b785-6919adfac141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 16:40:20.828278 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:20.828177    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:20.927291 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:20.927246    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:21.066656 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:21.066599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:21.443084 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:21.443037    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:40:21.443298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:21.443130    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" podUID="34239daa-57e1-47d2-b785-6919adfac141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 16:40:22.443778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:22.443309    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:40:22.443778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:22.443385    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" podUID="34239daa-57e1-47d2-b785-6919adfac141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 16:40:23.443801 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:23.443763    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:40:23.444380 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:23.444351    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" podUID="34239daa-57e1-47d2-b785-6919adfac141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 16:40:24.054067 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:24.054035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:24.446850 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:24.446820    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:40:24.447245 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:24.447224    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:40:24.447790 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:24.447775    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:40:25.433058 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:25.433019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:27.330464 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:27.330430    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:27.430302 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:27.430271    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:28.247997 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.247960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:28.548618 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.548529    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"]
Sep 08 16:40:28.548944 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.548931    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b97137f2-6192-4719-9a01-bd261befb57a" containerName="revoke-keys"
Sep 08 16:40:28.548985 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.548945    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b97137f2-6192-4719-9a01-bd261befb57a" containerName="revoke-keys"
Sep 08 16:40:28.548985 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.548966    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy"
Sep 08 16:40:28.548985 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.548972    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy"
Sep 08 16:40:28.548985 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.548982    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy"
Sep 08 16:40:28.549119 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.548987    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy"
Sep 08 16:40:28.549119 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.549039    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b97137f2-6192-4719-9a01-bd261befb57a" containerName="revoke-keys"
Sep 08 16:40:28.549119 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.549047    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy"
Sep 08 16:40:28.549119 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.549052    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ae8bac6-8fd4-4bea-aaa3-95521a8a532a" containerName="istio-proxy"
Sep 08 16:40:28.551897 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.551880    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.554392 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.554372    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-5a3b57-openshift-default-dockercfg-bm547\""
Sep 08 16:40:28.569334 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.569313    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"]
Sep 08 16:40:28.577520 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.577494    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:28.669309 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.669269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-workload-socket\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.669309 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.669302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-istio-envoy\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.669569 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.669383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-credential-socket\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.669569 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.669437    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6nwm\" (UniqueName: \"kubernetes.io/projected/7a624588-6e7a-470e-9fb0-560dd334d301-kube-api-access-n6nwm\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.669569 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.669481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-workload-certs\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.669569 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.669549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a624588-6e7a-470e-9fb0-560dd334d301-istio-podinfo\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.669813 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.669718    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-istio-data\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.669813 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.669782    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a624588-6e7a-470e-9fb0-560dd334d301-istio-token\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.669813 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.669809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a624588-6e7a-470e-9fb0-560dd334d301-istiod-ca-cert\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.770796 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.770768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-istio-data\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.770944 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.770815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a624588-6e7a-470e-9fb0-560dd334d301-istio-token\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.770944 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.770838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a624588-6e7a-470e-9fb0-560dd334d301-istiod-ca-cert\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.770944 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.770868    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-workload-socket\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.770944 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.770890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-istio-envoy\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.770944 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.770923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-credential-socket\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.771201 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.770957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6nwm\" (UniqueName: \"kubernetes.io/projected/7a624588-6e7a-470e-9fb0-560dd334d301-kube-api-access-n6nwm\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.771201 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.771011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-workload-certs\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.771201 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.771047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a624588-6e7a-470e-9fb0-560dd334d301-istio-podinfo\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.771436 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.771403    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-credential-socket\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.771436 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.771417    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-workload-socket\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.771655 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.771478    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-istio-data\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.771714 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.771684    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-workload-certs\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.771906 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.771882    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a624588-6e7a-470e-9fb0-560dd334d301-istiod-ca-cert\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.773304 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.773275    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-istio-envoy\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.773558 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.773542    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a624588-6e7a-470e-9fb0-560dd334d301-istio-podinfo\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.779080 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.779052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a624588-6e7a-470e-9fb0-560dd334d301-istio-token\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.779257 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.779236    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6nwm\" (UniqueName: \"kubernetes.io/projected/7a624588-6e7a-470e-9fb0-560dd334d301-kube-api-access-n6nwm\") pod \"e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") " pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:28.841328 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.841243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:28.862159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:28.862135    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:29.142522 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:29.142494    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"]
Sep 08 16:40:29.143623 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:40:29.143581    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a624588_6e7a_470e_9fb0_560dd334d301.slice/crio-bc5452c76eb500ea9f425efc907cab6559602f4bc6d9f1249894daac357a3920 WatchSource:0}: Error finding container bc5452c76eb500ea9f425efc907cab6559602f4bc6d9f1249894daac357a3920: Status 404 returned error can't find the container with id bc5452c76eb500ea9f425efc907cab6559602f4bc6d9f1249894daac357a3920
Sep 08 16:40:29.145954 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:29.145922    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:40:29.146052 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:29.146001    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:40:29.146119 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:29.146048    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:40:29.626015 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:29.625985    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" event={"ID":"7a624588-6e7a-470e-9fb0-560dd334d301","Type":"ContainerStarted","Data":"3899a83b213c5fba75171efca27e9e7185229b83fafb5b0ce408b721611a6436"}
Sep 08 16:40:29.626389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:29.626033    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" event={"ID":"7a624588-6e7a-470e-9fb0-560dd334d301","Type":"ContainerStarted","Data":"bc5452c76eb500ea9f425efc907cab6559602f4bc6d9f1249894daac357a3920"}
Sep 08 16:40:29.648368 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:29.648321    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" podStartSLOduration=1.648305301 podStartE2EDuration="1.648305301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:40:29.646672781 +0000 UTC m=+1072.231234399" watchObservedRunningTime="2026-09-08 16:40:29.648305301 +0000 UTC m=+1072.232866972"
Sep 08 16:40:29.863201 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:29.863169    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:30.867355 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:30.867284    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:31.449712 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.449675    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"]
Sep 08 16:40:31.452374 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.452357    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.455690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.455666    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-a4942b\"/\"kube-root-ca.crt\""
Sep 08 16:40:31.455690 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.455691    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-a4942b\"/\"default-dockercfg-vg2fx\""
Sep 08 16:40:31.455891 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.455689    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-a4942b\"/\"auth-test-model-a4942b-kserve-self-signed-certs\""
Sep 08 16:40:31.455891 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.455770    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-a4942b\"/\"openshift-service-ca.crt\""
Sep 08 16:40:31.462894 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.462870    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"]
Sep 08 16:40:31.493515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.493489    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-model-cache\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.493648 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.493539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96tv2\" (UniqueName: \"kubernetes.io/projected/86bdc4ef-532d-46ed-82d1-2a0d68418d71-kube-api-access-96tv2\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.493648 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.493572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86bdc4ef-532d-46ed-82d1-2a0d68418d71-tls-certs\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.493648 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.493588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-home\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.493762 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.493682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-dshm\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.493762 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.493706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-tmp-dir\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.570476 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.570446    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:31.594778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.594747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-model-cache\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.594911 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.594782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96tv2\" (UniqueName: \"kubernetes.io/projected/86bdc4ef-532d-46ed-82d1-2a0d68418d71-kube-api-access-96tv2\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.594911 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.594807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86bdc4ef-532d-46ed-82d1-2a0d68418d71-tls-certs\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.594911 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.594824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-home\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.594911 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.594865    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-dshm\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.594911 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.594885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-tmp-dir\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.595311 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.595283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-home\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.595399 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.595311    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-model-cache\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.595399 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.595325    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-tmp-dir\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.597073 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.597051    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-dshm\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.597190 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.597173    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86bdc4ef-532d-46ed-82d1-2a0d68418d71-tls-certs\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.620781 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.620754    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96tv2\" (UniqueName: \"kubernetes.io/projected/86bdc4ef-532d-46ed-82d1-2a0d68418d71-kube-api-access-96tv2\") pod \"auth-test-model-a4942b-kserve-67965d5475-5tlzt\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:31.637682 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.637658    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:31.638497 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.638477    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:31.674219 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.674194    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:31.762310 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:31.762234    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:32.064807 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:32.064781    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"]
Sep 08 16:40:32.065755 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:40:32.065724    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86bdc4ef_532d_46ed_82d1_2a0d68418d71.slice/crio-fd5448d9788ec9fcb0e71301b3c6019b72a4bab39f4ff4213eb2bbc2b4abc9d2 WatchSource:0}: Error finding container fd5448d9788ec9fcb0e71301b3c6019b72a4bab39f4ff4213eb2bbc2b4abc9d2: Status 404 returned error can't find the container with id fd5448d9788ec9fcb0e71301b3c6019b72a4bab39f4ff4213eb2bbc2b4abc9d2
Sep 08 16:40:32.643908 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:32.643870    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt" event={"ID":"86bdc4ef-532d-46ed-82d1-2a0d68418d71","Type":"ContainerStarted","Data":"61b2573f801702739fb24b22658312950080d83d38fbfb3408d5af987dffa96a"}
Sep 08 16:40:32.643908 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:32.643912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt" event={"ID":"86bdc4ef-532d-46ed-82d1-2a0d68418d71","Type":"ContainerStarted","Data":"fd5448d9788ec9fcb0e71301b3c6019b72a4bab39f4ff4213eb2bbc2b4abc9d2"}
Sep 08 16:40:32.664455 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:32.664405    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt" podStartSLOduration=1.664390979 podStartE2EDuration="1.664390979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:40:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:40:32.661410685 +0000 UTC m=+1075.245972304" watchObservedRunningTime="2026-09-08 16:40:32.664390979 +0000 UTC m=+1075.248952598"
Sep 08 16:40:32.793985 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:32.793948    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:32.924814 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:32.924724    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:33.477926 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:33.477878    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:33.569349 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:33.569314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:33.653113 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:33.653083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:38.559515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:38.559472    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:40:41.762907 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:41.762854    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:41.763333 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:41.762928    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:41.775495 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:41.775466    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:42.710487 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:42.710455    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:40:47.679775 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:47.679721    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:40:47.680259 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:47.679797    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:40:49.739911 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:49.739878    2562 generic.go:356] "Generic (PLEG): container finished" podID="7a624588-6e7a-470e-9fb0-560dd334d301" containerID="3899a83b213c5fba75171efca27e9e7185229b83fafb5b0ce408b721611a6436" exitCode=0
Sep 08 16:40:49.740338 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:49.739948    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" event={"ID":"7a624588-6e7a-470e-9fb0-560dd334d301","Type":"ContainerDied","Data":"3899a83b213c5fba75171efca27e9e7185229b83fafb5b0ce408b721611a6436"}
Sep 08 16:40:49.740394 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:49.740348    2562 scope.go:117] "RemoveContainer" containerID="3899a83b213c5fba75171efca27e9e7185229b83fafb5b0ce408b721611a6436"
Sep 08 16:40:49.741414 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:49.741386    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:40:49.741487 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:49.741470    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:40:49.741532 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:49.741511    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:40:50.749983 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:50.749951    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" event={"ID":"7a624588-6e7a-470e-9fb0-560dd334d301","Type":"ContainerStarted","Data":"b6aae7cec50fe87cbed9c10fd558fd2b08822d5fe013051bdd2f256f68c56b90"}
Sep 08 16:40:50.862665 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:50.862629    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:50.862881 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:50.862859    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 08 16:40:50.862927 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:50.862907    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 08 16:40:51.862937 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:51.862895    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 08 16:40:51.863339 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:51.862957    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 08 16:40:52.863010 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:52.862973    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 08 16:40:52.863413 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:52.863034    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 08 16:40:53.862860 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:53.862823    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 08 16:40:53.863067 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:53.862898    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 08 16:40:54.655929 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.655894    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"]
Sep 08 16:40:54.658558 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.658540    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.661028 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.661009    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-823397\"/\"kube-root-ca.crt\""
Sep 08 16:40:54.661775 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.661752    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-823397\"/\"openshift-service-ca.crt\""
Sep 08 16:40:54.661886 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.661764    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-823397\"/\"default-dockercfg-ntzvq\""
Sep 08 16:40:54.661886 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.661856    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-823397\"/\"auth-test-model-823397-kserve-self-signed-certs\""
Sep 08 16:40:54.670232 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.670210    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"]
Sep 08 16:40:54.686136 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.686108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:54.797880 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.797848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-home\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.797880 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.797884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-dshm\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.798081 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.797910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5zjk\" (UniqueName: \"kubernetes.io/projected/5f07a141-5072-4fac-bf1c-52c75144d9ec-kube-api-access-b5zjk\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.798081 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.797973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f07a141-5072-4fac-bf1c-52c75144d9ec-tls-certs\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.798081 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.798045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-tmp-dir\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.798184 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.798123    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-model-cache\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.863384 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.863345    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 08 16:40:54.863792 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.863404    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 08 16:40:54.899570 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.899535    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5zjk\" (UniqueName: \"kubernetes.io/projected/5f07a141-5072-4fac-bf1c-52c75144d9ec-kube-api-access-b5zjk\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.899721 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.899579    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f07a141-5072-4fac-bf1c-52c75144d9ec-tls-certs\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.899721 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.899628    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-tmp-dir\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.899721 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.899695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-model-cache\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.899890 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.899743    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-home\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.899890 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.899769    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-dshm\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.900103 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.900082    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-tmp-dir\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.900171 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.900099    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-model-cache\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.900171 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.900128    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-home\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.901968 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.901943    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-dshm\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.902114 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.902097    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f07a141-5072-4fac-bf1c-52c75144d9ec-tls-certs\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.907715 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.907660    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5zjk\" (UniqueName: \"kubernetes.io/projected/5f07a141-5072-4fac-bf1c-52c75144d9ec-kube-api-access-b5zjk\") pod \"auth-test-model-823397-kserve-7bd9b7b84c-4jh4p\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") " pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:54.970882 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:54.970838    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:40:55.255083 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:55.255059    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"]
Sep 08 16:40:55.256907 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:40:55.256875    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f07a141_5072_4fac_bf1c_52c75144d9ec.slice/crio-d6dc64b94a5a8760df2515871812e4ad37c462dbc132516cc0bffd88a56e73ec WatchSource:0}: Error finding container d6dc64b94a5a8760df2515871812e4ad37c462dbc132516cc0bffd88a56e73ec: Status 404 returned error can't find the container with id d6dc64b94a5a8760df2515871812e4ad37c462dbc132516cc0bffd88a56e73ec
Sep 08 16:40:55.779064 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:55.779013    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p" event={"ID":"5f07a141-5072-4fac-bf1c-52c75144d9ec","Type":"ContainerStarted","Data":"bef024ef1708bc02daad3b9a6608f18ff6c09917ea952f254e677a49e833a2c0"}
Sep 08 16:40:55.779064 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:55.779076    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p" event={"ID":"5f07a141-5072-4fac-bf1c-52c75144d9ec","Type":"ContainerStarted","Data":"d6dc64b94a5a8760df2515871812e4ad37c462dbc132516cc0bffd88a56e73ec"}
Sep 08 16:40:55.795341 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:55.795283    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p" podStartSLOduration=1.795261787 podStartE2EDuration="1.795261787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:40:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:40:55.79427119 +0000 UTC m=+1098.378832811" watchObservedRunningTime="2026-09-08 16:40:55.795261787 +0000 UTC m=+1098.379823405"
Sep 08 16:40:55.865815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:55.865782    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:55.866268 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:55.866143    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:55.866916 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:55.866897    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:40:56.613267 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:56.613223    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:56.995074 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:56.995038    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:57.278528 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.278448    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"]
Sep 08 16:40:57.280781 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.280764    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.285033 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.285016    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-b0b77f-openshift-default-dockercfg-ztq48\""
Sep 08 16:40:57.296158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.296136    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"]
Sep 08 16:40:57.299499 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.299470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:57.423299 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.423267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-data\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.423299 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.423300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-workload-certs\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.423588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.423326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-envoy\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.423588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.423367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-token\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.423588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.423394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-podinfo\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.423588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.423416    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-workload-socket\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.423588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.423467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-credential-socket\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.423588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.423523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istiod-ca-cert\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.423588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.423560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kb4c\" (UniqueName: \"kubernetes.io/projected/2eb365ca-f0d9-4d3d-a897-bc0187243c02-kube-api-access-5kb4c\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.524713 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.524680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-data\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.524860 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.524719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-workload-certs\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.524860 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.524745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-envoy\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.524860 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.524773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-token\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.524860 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.524804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-podinfo\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.524860 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.524849    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-workload-socket\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.525127 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.524889    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-credential-socket\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.525127 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.524931    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istiod-ca-cert\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.525127 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.524964    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kb4c\" (UniqueName: \"kubernetes.io/projected/2eb365ca-f0d9-4d3d-a897-bc0187243c02-kube-api-access-5kb4c\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.525278 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.525123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-workload-certs\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.525335 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.525283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-data\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.525473 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.525446    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-workload-socket\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.525540 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.525475    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-credential-socket\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.525821 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.525801    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istiod-ca-cert\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.527020 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.527001    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-envoy\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.527361 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.527342    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-podinfo\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.544943 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.544888    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kb4c\" (UniqueName: \"kubernetes.io/projected/2eb365ca-f0d9-4d3d-a897-bc0187243c02-kube-api-access-5kb4c\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.547582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.547558    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-token\") pod \"e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") " pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.591791 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.591769    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:57.876382 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.876352    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"]
Sep 08 16:40:57.877782 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:40:57.877755    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb365ca_f0d9_4d3d_a897_bc0187243c02.slice/crio-493f2d804004f5257df255e5bdf39cb6ebd0c1cbf37c8524c9ec631733775f2e WatchSource:0}: Error finding container 493f2d804004f5257df255e5bdf39cb6ebd0c1cbf37c8524c9ec631733775f2e: Status 404 returned error can't find the container with id 493f2d804004f5257df255e5bdf39cb6ebd0c1cbf37c8524c9ec631733775f2e
Sep 08 16:40:57.880136 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.880107    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:40:57.880220 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.880165    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:40:57.880220 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:57.880194    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:40:58.029397 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:58.029358    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:58.798104 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:58.798074    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf" event={"ID":"2eb365ca-f0d9-4d3d-a897-bc0187243c02","Type":"ContainerStarted","Data":"12ca995e73146bab0b4ece1e402db6754884b328898a913b54648764d400360b"}
Sep 08 16:40:58.798266 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:58.798123    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf" event={"ID":"2eb365ca-f0d9-4d3d-a897-bc0187243c02","Type":"ContainerStarted","Data":"493f2d804004f5257df255e5bdf39cb6ebd0c1cbf37c8524c9ec631733775f2e"}
Sep 08 16:40:58.821928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:58.821881    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf" podStartSLOduration=1.821866633 podStartE2EDuration="1.821866633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:40:58.820032156 +0000 UTC m=+1101.404593787" watchObservedRunningTime="2026-09-08 16:40:58.821866633 +0000 UTC m=+1101.406428251"
Sep 08 16:40:59.592805 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:59.592765    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:59.597794 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:59.597771    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:59.803763 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:59.803732    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:40:59.804647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:40:59.804629    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:41:00.172506 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:00.172470    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:41:00.938028 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:00.937996    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:01.074195 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:01.074164    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:02.223407 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:02.223361    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:02.336985 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:02.336948    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:02.541730 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:02.541644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:02.780392 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:02.780354    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:02.896892 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:02.896806    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:04.971559 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:04.971529    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:41:04.971949 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:04.971573    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:41:04.989691 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:04.989665    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:41:05.847603 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:05.847573    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:41:15.562476 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:15.562434    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:41:18.912392 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:18.912364    2562 generic.go:356] "Generic (PLEG): container finished" podID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerID="12ca995e73146bab0b4ece1e402db6754884b328898a913b54648764d400360b" exitCode=0
Sep 08 16:41:18.912819 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:18.912446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf" event={"ID":"2eb365ca-f0d9-4d3d-a897-bc0187243c02","Type":"ContainerDied","Data":"12ca995e73146bab0b4ece1e402db6754884b328898a913b54648764d400360b"}
Sep 08 16:41:18.912982 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:18.912964    2562 scope.go:117] "RemoveContainer" containerID="12ca995e73146bab0b4ece1e402db6754884b328898a913b54648764d400360b"
Sep 08 16:41:18.914073 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:18.914043    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:41:18.914155 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:18.914110    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:41:18.914155 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:18.914140    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:41:19.919577 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:19.919541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf" event={"ID":"2eb365ca-f0d9-4d3d-a897-bc0187243c02","Type":"ContainerStarted","Data":"50818b14d805f5f94eaaf796d774fba8147a612ec885485088b35b9247219408"}
Sep 08 16:41:20.592037 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:20.591997    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:41:20.592230 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:20.592207    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 08 16:41:20.592285 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:20.592255    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf" podUID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 08 16:41:21.593106 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:21.593066    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 08 16:41:21.593513 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:21.593123    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf" podUID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 08 16:41:22.593120 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:22.593081    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 08 16:41:22.593516 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:22.593139    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf" podUID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 08 16:41:23.592574 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:23.592535    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 08 16:41:23.592783 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:23.592599    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf" podUID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 08 16:41:24.592735 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:24.592694    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 08 16:41:24.593182 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:24.592751    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf" podUID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 08 16:41:25.595716 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:25.595685    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:41:25.596077 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:25.595974    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:41:25.596675 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:25.596659    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:41:25.792756 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:25.792715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:26.480603 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:26.480566    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7839-139884357490272"]
Sep 08 16:41:26.483118 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:26.483101    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:26.485561 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:26.485536    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mrsv6\""
Sep 08 16:41:26.489706 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:26.489683    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7839-139884357490272"]
Sep 08 16:41:26.499680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:26.499657    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4k4f\" (UniqueName: \"kubernetes.io/projected/d0768016-30ad-4476-a84b-6706eb96c9be-kube-api-access-r4k4f\") pod \"test-curl-7839-139884357490272\" (UID: \"d0768016-30ad-4476-a84b-6706eb96c9be\") " pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:26.600132 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:26.600098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4k4f\" (UniqueName: \"kubernetes.io/projected/d0768016-30ad-4476-a84b-6706eb96c9be-kube-api-access-r4k4f\") pod \"test-curl-7839-139884357490272\" (UID: \"d0768016-30ad-4476-a84b-6706eb96c9be\") " pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:26.609364 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:26.609343    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4k4f\" (UniqueName: \"kubernetes.io/projected/d0768016-30ad-4476-a84b-6706eb96c9be-kube-api-access-r4k4f\") pod \"test-curl-7839-139884357490272\" (UID: \"d0768016-30ad-4476-a84b-6706eb96c9be\") " pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:26.794239 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:26.794171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:27.065394 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:27.065367    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7839-139884357490272"]
Sep 08 16:41:27.066387 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:41:27.066364    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0768016_30ad_4476_a84b_6706eb96c9be.slice/crio-5576120ca1ac0b84d0e0ebe3bbf8d6b1b9cfc9945cd1e91a0d8a06ab85d26e95 WatchSource:0}: Error finding container 5576120ca1ac0b84d0e0ebe3bbf8d6b1b9cfc9945cd1e91a0d8a06ab85d26e95: Status 404 returned error can't find the container with id 5576120ca1ac0b84d0e0ebe3bbf8d6b1b9cfc9945cd1e91a0d8a06ab85d26e95
Sep 08 16:41:27.067582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:27.067564    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:41:27.974622 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:27.974586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7839-139884357490272" event={"ID":"d0768016-30ad-4476-a84b-6706eb96c9be","Type":"ContainerStarted","Data":"5576120ca1ac0b84d0e0ebe3bbf8d6b1b9cfc9945cd1e91a0d8a06ab85d26e95"}
Sep 08 16:41:28.356751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:28.356673    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:41:28.981311 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:28.981275    2562 generic.go:356] "Generic (PLEG): container finished" podID="d0768016-30ad-4476-a84b-6706eb96c9be" containerID="ab2cd8044417cb60055a6125b4feed8751580eab1ac2c864f707306a4d43dff0" exitCode=0
Sep 08 16:41:28.981714 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:28.981335    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7839-139884357490272" event={"ID":"d0768016-30ad-4476-a84b-6706eb96c9be","Type":"ContainerDied","Data":"ab2cd8044417cb60055a6125b4feed8751580eab1ac2c864f707306a4d43dff0"}
Sep 08 16:41:30.124462 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.124436    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:30.144673 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.144647    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7839-139884357490272_d0768016-30ad-4476-a84b-6706eb96c9be/test-curl-7839-139884357490272/0.log"
Sep 08 16:41:30.173671 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.173648    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7839-139884357490272"]
Sep 08 16:41:30.175788 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.175766    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7839-139884357490272"]
Sep 08 16:41:30.234445 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.234422    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4k4f\" (UniqueName: \"kubernetes.io/projected/d0768016-30ad-4476-a84b-6706eb96c9be-kube-api-access-r4k4f\") pod \"d0768016-30ad-4476-a84b-6706eb96c9be\" (UID: \"d0768016-30ad-4476-a84b-6706eb96c9be\") "
Sep 08 16:41:30.236398 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.236377    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0768016-30ad-4476-a84b-6706eb96c9be-kube-api-access-r4k4f" (OuterVolumeSpecName: "kube-api-access-r4k4f") pod "d0768016-30ad-4476-a84b-6706eb96c9be" (UID: "d0768016-30ad-4476-a84b-6706eb96c9be"). InnerVolumeSpecName "kube-api-access-r4k4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:41:30.305400 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.305377    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7839-139884357490272"]
Sep 08 16:41:30.305755 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.305741    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0768016-30ad-4476-a84b-6706eb96c9be" containerName="test-curl-7839-139884357490272"
Sep 08 16:41:30.305809 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.305757    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0768016-30ad-4476-a84b-6706eb96c9be" containerName="test-curl-7839-139884357490272"
Sep 08 16:41:30.305843 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.305813    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0768016-30ad-4476-a84b-6706eb96c9be" containerName="test-curl-7839-139884357490272"
Sep 08 16:41:30.307683 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.307669    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:30.317120 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.317098    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7839-139884357490272"]
Sep 08 16:41:30.335979 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.335955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc8v2\" (UniqueName: \"kubernetes.io/projected/abfc272a-06b1-4099-bbe0-13ebbe605a77-kube-api-access-vc8v2\") pod \"test-curl-7839-139884357490272\" (UID: \"abfc272a-06b1-4099-bbe0-13ebbe605a77\") " pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:30.336102 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.336008    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4k4f\" (UniqueName: \"kubernetes.io/projected/d0768016-30ad-4476-a84b-6706eb96c9be-kube-api-access-r4k4f\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:41:30.436756 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.436728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc8v2\" (UniqueName: \"kubernetes.io/projected/abfc272a-06b1-4099-bbe0-13ebbe605a77-kube-api-access-vc8v2\") pod \"test-curl-7839-139884357490272\" (UID: \"abfc272a-06b1-4099-bbe0-13ebbe605a77\") " pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:30.444917 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.444895    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc8v2\" (UniqueName: \"kubernetes.io/projected/abfc272a-06b1-4099-bbe0-13ebbe605a77-kube-api-access-vc8v2\") pod \"test-curl-7839-139884357490272\" (UID: \"abfc272a-06b1-4099-bbe0-13ebbe605a77\") " pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:30.617182 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.617124    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:30.890934 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:41:30.890896    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabfc272a_06b1_4099_bbe0_13ebbe605a77.slice/crio-70fdf83b7f64457d67f5687899782ce748258d4b4659eea4b2a1214ea964b259 WatchSource:0}: Error finding container 70fdf83b7f64457d67f5687899782ce748258d4b4659eea4b2a1214ea964b259: Status 404 returned error can't find the container with id 70fdf83b7f64457d67f5687899782ce748258d4b4659eea4b2a1214ea964b259
Sep 08 16:41:30.891698 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.891666    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7839-139884357490272"]
Sep 08 16:41:30.993760 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.993726    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7839-139884357490272" event={"ID":"abfc272a-06b1-4099-bbe0-13ebbe605a77","Type":"ContainerStarted","Data":"70fdf83b7f64457d67f5687899782ce748258d4b4659eea4b2a1214ea964b259"}
Sep 08 16:41:30.994923 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.994906    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:30.994923 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:30.994914    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5576120ca1ac0b84d0e0ebe3bbf8d6b1b9cfc9945cd1e91a0d8a06ab85d26e95"
Sep 08 16:41:31.006308 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:31.006276    2562 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7839-139884357490272" oldPodUID="d0768016-30ad-4476-a84b-6706eb96c9be" podUID="abfc272a-06b1-4099-bbe0-13ebbe605a77"
Sep 08 16:41:32.002118 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:32.002093    2562 generic.go:356] "Generic (PLEG): container finished" podID="abfc272a-06b1-4099-bbe0-13ebbe605a77" containerID="b96d9d66727daf8a6be4b0dd2bf4a190b9d87d5413ee3866b48859ee6cd26c20" exitCode=0
Sep 08 16:41:32.006275 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:32.006252    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0768016-30ad-4476-a84b-6706eb96c9be" path="/var/lib/kubelet/pods/d0768016-30ad-4476-a84b-6706eb96c9be/volumes"
Sep 08 16:41:32.006548 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:32.006531    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7839-139884357490272" event={"ID":"abfc272a-06b1-4099-bbe0-13ebbe605a77","Type":"ContainerDied","Data":"b96d9d66727daf8a6be4b0dd2bf4a190b9d87d5413ee3866b48859ee6cd26c20"}
Sep 08 16:41:33.139447 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.139422    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:33.161112 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.161089    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7839-139884357490272_abfc272a-06b1-4099-bbe0-13ebbe605a77/test-curl-7839-139884357490272/0.log"
Sep 08 16:41:33.188911 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.188887    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7839-139884357490272"]
Sep 08 16:41:33.192915 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.192894    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7839-139884357490272"]
Sep 08 16:41:33.260818 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.260762    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc8v2\" (UniqueName: \"kubernetes.io/projected/abfc272a-06b1-4099-bbe0-13ebbe605a77-kube-api-access-vc8v2\") pod \"abfc272a-06b1-4099-bbe0-13ebbe605a77\" (UID: \"abfc272a-06b1-4099-bbe0-13ebbe605a77\") "
Sep 08 16:41:33.262742 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.262719    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abfc272a-06b1-4099-bbe0-13ebbe605a77-kube-api-access-vc8v2" (OuterVolumeSpecName: "kube-api-access-vc8v2") pod "abfc272a-06b1-4099-bbe0-13ebbe605a77" (UID: "abfc272a-06b1-4099-bbe0-13ebbe605a77"). InnerVolumeSpecName "kube-api-access-vc8v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:41:33.312241 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.312218    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7839-139884357490848"]
Sep 08 16:41:33.312659 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.312643    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abfc272a-06b1-4099-bbe0-13ebbe605a77" containerName="test-curl-7839-139884357490272"
Sep 08 16:41:33.312714 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.312663    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="abfc272a-06b1-4099-bbe0-13ebbe605a77" containerName="test-curl-7839-139884357490272"
Sep 08 16:41:33.312751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.312723    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="abfc272a-06b1-4099-bbe0-13ebbe605a77" containerName="test-curl-7839-139884357490272"
Sep 08 16:41:33.315785 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.315772    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:33.321046 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.321017    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7839-139884357490848"]
Sep 08 16:41:33.361887 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.361860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mmf8\" (UniqueName: \"kubernetes.io/projected/7d24d441-1a41-447c-92b5-c8d142be8685-kube-api-access-6mmf8\") pod \"test-curl-7839-139884357490848\" (UID: \"7d24d441-1a41-447c-92b5-c8d142be8685\") " pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:33.361982 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.361903    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc8v2\" (UniqueName: \"kubernetes.io/projected/abfc272a-06b1-4099-bbe0-13ebbe605a77-kube-api-access-vc8v2\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:41:33.463039 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.463018    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mmf8\" (UniqueName: \"kubernetes.io/projected/7d24d441-1a41-447c-92b5-c8d142be8685-kube-api-access-6mmf8\") pod \"test-curl-7839-139884357490848\" (UID: \"7d24d441-1a41-447c-92b5-c8d142be8685\") " pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:33.472141 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.472115    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mmf8\" (UniqueName: \"kubernetes.io/projected/7d24d441-1a41-447c-92b5-c8d142be8685-kube-api-access-6mmf8\") pod \"test-curl-7839-139884357490848\" (UID: \"7d24d441-1a41-447c-92b5-c8d142be8685\") " pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:33.625710 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.625647    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:33.899749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:33.899723    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7839-139884357490848"]
Sep 08 16:41:33.901315 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:41:33.901286    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d24d441_1a41_447c_92b5_c8d142be8685.slice/crio-35595340ea03c615e4658b392fa8d10b3de62eea46cd3b1fa5f00f0d4d149a0f WatchSource:0}: Error finding container 35595340ea03c615e4658b392fa8d10b3de62eea46cd3b1fa5f00f0d4d149a0f: Status 404 returned error can't find the container with id 35595340ea03c615e4658b392fa8d10b3de62eea46cd3b1fa5f00f0d4d149a0f
Sep 08 16:41:34.006570 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:34.006542    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abfc272a-06b1-4099-bbe0-13ebbe605a77" path="/var/lib/kubelet/pods/abfc272a-06b1-4099-bbe0-13ebbe605a77/volumes"
Sep 08 16:41:34.015169 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:34.015151    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490272"
Sep 08 16:41:34.015274 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:34.015199    2562 scope.go:117] "RemoveContainer" containerID="b96d9d66727daf8a6be4b0dd2bf4a190b9d87d5413ee3866b48859ee6cd26c20"
Sep 08 16:41:34.016491 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:34.016461    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7839-139884357490848" event={"ID":"7d24d441-1a41-447c-92b5-c8d142be8685","Type":"ContainerStarted","Data":"35595340ea03c615e4658b392fa8d10b3de62eea46cd3b1fa5f00f0d4d149a0f"}
Sep 08 16:41:36.030218 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:36.030185    2562 generic.go:356] "Generic (PLEG): container finished" podID="7d24d441-1a41-447c-92b5-c8d142be8685" containerID="e153a3d38e2f878652eb690d357e17c62236dcb2f9d6d1c849f1159ac6ccf432" exitCode=0
Sep 08 16:41:36.030583 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:36.030262    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7839-139884357490848" event={"ID":"7d24d441-1a41-447c-92b5-c8d142be8685","Type":"ContainerDied","Data":"e153a3d38e2f878652eb690d357e17c62236dcb2f9d6d1c849f1159ac6ccf432"}
Sep 08 16:41:37.169616 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.169581    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:37.189956 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.189930    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7839-139884357490848_7d24d441-1a41-447c-92b5-c8d142be8685/test-curl-7839-139884357490848/0.log"
Sep 08 16:41:37.218549 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.218526    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7839-139884357490848"]
Sep 08 16:41:37.222721 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.222696    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7839-139884357490848"]
Sep 08 16:41:37.297880 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.297820    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mmf8\" (UniqueName: \"kubernetes.io/projected/7d24d441-1a41-447c-92b5-c8d142be8685-kube-api-access-6mmf8\") pod \"7d24d441-1a41-447c-92b5-c8d142be8685\" (UID: \"7d24d441-1a41-447c-92b5-c8d142be8685\") "
Sep 08 16:41:37.299766 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.299739    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d24d441-1a41-447c-92b5-c8d142be8685-kube-api-access-6mmf8" (OuterVolumeSpecName: "kube-api-access-6mmf8") pod "7d24d441-1a41-447c-92b5-c8d142be8685" (UID: "7d24d441-1a41-447c-92b5-c8d142be8685"). InnerVolumeSpecName "kube-api-access-6mmf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:41:37.347251 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.347221    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7839-139884357490848"]
Sep 08 16:41:37.347640 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.347595    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d24d441-1a41-447c-92b5-c8d142be8685" containerName="test-curl-7839-139884357490848"
Sep 08 16:41:37.347640 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.347627    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d24d441-1a41-447c-92b5-c8d142be8685" containerName="test-curl-7839-139884357490848"
Sep 08 16:41:37.347775 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.347761    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d24d441-1a41-447c-92b5-c8d142be8685" containerName="test-curl-7839-139884357490848"
Sep 08 16:41:37.350705 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.350687    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:37.357567 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.357542    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7839-139884357490848"]
Sep 08 16:41:37.398583 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.398542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scjt4\" (UniqueName: \"kubernetes.io/projected/cb601c3c-c2da-4a4b-b20c-2fab8a62037b-kube-api-access-scjt4\") pod \"test-curl-7839-139884357490848\" (UID: \"cb601c3c-c2da-4a4b-b20c-2fab8a62037b\") " pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:37.398731 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.398716    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mmf8\" (UniqueName: \"kubernetes.io/projected/7d24d441-1a41-447c-92b5-c8d142be8685-kube-api-access-6mmf8\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:41:37.500145 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.500113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scjt4\" (UniqueName: \"kubernetes.io/projected/cb601c3c-c2da-4a4b-b20c-2fab8a62037b-kube-api-access-scjt4\") pod \"test-curl-7839-139884357490848\" (UID: \"cb601c3c-c2da-4a4b-b20c-2fab8a62037b\") " pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:37.509520 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.509493    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scjt4\" (UniqueName: \"kubernetes.io/projected/cb601c3c-c2da-4a4b-b20c-2fab8a62037b-kube-api-access-scjt4\") pod \"test-curl-7839-139884357490848\" (UID: \"cb601c3c-c2da-4a4b-b20c-2fab8a62037b\") " pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:37.661241 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.661167    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:37.930818 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:37.930793    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7839-139884357490848"]
Sep 08 16:41:37.932136 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:41:37.932113    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb601c3c_c2da_4a4b_b20c_2fab8a62037b.slice/crio-a04b9117a2e355a773ded0a8c08627b2a02c5e8709eb58d4f579d4191d6f017d WatchSource:0}: Error finding container a04b9117a2e355a773ded0a8c08627b2a02c5e8709eb58d4f579d4191d6f017d: Status 404 returned error can't find the container with id a04b9117a2e355a773ded0a8c08627b2a02c5e8709eb58d4f579d4191d6f017d
Sep 08 16:41:38.005166 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:38.005137    2562 scope.go:117] "RemoveContainer" containerID="a4ef4394240151b5ccc12b16b03dc6a9653b176af9754d3c5ad32ac9c29d158b"
Sep 08 16:41:38.006104 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:38.006083    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d24d441-1a41-447c-92b5-c8d142be8685" path="/var/lib/kubelet/pods/7d24d441-1a41-447c-92b5-c8d142be8685/volumes"
Sep 08 16:41:38.041986 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:38.041960    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7839-139884357490848" event={"ID":"cb601c3c-c2da-4a4b-b20c-2fab8a62037b","Type":"ContainerStarted","Data":"a04b9117a2e355a773ded0a8c08627b2a02c5e8709eb58d4f579d4191d6f017d"}
Sep 08 16:41:38.043105 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:38.043088    2562 scope.go:117] "RemoveContainer" containerID="e153a3d38e2f878652eb690d357e17c62236dcb2f9d6d1c849f1159ac6ccf432"
Sep 08 16:41:38.043196 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:38.043107    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:39.050862 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:39.050830    2562 generic.go:356] "Generic (PLEG): container finished" podID="cb601c3c-c2da-4a4b-b20c-2fab8a62037b" containerID="1bd88e322b40a8a8e342e48836d513c00afde7afa4f4a73c6d99da0982c66f20" exitCode=0
Sep 08 16:41:39.051208 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:39.050915    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7839-139884357490848" event={"ID":"cb601c3c-c2da-4a4b-b20c-2fab8a62037b","Type":"ContainerDied","Data":"1bd88e322b40a8a8e342e48836d513c00afde7afa4f4a73c6d99da0982c66f20"}
Sep 08 16:41:40.186007 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:40.185982    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:40.206840 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:40.206816    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7839-139884357490848_cb601c3c-c2da-4a4b-b20c-2fab8a62037b/test-curl-7839-139884357490848/0.log"
Sep 08 16:41:40.230819 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:40.230793    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7839-139884357490848"]
Sep 08 16:41:40.233022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:40.233000    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7839-139884357490848"]
Sep 08 16:41:40.324775 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:40.324713    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scjt4\" (UniqueName: \"kubernetes.io/projected/cb601c3c-c2da-4a4b-b20c-2fab8a62037b-kube-api-access-scjt4\") pod \"cb601c3c-c2da-4a4b-b20c-2fab8a62037b\" (UID: \"cb601c3c-c2da-4a4b-b20c-2fab8a62037b\") "
Sep 08 16:41:40.326682 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:40.326661    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb601c3c-c2da-4a4b-b20c-2fab8a62037b-kube-api-access-scjt4" (OuterVolumeSpecName: "kube-api-access-scjt4") pod "cb601c3c-c2da-4a4b-b20c-2fab8a62037b" (UID: "cb601c3c-c2da-4a4b-b20c-2fab8a62037b"). InnerVolumeSpecName "kube-api-access-scjt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:41:40.425540 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:40.425513    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scjt4\" (UniqueName: \"kubernetes.io/projected/cb601c3c-c2da-4a4b-b20c-2fab8a62037b-kube-api-access-scjt4\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:41:40.890046 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:40.890010    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:41.062707 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.062683    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:41.062874 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.062742    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a04b9117a2e355a773ded0a8c08627b2a02c5e8709eb58d4f579d4191d6f017d"
Sep 08 16:41:41.072212 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:41:41.072187    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7839-139884357490848\" is forbidden: User \"system:node:ip-10-0-139-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-55.ec2.internal' and this object" podUID="cb601c3c-c2da-4a4b-b20c-2fab8a62037b" pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:41.194575 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.194540    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"]
Sep 08 16:41:41.195117 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.195098    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb601c3c-c2da-4a4b-b20c-2fab8a62037b" containerName="test-curl-7839-139884357490848"
Sep 08 16:41:41.195204 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.195120    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb601c3c-c2da-4a4b-b20c-2fab8a62037b" containerName="test-curl-7839-139884357490848"
Sep 08 16:41:41.195265 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.195240    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb601c3c-c2da-4a4b-b20c-2fab8a62037b" containerName="test-curl-7839-139884357490848"
Sep 08 16:41:41.198357 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.198338    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.200703 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:41:41.200668    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7839-139884357490848\" is forbidden: User \"system:node:ip-10-0-139-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-55.ec2.internal' and this object" podUID="cb601c3c-c2da-4a4b-b20c-2fab8a62037b" pod="opendatahub/test-curl-7839-139884357490848"
Sep 08 16:41:41.200925 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.200910    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b16e488f-openshift-default-dockercfg-tpstx\""
Sep 08 16:41:41.217302 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.217279    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"]
Sep 08 16:41:41.226496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.226470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:41.332697 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.332662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-workload-socket\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.332697 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.332698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69q46\" (UniqueName: \"kubernetes.io/projected/e01db931-f6ab-431c-8346-7015cedc0f21-kube-api-access-69q46\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.332934 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.332724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-istio-data\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.332934 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.332811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01db931-f6ab-431c-8346-7015cedc0f21-istio-podinfo\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.332934 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.332889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01db931-f6ab-431c-8346-7015cedc0f21-istio-token\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.332934 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.332932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01db931-f6ab-431c-8346-7015cedc0f21-istiod-ca-cert\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.333145 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.333017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-credential-socket\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.333145 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.333086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-workload-certs\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.333229 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.333157    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-istio-envoy\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.347015 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.346984    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:41.434313 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.434278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-istio-envoy\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.434489 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.434335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-workload-socket\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.434489 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.434440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69q46\" (UniqueName: \"kubernetes.io/projected/e01db931-f6ab-431c-8346-7015cedc0f21-kube-api-access-69q46\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.434489 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.434483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-istio-data\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.434694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.434518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01db931-f6ab-431c-8346-7015cedc0f21-istio-podinfo\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.434694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.434552    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01db931-f6ab-431c-8346-7015cedc0f21-istio-token\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.434694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.434581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01db931-f6ab-431c-8346-7015cedc0f21-istiod-ca-cert\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.434694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.434677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-credential-socket\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.434902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.434693    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-workload-socket\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.434902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.434767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-workload-certs\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.434902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.434837    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-istio-data\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.435073 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.434991    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-credential-socket\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.435073 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.435053    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-workload-certs\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.435404 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.435382    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01db931-f6ab-431c-8346-7015cedc0f21-istiod-ca-cert\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.436680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.436655    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-istio-envoy\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.436916 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.436901    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01db931-f6ab-431c-8346-7015cedc0f21-istio-podinfo\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.443216 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.443195    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01db931-f6ab-431c-8346-7015cedc0f21-istio-token\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.443695 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.443676    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69q46\" (UniqueName: \"kubernetes.io/projected/e01db931-f6ab-431c-8346-7015cedc0f21-kube-api-access-69q46\") pod \"e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") " pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.508593 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.508534    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:41.791391 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.791368    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"]
Sep 08 16:41:41.793102 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:41:41.793074    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01db931_f6ab_431c_8346_7015cedc0f21.slice/crio-1587e499b4fb4863ffe119dcc74fe86327c67f98c21f1fb6dad0400c3bc8f06f WatchSource:0}: Error finding container 1587e499b4fb4863ffe119dcc74fe86327c67f98c21f1fb6dad0400c3bc8f06f: Status 404 returned error can't find the container with id 1587e499b4fb4863ffe119dcc74fe86327c67f98c21f1fb6dad0400c3bc8f06f
Sep 08 16:41:41.795404 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.795363    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:41:41.795488 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.795452    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:41:41.795529 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:41.795496    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:41:42.007558 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:42.007529    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb601c3c-c2da-4a4b-b20c-2fab8a62037b" path="/var/lib/kubelet/pods/cb601c3c-c2da-4a4b-b20c-2fab8a62037b/volumes"
Sep 08 16:41:42.071602 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:42.071518    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" event={"ID":"e01db931-f6ab-431c-8346-7015cedc0f21","Type":"ContainerStarted","Data":"83b7399877c2f2b6ae720ec3ef0f59ae34dae31dd16092bec007ccccf1097898"}
Sep 08 16:41:42.071602 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:42.071570    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" event={"ID":"e01db931-f6ab-431c-8346-7015cedc0f21","Type":"ContainerStarted","Data":"1587e499b4fb4863ffe119dcc74fe86327c67f98c21f1fb6dad0400c3bc8f06f"}
Sep 08 16:41:42.095962 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:42.095905    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" podStartSLOduration=1.095885621 podStartE2EDuration="1.095885621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:41:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:41:42.092539699 +0000 UTC m=+1144.677101346" watchObservedRunningTime="2026-09-08 16:41:42.095885621 +0000 UTC m=+1144.680447240"
Sep 08 16:41:42.509490 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:42.509458    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:42.514545 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:42.514520    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:43.077066 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:43.077038    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:43.078319 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:43.078296    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:41:44.058255 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:44.058212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:44.149370 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:44.149337    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:44.759523 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:44.759486    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:41:45.204538 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:45.204496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:45.303565 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:45.303530    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:45.630926 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:45.630839    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:45.733833 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:45.733798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:45.844534 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:45.844501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:48.637520 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:41:48.637489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:42:02.362127 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:02.362088    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:42:04.197450 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:04.197424    2562 generic.go:356] "Generic (PLEG): container finished" podID="e01db931-f6ab-431c-8346-7015cedc0f21" containerID="83b7399877c2f2b6ae720ec3ef0f59ae34dae31dd16092bec007ccccf1097898" exitCode=0
Sep 08 16:42:04.197858 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:04.197498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" event={"ID":"e01db931-f6ab-431c-8346-7015cedc0f21","Type":"ContainerDied","Data":"83b7399877c2f2b6ae720ec3ef0f59ae34dae31dd16092bec007ccccf1097898"}
Sep 08 16:42:04.197901 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:04.197888    2562 scope.go:117] "RemoveContainer" containerID="83b7399877c2f2b6ae720ec3ef0f59ae34dae31dd16092bec007ccccf1097898"
Sep 08 16:42:04.199111 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:04.199076    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:42:04.199177 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:04.199146    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:42:04.199214 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:04.199199    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:42:05.206110 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:05.206081    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" event={"ID":"e01db931-f6ab-431c-8346-7015cedc0f21","Type":"ContainerStarted","Data":"630b9c0493d96f3724fc3ba5238e3c9a5c6497f5f9003407e283d58d331c60c0"}
Sep 08 16:42:05.508951 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:05.508874    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:42:05.509094 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:05.509037    2562 patch_prober.go:28] interesting pod/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 08 16:42:05.509136 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:05.509093    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 08 16:42:06.184237 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:06.184201    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:42:06.509308 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:06.509275    2562 patch_prober.go:28] interesting pod/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 08 16:42:06.509689 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:06.509330    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 08 16:42:07.509358 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:07.509323    2562 patch_prober.go:28] interesting pod/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 08 16:42:07.509741 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:07.509385    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 08 16:42:08.509474 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:08.509436    2562 patch_prober.go:28] interesting pod/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 08 16:42:08.509867 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:08.509491    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 08 16:42:09.032765 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:09.032722    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:42:09.508891 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:09.508855    2562 patch_prober.go:28] interesting pod/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 08 16:42:09.509063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:09.508909    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 08 16:42:10.509334 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:10.509297    2562 patch_prober.go:28] interesting pod/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 08 16:42:10.509817 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:10.509369    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 08 16:42:11.513703 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:11.513671    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:42:11.514139 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:11.514067    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:42:11.514624 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:11.514593    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:42:15.650896 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:15.650853    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:42:20.361060 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:20.361023    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:42:23.011756 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.011722    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"]
Sep 08 16:42:23.014216 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.014200    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.026139 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.026121    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b16e488f\"/\"openshift-service-ca.crt\""
Sep 08 16:42:23.026557 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.026541    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b16e488f\"/\"e2e-lifecycle-model-b16e488f-kserve-self-signed-certs\""
Sep 08 16:42:23.027082 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.027066    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b16e488f\"/\"kube-root-ca.crt\""
Sep 08 16:42:23.029898 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.029881    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b16e488f\"/\"default-dockercfg-qxn44\""
Sep 08 16:42:23.057110 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.057089    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"]
Sep 08 16:42:23.112340 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.112308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:42:23.114433 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.114411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-dshm\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.114541 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.114451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-tmp-dir\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.114541 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.114511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4vg7\" (UniqueName: \"kubernetes.io/projected/9cd83cfd-cba9-4e63-bdec-8df53026f54b-kube-api-access-d4vg7\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.114681 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.114542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-model-cache\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.114746 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.114686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-home\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.114746 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.114727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cd83cfd-cba9-4e63-bdec-8df53026f54b-tls-certs\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.215373 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.215341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-dshm\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.215560 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.215377    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-tmp-dir\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.215560 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.215399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4vg7\" (UniqueName: \"kubernetes.io/projected/9cd83cfd-cba9-4e63-bdec-8df53026f54b-kube-api-access-d4vg7\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.215560 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.215519    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-model-cache\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.215776 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.215630    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-home\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.215776 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.215678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cd83cfd-cba9-4e63-bdec-8df53026f54b-tls-certs\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.215864 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.215793    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-tmp-dir\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.215918 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.215899    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-model-cache\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.216030 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.216010    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-home\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.217731 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.217714    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-dshm\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.217984 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.217968    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cd83cfd-cba9-4e63-bdec-8df53026f54b-tls-certs\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.226676 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.226654    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4vg7\" (UniqueName: \"kubernetes.io/projected/9cd83cfd-cba9-4e63-bdec-8df53026f54b-kube-api-access-d4vg7\") pod \"e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") " pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.323172 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.323111    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:23.598435 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:23.598407    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"]
Sep 08 16:42:23.600826 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:42:23.600800    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cd83cfd_cba9_4e63_bdec_8df53026f54b.slice/crio-5dfc0d3bc20c118d99029b960bc62b50c69f908b5f8e197f8a3c734014533c4b WatchSource:0}: Error finding container 5dfc0d3bc20c118d99029b960bc62b50c69f908b5f8e197f8a3c734014533c4b: Status 404 returned error can't find the container with id 5dfc0d3bc20c118d99029b960bc62b50c69f908b5f8e197f8a3c734014533c4b
Sep 08 16:42:24.336504 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:24.336472    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls" event={"ID":"9cd83cfd-cba9-4e63-bdec-8df53026f54b","Type":"ContainerStarted","Data":"784d6ea97d72fbda0bf29b4480ed8ac27593fc6fbd8c9b57e46f4dfbb1e8a2cb"}
Sep 08 16:42:24.336878 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:24.336521    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls" event={"ID":"9cd83cfd-cba9-4e63-bdec-8df53026f54b","Type":"ContainerStarted","Data":"5dfc0d3bc20c118d99029b960bc62b50c69f908b5f8e197f8a3c734014533c4b"}
Sep 08 16:42:24.359107 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:24.359063    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls" podStartSLOduration=2.359049186 podStartE2EDuration="2.359049186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:42:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:42:24.35679284 +0000 UTC m=+1186.941354460" watchObservedRunningTime="2026-09-08 16:42:24.359049186 +0000 UTC m=+1186.943610806"
Sep 08 16:42:33.324091 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:33.324058    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:33.324599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:33.324136    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:33.336344 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:33.336322    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:33.396647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:33.396624    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:42:38.031292 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:38.031263    2562 scope.go:117] "RemoveContainer" containerID="55fc0384f4f34466720c8319164df558bc03b930a7124a1004f6aecc854a4cb9"
Sep 08 16:42:38.039949 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:38.039931    2562 scope.go:117] "RemoveContainer" containerID="676659d0bfb79897cca8e99b5f44a14ead0f3bcabf479f2ad5529d0441d6d0bf"
Sep 08 16:42:38.312038 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:38.311949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:42:39.954834 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:39.954797    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:42:58.460356 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:42:58.460318    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:43:04.087052 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:04.087014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:04.188271 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:04.188236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:04.288540 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:04.288500    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:04.390366 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:04.390274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:06.896080 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:06.896047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:06.963202 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:06.963173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:07.547668 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:07.547632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:12.481383 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:12.481343    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"]
Sep 08 16:43:12.530163 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:12.530125    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:16.320308 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:16.320266    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"]
Sep 08 16:43:16.341061 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:16.341031    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:17.348693 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:17.348664    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"]
Sep 08 16:43:17.366702 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:17.366664    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:19.552231 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:19.552198    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:43:27.501188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.501146    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls" podUID="9cd83cfd-cba9-4e63-bdec-8df53026f54b" containerName="main" containerID="cri-o://784d6ea97d72fbda0bf29b4480ed8ac27593fc6fbd8c9b57e46f4dfbb1e8a2cb" gracePeriod=45
Sep 08 16:43:27.694965 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.694935    2562 generic.go:356] "Generic (PLEG): container finished" podID="9cd83cfd-cba9-4e63-bdec-8df53026f54b" containerID="784d6ea97d72fbda0bf29b4480ed8ac27593fc6fbd8c9b57e46f4dfbb1e8a2cb" exitCode=0
Sep 08 16:43:27.695111 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.695011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls" event={"ID":"9cd83cfd-cba9-4e63-bdec-8df53026f54b","Type":"ContainerDied","Data":"784d6ea97d72fbda0bf29b4480ed8ac27593fc6fbd8c9b57e46f4dfbb1e8a2cb"}
Sep 08 16:43:27.738171 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.738145    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:43:27.917627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.917529    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4vg7\" (UniqueName: \"kubernetes.io/projected/9cd83cfd-cba9-4e63-bdec-8df53026f54b-kube-api-access-d4vg7\") pod \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") "
Sep 08 16:43:27.917627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.917592    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-model-cache\") pod \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") "
Sep 08 16:43:27.917810 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.917642    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-tmp-dir\") pod \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") "
Sep 08 16:43:27.917810 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.917674    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-dshm\") pod \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") "
Sep 08 16:43:27.917810 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.917726    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-home\") pod \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") "
Sep 08 16:43:27.917810 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.917773    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cd83cfd-cba9-4e63-bdec-8df53026f54b-tls-certs\") pod \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\" (UID: \"9cd83cfd-cba9-4e63-bdec-8df53026f54b\") "
Sep 08 16:43:27.918003 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.917889    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-model-cache" (OuterVolumeSpecName: "model-cache") pod "9cd83cfd-cba9-4e63-bdec-8df53026f54b" (UID: "9cd83cfd-cba9-4e63-bdec-8df53026f54b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:43:27.918003 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.917918    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9cd83cfd-cba9-4e63-bdec-8df53026f54b" (UID: "9cd83cfd-cba9-4e63-bdec-8df53026f54b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:43:27.918131 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.918048    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-home" (OuterVolumeSpecName: "home") pod "9cd83cfd-cba9-4e63-bdec-8df53026f54b" (UID: "9cd83cfd-cba9-4e63-bdec-8df53026f54b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:43:27.918189 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.918150    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:27.918189 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.918168    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:27.918189 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.918181    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:27.919847 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.919825    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-dshm" (OuterVolumeSpecName: "dshm") pod "9cd83cfd-cba9-4e63-bdec-8df53026f54b" (UID: "9cd83cfd-cba9-4e63-bdec-8df53026f54b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:43:27.919949 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.919871    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd83cfd-cba9-4e63-bdec-8df53026f54b-kube-api-access-d4vg7" (OuterVolumeSpecName: "kube-api-access-d4vg7") pod "9cd83cfd-cba9-4e63-bdec-8df53026f54b" (UID: "9cd83cfd-cba9-4e63-bdec-8df53026f54b"). InnerVolumeSpecName "kube-api-access-d4vg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:43:27.919949 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:27.919879    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cd83cfd-cba9-4e63-bdec-8df53026f54b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9cd83cfd-cba9-4e63-bdec-8df53026f54b" (UID: "9cd83cfd-cba9-4e63-bdec-8df53026f54b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:43:28.018865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:28.018837    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4vg7\" (UniqueName: \"kubernetes.io/projected/9cd83cfd-cba9-4e63-bdec-8df53026f54b-kube-api-access-d4vg7\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:28.018865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:28.018862    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cd83cfd-cba9-4e63-bdec-8df53026f54b-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:28.019067 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:28.018873    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cd83cfd-cba9-4e63-bdec-8df53026f54b-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:28.701933 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:28.701897    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls" event={"ID":"9cd83cfd-cba9-4e63-bdec-8df53026f54b","Type":"ContainerDied","Data":"5dfc0d3bc20c118d99029b960bc62b50c69f908b5f8e197f8a3c734014533c4b"}
Sep 08 16:43:28.701933 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:28.701918    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"
Sep 08 16:43:28.702441 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:28.701950    2562 scope.go:117] "RemoveContainer" containerID="784d6ea97d72fbda0bf29b4480ed8ac27593fc6fbd8c9b57e46f4dfbb1e8a2cb"
Sep 08 16:43:28.718202 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:28.718178    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"]
Sep 08 16:43:28.723766 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:28.723742    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b16e488f/e2e-lifecycle-model-b16e488f-kserve-7449f74f87-f7qls"]
Sep 08 16:43:29.570740 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:29.570709    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:29.632066 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:29.632042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:30.006330 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.006295    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cd83cfd-cba9-4e63-bdec-8df53026f54b" path="/var/lib/kubelet/pods/9cd83cfd-cba9-4e63-bdec-8df53026f54b/volumes"
Sep 08 16:43:30.067389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.067316    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"]
Sep 08 16:43:30.067873 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.067854    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd83cfd-cba9-4e63-bdec-8df53026f54b" containerName="main"
Sep 08 16:43:30.067873 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.067874    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd83cfd-cba9-4e63-bdec-8df53026f54b" containerName="main"
Sep 08 16:43:30.068300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.067989    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cd83cfd-cba9-4e63-bdec-8df53026f54b" containerName="main"
Sep 08 16:43:30.072681 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.072659    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.075455 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.075435    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-a4942b\"/\"sub-test-model-a4942b-kserve-self-signed-certs\""
Sep 08 16:43:30.080287 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.080252    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"]
Sep 08 16:43:30.113957 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.113933    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:30.240515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.240486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-dshm\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.240515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.240515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-tmp-dir\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.240749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.240541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-home\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.240749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.240636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb399046-84e6-463a-af25-75718a5492cb-tls-certs\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.240749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.240701    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-model-cache\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.240749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.240738    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5jqn\" (UniqueName: \"kubernetes.io/projected/cb399046-84e6-463a-af25-75718a5492cb-kube-api-access-v5jqn\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.342240 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.342125    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-dshm\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.342240 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.342189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-tmp-dir\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.342240 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.342225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-home\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.342525 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.342273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb399046-84e6-463a-af25-75718a5492cb-tls-certs\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.342525 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.342320    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-model-cache\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.342525 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.342349    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5jqn\" (UniqueName: \"kubernetes.io/projected/cb399046-84e6-463a-af25-75718a5492cb-kube-api-access-v5jqn\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.343536 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.343505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-home\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.343857 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.343821    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-model-cache\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.343977 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.343962    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-tmp-dir\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.346020 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.345966    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-dshm\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.346416 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.346379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb399046-84e6-463a-af25-75718a5492cb-tls-certs\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.351815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.351795    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5jqn\" (UniqueName: \"kubernetes.io/projected/cb399046-84e6-463a-af25-75718a5492cb-kube-api-access-v5jqn\") pod \"sub-test-model-a4942b-kserve-57446c59b7-445w2\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.383654 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.383629    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:30.655264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.655235    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"]
Sep 08 16:43:30.657130 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:43:30.657104    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb399046_84e6_463a_af25_75718a5492cb.slice/crio-fdf8fe3e4818eea3183b121539c219e0573e2d25c656eca66b89138104f3cf94 WatchSource:0}: Error finding container fdf8fe3e4818eea3183b121539c219e0573e2d25c656eca66b89138104f3cf94: Status 404 returned error can't find the container with id fdf8fe3e4818eea3183b121539c219e0573e2d25c656eca66b89138104f3cf94
Sep 08 16:43:30.715331 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:30.715304    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2" event={"ID":"cb399046-84e6-463a-af25-75718a5492cb","Type":"ContainerStarted","Data":"fdf8fe3e4818eea3183b121539c219e0573e2d25c656eca66b89138104f3cf94"}
Sep 08 16:43:31.340107 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.340043    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt" podUID="86bdc4ef-532d-46ed-82d1-2a0d68418d71" containerName="main" containerID="cri-o://61b2573f801702739fb24b22658312950080d83d38fbfb3408d5af987dffa96a" gracePeriod=45
Sep 08 16:43:31.588181 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.588156    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:43:31.722044 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.722009    2562 generic.go:356] "Generic (PLEG): container finished" podID="86bdc4ef-532d-46ed-82d1-2a0d68418d71" containerID="61b2573f801702739fb24b22658312950080d83d38fbfb3408d5af987dffa96a" exitCode=0
Sep 08 16:43:31.722254 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.722050    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"
Sep 08 16:43:31.722254 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.722092    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt" event={"ID":"86bdc4ef-532d-46ed-82d1-2a0d68418d71","Type":"ContainerDied","Data":"61b2573f801702739fb24b22658312950080d83d38fbfb3408d5af987dffa96a"}
Sep 08 16:43:31.722254 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.722138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt" event={"ID":"86bdc4ef-532d-46ed-82d1-2a0d68418d71","Type":"ContainerDied","Data":"fd5448d9788ec9fcb0e71301b3c6019b72a4bab39f4ff4213eb2bbc2b4abc9d2"}
Sep 08 16:43:31.722254 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.722158    2562 scope.go:117] "RemoveContainer" containerID="61b2573f801702739fb24b22658312950080d83d38fbfb3408d5af987dffa96a"
Sep 08 16:43:31.723745 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.723721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2" event={"ID":"cb399046-84e6-463a-af25-75718a5492cb","Type":"ContainerStarted","Data":"09450eabb1c5c64a1e04f7937622aaf9169a20b04eb7c83e49688520348641d6"}
Sep 08 16:43:31.731280 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.731263    2562 scope.go:117] "RemoveContainer" containerID="61b2573f801702739fb24b22658312950080d83d38fbfb3408d5af987dffa96a"
Sep 08 16:43:31.731520 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:43:31.731499    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61b2573f801702739fb24b22658312950080d83d38fbfb3408d5af987dffa96a\": container with ID starting with 61b2573f801702739fb24b22658312950080d83d38fbfb3408d5af987dffa96a not found: ID does not exist" containerID="61b2573f801702739fb24b22658312950080d83d38fbfb3408d5af987dffa96a"
Sep 08 16:43:31.731574 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.731527    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61b2573f801702739fb24b22658312950080d83d38fbfb3408d5af987dffa96a"} err="failed to get container status \"61b2573f801702739fb24b22658312950080d83d38fbfb3408d5af987dffa96a\": rpc error: code = NotFound desc = could not find container \"61b2573f801702739fb24b22658312950080d83d38fbfb3408d5af987dffa96a\": container with ID starting with 61b2573f801702739fb24b22658312950080d83d38fbfb3408d5af987dffa96a not found: ID does not exist"
Sep 08 16:43:31.743815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.743777    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2" podStartSLOduration=1.743765005 podStartE2EDuration="1.743765005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:43:31.741379813 +0000 UTC m=+1254.325941433" watchObservedRunningTime="2026-09-08 16:43:31.743765005 +0000 UTC m=+1254.328326623"
Sep 08 16:43:31.757269 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.757244    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86bdc4ef-532d-46ed-82d1-2a0d68418d71-tls-certs\") pod \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") "
Sep 08 16:43:31.757359 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.757330    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-model-cache\") pod \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") "
Sep 08 16:43:31.757404 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.757386    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-tmp-dir\") pod \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") "
Sep 08 16:43:31.757443 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.757421    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-home\") pod \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") "
Sep 08 16:43:31.757483 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.757449    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96tv2\" (UniqueName: \"kubernetes.io/projected/86bdc4ef-532d-46ed-82d1-2a0d68418d71-kube-api-access-96tv2\") pod \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") "
Sep 08 16:43:31.757483 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.757479    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-dshm\") pod \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\" (UID: \"86bdc4ef-532d-46ed-82d1-2a0d68418d71\") "
Sep 08 16:43:31.757585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.757561    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-model-cache" (OuterVolumeSpecName: "model-cache") pod "86bdc4ef-532d-46ed-82d1-2a0d68418d71" (UID: "86bdc4ef-532d-46ed-82d1-2a0d68418d71"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:43:31.757723 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.757698    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "86bdc4ef-532d-46ed-82d1-2a0d68418d71" (UID: "86bdc4ef-532d-46ed-82d1-2a0d68418d71"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:43:31.757723 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.757711    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-home" (OuterVolumeSpecName: "home") pod "86bdc4ef-532d-46ed-82d1-2a0d68418d71" (UID: "86bdc4ef-532d-46ed-82d1-2a0d68418d71"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:43:31.757908 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.757890    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:31.757968 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.757929    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:31.757968 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.757938    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:31.759458 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.759432    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86bdc4ef-532d-46ed-82d1-2a0d68418d71-kube-api-access-96tv2" (OuterVolumeSpecName: "kube-api-access-96tv2") pod "86bdc4ef-532d-46ed-82d1-2a0d68418d71" (UID: "86bdc4ef-532d-46ed-82d1-2a0d68418d71"). InnerVolumeSpecName "kube-api-access-96tv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:43:31.759458 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.759447    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-dshm" (OuterVolumeSpecName: "dshm") pod "86bdc4ef-532d-46ed-82d1-2a0d68418d71" (UID: "86bdc4ef-532d-46ed-82d1-2a0d68418d71"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:43:31.759649 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.759473    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86bdc4ef-532d-46ed-82d1-2a0d68418d71-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "86bdc4ef-532d-46ed-82d1-2a0d68418d71" (UID: "86bdc4ef-532d-46ed-82d1-2a0d68418d71"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:43:31.859166 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.859108    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96tv2\" (UniqueName: \"kubernetes.io/projected/86bdc4ef-532d-46ed-82d1-2a0d68418d71-kube-api-access-96tv2\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:31.859166 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.859163    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86bdc4ef-532d-46ed-82d1-2a0d68418d71-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:31.859430 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:31.859178    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86bdc4ef-532d-46ed-82d1-2a0d68418d71-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:32.038692 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.038662    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"]
Sep 08 16:43:32.043396 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.043372    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/auth-test-model-a4942b-kserve-67965d5475-5tlzt"]
Sep 08 16:43:32.368863 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.368752    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p" podUID="5f07a141-5072-4fac-bf1c-52c75144d9ec" containerName="main" containerID="cri-o://bef024ef1708bc02daad3b9a6608f18ff6c09917ea952f254e677a49e833a2c0" gracePeriod=45
Sep 08 16:43:32.614908 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.614885    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:43:32.730881 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.730851    2562 generic.go:356] "Generic (PLEG): container finished" podID="5f07a141-5072-4fac-bf1c-52c75144d9ec" containerID="bef024ef1708bc02daad3b9a6608f18ff6c09917ea952f254e677a49e833a2c0" exitCode=0
Sep 08 16:43:32.731060 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.730893    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"
Sep 08 16:43:32.731060 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.730940    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p" event={"ID":"5f07a141-5072-4fac-bf1c-52c75144d9ec","Type":"ContainerDied","Data":"bef024ef1708bc02daad3b9a6608f18ff6c09917ea952f254e677a49e833a2c0"}
Sep 08 16:43:32.731060 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.730989    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p" event={"ID":"5f07a141-5072-4fac-bf1c-52c75144d9ec","Type":"ContainerDied","Data":"d6dc64b94a5a8760df2515871812e4ad37c462dbc132516cc0bffd88a56e73ec"}
Sep 08 16:43:32.731060 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.731015    2562 scope.go:117] "RemoveContainer" containerID="bef024ef1708bc02daad3b9a6608f18ff6c09917ea952f254e677a49e833a2c0"
Sep 08 16:43:32.739550 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.739531    2562 scope.go:117] "RemoveContainer" containerID="bef024ef1708bc02daad3b9a6608f18ff6c09917ea952f254e677a49e833a2c0"
Sep 08 16:43:32.739836 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:43:32.739818    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bef024ef1708bc02daad3b9a6608f18ff6c09917ea952f254e677a49e833a2c0\": container with ID starting with bef024ef1708bc02daad3b9a6608f18ff6c09917ea952f254e677a49e833a2c0 not found: ID does not exist" containerID="bef024ef1708bc02daad3b9a6608f18ff6c09917ea952f254e677a49e833a2c0"
Sep 08 16:43:32.739891 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.739843    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bef024ef1708bc02daad3b9a6608f18ff6c09917ea952f254e677a49e833a2c0"} err="failed to get container status \"bef024ef1708bc02daad3b9a6608f18ff6c09917ea952f254e677a49e833a2c0\": rpc error: code = NotFound desc = could not find container \"bef024ef1708bc02daad3b9a6608f18ff6c09917ea952f254e677a49e833a2c0\": container with ID starting with bef024ef1708bc02daad3b9a6608f18ff6c09917ea952f254e677a49e833a2c0 not found: ID does not exist"
Sep 08 16:43:32.768235 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.768205    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-tmp-dir\") pod \"5f07a141-5072-4fac-bf1c-52c75144d9ec\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") "
Sep 08 16:43:32.768354 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.768253    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f07a141-5072-4fac-bf1c-52c75144d9ec-tls-certs\") pod \"5f07a141-5072-4fac-bf1c-52c75144d9ec\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") "
Sep 08 16:43:32.768354 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.768310    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5zjk\" (UniqueName: \"kubernetes.io/projected/5f07a141-5072-4fac-bf1c-52c75144d9ec-kube-api-access-b5zjk\") pod \"5f07a141-5072-4fac-bf1c-52c75144d9ec\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") "
Sep 08 16:43:32.768424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.768356    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-model-cache\") pod \"5f07a141-5072-4fac-bf1c-52c75144d9ec\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") "
Sep 08 16:43:32.768424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.768401    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-home\") pod \"5f07a141-5072-4fac-bf1c-52c75144d9ec\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") "
Sep 08 16:43:32.768544 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.768427    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-dshm\") pod \"5f07a141-5072-4fac-bf1c-52c75144d9ec\" (UID: \"5f07a141-5072-4fac-bf1c-52c75144d9ec\") "
Sep 08 16:43:32.768544 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.768449    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5f07a141-5072-4fac-bf1c-52c75144d9ec" (UID: "5f07a141-5072-4fac-bf1c-52c75144d9ec"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:43:32.768712 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.768670    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-home" (OuterVolumeSpecName: "home") pod "5f07a141-5072-4fac-bf1c-52c75144d9ec" (UID: "5f07a141-5072-4fac-bf1c-52c75144d9ec"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:43:32.768712 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.768687    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-model-cache" (OuterVolumeSpecName: "model-cache") pod "5f07a141-5072-4fac-bf1c-52c75144d9ec" (UID: "5f07a141-5072-4fac-bf1c-52c75144d9ec"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:43:32.768838 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.768819    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:32.768838 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.768836    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:32.769018 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.768845    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:32.770583 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.770560    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f07a141-5072-4fac-bf1c-52c75144d9ec-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5f07a141-5072-4fac-bf1c-52c75144d9ec" (UID: "5f07a141-5072-4fac-bf1c-52c75144d9ec"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:43:32.770684 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.770596    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f07a141-5072-4fac-bf1c-52c75144d9ec-kube-api-access-b5zjk" (OuterVolumeSpecName: "kube-api-access-b5zjk") pod "5f07a141-5072-4fac-bf1c-52c75144d9ec" (UID: "5f07a141-5072-4fac-bf1c-52c75144d9ec"). InnerVolumeSpecName "kube-api-access-b5zjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:43:32.770684 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.770640    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-dshm" (OuterVolumeSpecName: "dshm") pod "5f07a141-5072-4fac-bf1c-52c75144d9ec" (UID: "5f07a141-5072-4fac-bf1c-52c75144d9ec"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:43:32.870165 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.870132    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5zjk\" (UniqueName: \"kubernetes.io/projected/5f07a141-5072-4fac-bf1c-52c75144d9ec-kube-api-access-b5zjk\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:32.870165 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.870158    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f07a141-5072-4fac-bf1c-52c75144d9ec-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:32.870165 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:32.870170    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f07a141-5072-4fac-bf1c-52c75144d9ec-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:43:33.054651 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:33.054618    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"]
Sep 08 16:43:33.059435 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:33.059412    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/auth-test-model-823397-kserve-7bd9b7b84c-4jh4p"]
Sep 08 16:43:33.062661 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:33.062638    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:43:34.011356 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:34.011320    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f07a141-5072-4fac-bf1c-52c75144d9ec" path="/var/lib/kubelet/pods/5f07a141-5072-4fac-bf1c-52c75144d9ec/volumes"
Sep 08 16:43:34.011743 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:34.011717    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86bdc4ef-532d-46ed-82d1-2a0d68418d71" path="/var/lib/kubelet/pods/86bdc4ef-532d-46ed-82d1-2a0d68418d71/volumes"
Sep 08 16:43:40.383965 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:40.383933    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:40.383965 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:40.383976    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:40.396162 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:40.396141    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:40.790721 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:40.790687    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:43:47.555439 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:47.555403    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:48.121980 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:48.121939    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:54.091253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:43:54.091211    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:00.081958 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:00.081920    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:00.178352 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:00.178313    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:00.366858 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:00.366776    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"]
Sep 08 16:44:00.367060 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:00.367015    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" containerName="istio-proxy" containerID="cri-o://630b9c0493d96f3724fc3ba5238e3c9a5c6497f5f9003407e283d58d331c60c0" gracePeriod=30
Sep 08 16:44:00.387777 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:00.387751    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:01.632521 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:01.632485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:01.732918 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:01.732885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:01.832409 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:01.832376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:02.453045 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:02.453002    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:02.562292 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:02.562256    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:02.647370 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:02.647336    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:03.953219 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:03.953186    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:05.623464 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.623438    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:44:05.773322 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.773292    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01db931-f6ab-431c-8346-7015cedc0f21-istio-podinfo\") pod \"e01db931-f6ab-431c-8346-7015cedc0f21\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") "
Sep 08 16:44:05.773515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.773358    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-workload-certs\") pod \"e01db931-f6ab-431c-8346-7015cedc0f21\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") "
Sep 08 16:44:05.773515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.773398    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69q46\" (UniqueName: \"kubernetes.io/projected/e01db931-f6ab-431c-8346-7015cedc0f21-kube-api-access-69q46\") pod \"e01db931-f6ab-431c-8346-7015cedc0f21\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") "
Sep 08 16:44:05.773515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.773423    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-workload-socket\") pod \"e01db931-f6ab-431c-8346-7015cedc0f21\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") "
Sep 08 16:44:05.773515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.773467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-istio-envoy\") pod \"e01db931-f6ab-431c-8346-7015cedc0f21\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") "
Sep 08 16:44:05.773515 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.773494    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-istio-data\") pod \"e01db931-f6ab-431c-8346-7015cedc0f21\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") "
Sep 08 16:44:05.774159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.773522    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-credential-socket\") pod \"e01db931-f6ab-431c-8346-7015cedc0f21\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") "
Sep 08 16:44:05.774159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.773566    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01db931-f6ab-431c-8346-7015cedc0f21-istio-token\") pod \"e01db931-f6ab-431c-8346-7015cedc0f21\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") "
Sep 08 16:44:05.774159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.773646    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01db931-f6ab-431c-8346-7015cedc0f21-istiod-ca-cert\") pod \"e01db931-f6ab-431c-8346-7015cedc0f21\" (UID: \"e01db931-f6ab-431c-8346-7015cedc0f21\") "
Sep 08 16:44:05.774159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.773772    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e01db931-f6ab-431c-8346-7015cedc0f21" (UID: "e01db931-f6ab-431c-8346-7015cedc0f21"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:05.774159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.773825    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e01db931-f6ab-431c-8346-7015cedc0f21" (UID: "e01db931-f6ab-431c-8346-7015cedc0f21"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:05.774159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.773856    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-istio-data" (OuterVolumeSpecName: "istio-data") pod "e01db931-f6ab-431c-8346-7015cedc0f21" (UID: "e01db931-f6ab-431c-8346-7015cedc0f21"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:05.774159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.773867    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e01db931-f6ab-431c-8346-7015cedc0f21" (UID: "e01db931-f6ab-431c-8346-7015cedc0f21"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:05.774159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.774075    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e01db931-f6ab-431c-8346-7015cedc0f21-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e01db931-f6ab-431c-8346-7015cedc0f21" (UID: "e01db931-f6ab-431c-8346-7015cedc0f21"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:44:05.774159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.774082    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:44:05.774159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.774115    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:44:05.774159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.774131    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:44:05.774159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.774144    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:44:05.775547 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.775527    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e01db931-f6ab-431c-8346-7015cedc0f21-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e01db931-f6ab-431c-8346-7015cedc0f21" (UID: "e01db931-f6ab-431c-8346-7015cedc0f21"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:44:05.775885 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.775862    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e01db931-f6ab-431c-8346-7015cedc0f21-istio-token" (OuterVolumeSpecName: "istio-token") pod "e01db931-f6ab-431c-8346-7015cedc0f21" (UID: "e01db931-f6ab-431c-8346-7015cedc0f21"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:44:05.776023 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.776004    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e01db931-f6ab-431c-8346-7015cedc0f21" (UID: "e01db931-f6ab-431c-8346-7015cedc0f21"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:05.776071 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.776035    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e01db931-f6ab-431c-8346-7015cedc0f21-kube-api-access-69q46" (OuterVolumeSpecName: "kube-api-access-69q46") pod "e01db931-f6ab-431c-8346-7015cedc0f21" (UID: "e01db931-f6ab-431c-8346-7015cedc0f21"). InnerVolumeSpecName "kube-api-access-69q46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:44:05.874824 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.874787    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01db931-f6ab-431c-8346-7015cedc0f21-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:44:05.874824 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.874817    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01db931-f6ab-431c-8346-7015cedc0f21-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:44:05.874824 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.874826    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01db931-f6ab-431c-8346-7015cedc0f21-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:44:05.875056 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.874836    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69q46\" (UniqueName: \"kubernetes.io/projected/e01db931-f6ab-431c-8346-7015cedc0f21-kube-api-access-69q46\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:44:05.875056 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.874845    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01db931-f6ab-431c-8346-7015cedc0f21-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:44:05.919815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.919780    2562 generic.go:356] "Generic (PLEG): container finished" podID="e01db931-f6ab-431c-8346-7015cedc0f21" containerID="630b9c0493d96f3724fc3ba5238e3c9a5c6497f5f9003407e283d58d331c60c0" exitCode=0
Sep 08 16:44:05.919968 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.919824    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"
Sep 08 16:44:05.919968 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.919851    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" event={"ID":"e01db931-f6ab-431c-8346-7015cedc0f21","Type":"ContainerDied","Data":"630b9c0493d96f3724fc3ba5238e3c9a5c6497f5f9003407e283d58d331c60c0"}
Sep 08 16:44:05.919968 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.919925    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd" event={"ID":"e01db931-f6ab-431c-8346-7015cedc0f21","Type":"ContainerDied","Data":"1587e499b4fb4863ffe119dcc74fe86327c67f98c21f1fb6dad0400c3bc8f06f"}
Sep 08 16:44:05.919968 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.919948    2562 scope.go:117] "RemoveContainer" containerID="630b9c0493d96f3724fc3ba5238e3c9a5c6497f5f9003407e283d58d331c60c0"
Sep 08 16:44:05.929660 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.929640    2562 scope.go:117] "RemoveContainer" containerID="83b7399877c2f2b6ae720ec3ef0f59ae34dae31dd16092bec007ccccf1097898"
Sep 08 16:44:05.938198 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.938180    2562 scope.go:117] "RemoveContainer" containerID="630b9c0493d96f3724fc3ba5238e3c9a5c6497f5f9003407e283d58d331c60c0"
Sep 08 16:44:05.938476 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:44:05.938456    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"630b9c0493d96f3724fc3ba5238e3c9a5c6497f5f9003407e283d58d331c60c0\": container with ID starting with 630b9c0493d96f3724fc3ba5238e3c9a5c6497f5f9003407e283d58d331c60c0 not found: ID does not exist" containerID="630b9c0493d96f3724fc3ba5238e3c9a5c6497f5f9003407e283d58d331c60c0"
Sep 08 16:44:05.938528 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.938483    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"630b9c0493d96f3724fc3ba5238e3c9a5c6497f5f9003407e283d58d331c60c0"} err="failed to get container status \"630b9c0493d96f3724fc3ba5238e3c9a5c6497f5f9003407e283d58d331c60c0\": rpc error: code = NotFound desc = could not find container \"630b9c0493d96f3724fc3ba5238e3c9a5c6497f5f9003407e283d58d331c60c0\": container with ID starting with 630b9c0493d96f3724fc3ba5238e3c9a5c6497f5f9003407e283d58d331c60c0 not found: ID does not exist"
Sep 08 16:44:05.938528 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.938502    2562 scope.go:117] "RemoveContainer" containerID="83b7399877c2f2b6ae720ec3ef0f59ae34dae31dd16092bec007ccccf1097898"
Sep 08 16:44:05.938793 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:44:05.938775    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83b7399877c2f2b6ae720ec3ef0f59ae34dae31dd16092bec007ccccf1097898\": container with ID starting with 83b7399877c2f2b6ae720ec3ef0f59ae34dae31dd16092bec007ccccf1097898 not found: ID does not exist" containerID="83b7399877c2f2b6ae720ec3ef0f59ae34dae31dd16092bec007ccccf1097898"
Sep 08 16:44:05.938855 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.938800    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b7399877c2f2b6ae720ec3ef0f59ae34dae31dd16092bec007ccccf1097898"} err="failed to get container status \"83b7399877c2f2b6ae720ec3ef0f59ae34dae31dd16092bec007ccccf1097898\": rpc error: code = NotFound desc = could not find container \"83b7399877c2f2b6ae720ec3ef0f59ae34dae31dd16092bec007ccccf1097898\": container with ID starting with 83b7399877c2f2b6ae720ec3ef0f59ae34dae31dd16092bec007ccccf1097898 not found: ID does not exist"
Sep 08 16:44:05.945506 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.945477    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"]
Sep 08 16:44:05.947757 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.947732    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd"]
Sep 08 16:44:05.954503 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:05.954475    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:44:06.006349 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:06.006318    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" path="/var/lib/kubelet/pods/e01db931-f6ab-431c-8346-7015cedc0f21/volumes"
Sep 08 16:44:09.842999 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:09.842960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:09.943544 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:09.943508    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:10.522786 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:10.522749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:12.164518 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.164485    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"]
Sep 08 16:44:12.164922 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.164845    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f07a141-5072-4fac-bf1c-52c75144d9ec" containerName="main"
Sep 08 16:44:12.164922 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.164857    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f07a141-5072-4fac-bf1c-52c75144d9ec" containerName="main"
Sep 08 16:44:12.164922 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.164864    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" containerName="istio-proxy"
Sep 08 16:44:12.164922 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.164870    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" containerName="istio-proxy"
Sep 08 16:44:12.164922 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.164880    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" containerName="istio-proxy"
Sep 08 16:44:12.164922 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.164885    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" containerName="istio-proxy"
Sep 08 16:44:12.164922 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.164906    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86bdc4ef-532d-46ed-82d1-2a0d68418d71" containerName="main"
Sep 08 16:44:12.164922 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.164912    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="86bdc4ef-532d-46ed-82d1-2a0d68418d71" containerName="main"
Sep 08 16:44:12.165235 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.164964    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f07a141-5072-4fac-bf1c-52c75144d9ec" containerName="main"
Sep 08 16:44:12.165235 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.164972    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" containerName="istio-proxy"
Sep 08 16:44:12.165235 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.164978    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="86bdc4ef-532d-46ed-82d1-2a0d68418d71" containerName="main"
Sep 08 16:44:12.167744 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.167726    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.170389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.170367    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-823397\"/\"kube-root-ca.crt\""
Sep 08 16:44:12.171350 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.171333    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-823397\"/\"openshift-service-ca.crt\""
Sep 08 16:44:12.171452 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.171359    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-823397\"/\"default-dockercfg-ntzvq\""
Sep 08 16:44:12.171452 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.171372    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-823397\"/\"sub-test-model-823397-kserve-self-signed-certs\""
Sep 08 16:44:12.178166 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.178146    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"]
Sep 08 16:44:12.189754 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.189715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:12.336365 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.336323    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ced24944-cae2-4839-a3e6-b8e37d472a3c-tls-certs\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.336561 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.336404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-tmp-dir\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.336561 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.336438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-home\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.336561 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.336469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27lh6\" (UniqueName: \"kubernetes.io/projected/ced24944-cae2-4839-a3e6-b8e37d472a3c-kube-api-access-27lh6\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.336561 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.336507    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-model-cache\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.336561 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.336534    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-dshm\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.437798 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.437705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-home\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.437798 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.437758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27lh6\" (UniqueName: \"kubernetes.io/projected/ced24944-cae2-4839-a3e6-b8e37d472a3c-kube-api-access-27lh6\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.438025 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.437878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-model-cache\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.438025 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.437934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-dshm\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.438025 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.437958    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ced24944-cae2-4839-a3e6-b8e37d472a3c-tls-certs\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.438199 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.438050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-tmp-dir\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.438199 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.438118    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-home\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.438307 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.438255    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-model-cache\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.438346 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.438303    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-tmp-dir\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.440131 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.440109    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-dshm\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.440374 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.440356    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ced24944-cae2-4839-a3e6-b8e37d472a3c-tls-certs\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.446278 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.446255    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27lh6\" (UniqueName: \"kubernetes.io/projected/ced24944-cae2-4839-a3e6-b8e37d472a3c-kube-api-access-27lh6\") pod \"sub-test-model-823397-kserve-5564495767-l8fbd\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") " pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.477497 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.477464    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:12.751774 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.751743    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"]
Sep 08 16:44:12.752790 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:44:12.752764    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podced24944_cae2_4839_a3e6_b8e37d472a3c.slice/crio-adddc38817b32d15ea56d44a88720a6dbed985d587f9e9c2e18e4bccd08d516c WatchSource:0}: Error finding container adddc38817b32d15ea56d44a88720a6dbed985d587f9e9c2e18e4bccd08d516c: Status 404 returned error can't find the container with id adddc38817b32d15ea56d44a88720a6dbed985d587f9e9c2e18e4bccd08d516c
Sep 08 16:44:12.960602 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.960565    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd" event={"ID":"ced24944-cae2-4839-a3e6-b8e37d472a3c","Type":"ContainerStarted","Data":"7182b1853d69660f68a498c98f482a553b46c0b405d2c1ee17213c8fb300848e"}
Sep 08 16:44:12.960812 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.960635    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd" event={"ID":"ced24944-cae2-4839-a3e6-b8e37d472a3c","Type":"ContainerStarted","Data":"adddc38817b32d15ea56d44a88720a6dbed985d587f9e9c2e18e4bccd08d516c"}
Sep 08 16:44:12.979879 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:12.979833    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd" podStartSLOduration=0.979820059 podStartE2EDuration="979.820059ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:44:12.977280734 +0000 UTC m=+1295.561842388" watchObservedRunningTime="2026-09-08 16:44:12.979820059 +0000 UTC m=+1295.564381677"
Sep 08 16:44:14.473624 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:14.473570    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:16.301210 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:16.301170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:16.406750 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:16.406709    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:16.502116 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:16.502077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:21.652235 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:21.652202    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:44:22.478034 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:22.477997    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:22.478034 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:22.478044    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:22.490027 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:22.489996    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:23.029749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:23.029718    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:44:27.034969 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:27.034935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:27.250985 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:27.250950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:41.163030 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:41.162994    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:44:48.218337 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:48.218296    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:53.368070 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:53.368036    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7842-a63762"]
Sep 08 16:44:53.368540 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:53.368499    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e01db931-f6ab-431c-8346-7015cedc0f21" containerName="istio-proxy"
Sep 08 16:44:53.372841 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:53.372825    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7842-a63762"
Sep 08 16:44:53.376589 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:53.376557    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mrsv6\""
Sep 08 16:44:53.389535 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:53.389508    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7842-a63762"]
Sep 08 16:44:53.525604 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:53.525556    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x95g\" (UniqueName: \"kubernetes.io/projected/5ef37b85-1aee-454c-ac5e-181f5d903e23-kube-api-access-4x95g\") pod \"mt-curl-7842-a63762\" (UID: \"5ef37b85-1aee-454c-ac5e-181f5d903e23\") " pod="opendatahub/mt-curl-7842-a63762"
Sep 08 16:44:53.626540 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:53.626444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x95g\" (UniqueName: \"kubernetes.io/projected/5ef37b85-1aee-454c-ac5e-181f5d903e23-kube-api-access-4x95g\") pod \"mt-curl-7842-a63762\" (UID: \"5ef37b85-1aee-454c-ac5e-181f5d903e23\") " pod="opendatahub/mt-curl-7842-a63762"
Sep 08 16:44:53.634322 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:53.634296    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x95g\" (UniqueName: \"kubernetes.io/projected/5ef37b85-1aee-454c-ac5e-181f5d903e23-kube-api-access-4x95g\") pod \"mt-curl-7842-a63762\" (UID: \"5ef37b85-1aee-454c-ac5e-181f5d903e23\") " pod="opendatahub/mt-curl-7842-a63762"
Sep 08 16:44:53.682040 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:53.682001    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7842-a63762"
Sep 08 16:44:53.952142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:53.952114    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7842-a63762"]
Sep 08 16:44:53.954013 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:44:53.953987    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ef37b85_1aee_454c_ac5e_181f5d903e23.slice/crio-3cfd079a7b49f5721150dd8414113324fae593bc40a41c9ddbb22551fd505e34 WatchSource:0}: Error finding container 3cfd079a7b49f5721150dd8414113324fae593bc40a41c9ddbb22551fd505e34: Status 404 returned error can't find the container with id 3cfd079a7b49f5721150dd8414113324fae593bc40a41c9ddbb22551fd505e34
Sep 08 16:44:54.191386 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:54.191349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7842-a63762" event={"ID":"5ef37b85-1aee-454c-ac5e-181f5d903e23","Type":"ContainerStarted","Data":"3cfd079a7b49f5721150dd8414113324fae593bc40a41c9ddbb22551fd505e34"}
Sep 08 16:44:54.359688 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:54.359586    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:54.423734 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:54.423698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:54.590240 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:54.590202    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:54.749270 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:54.749235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:55.045229 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.045189    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"]
Sep 08 16:44:55.049099 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.049077    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.051543 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.051522    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-61f413-openshift-default-dockercfg-l9fvt\""
Sep 08 16:44:55.061531 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.061506    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"]
Sep 08 16:44:55.076061 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.076035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:55.141782 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.141745    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xtvf\" (UniqueName: \"kubernetes.io/projected/63eddb5e-3624-4563-a1da-1272d8226ba3-kube-api-access-8xtvf\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.142109 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.142091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-workload-certs\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.142691 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.142669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-envoy\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.142864 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.142850    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63eddb5e-3624-4563-a1da-1272d8226ba3-istiod-ca-cert\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.142994 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.142981    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-token\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.143110 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.143098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-credential-socket\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.143284 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.143271    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-workload-socket\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.143595 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.143581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-podinfo\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.143815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.143799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-data\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.198663 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.198634    2562 generic.go:356] "Generic (PLEG): container finished" podID="5ef37b85-1aee-454c-ac5e-181f5d903e23" containerID="dae5ff3e596262e500d2e389503f3b72806b4a0c7736f17e58a540ab7fdbf3c5" exitCode=0
Sep 08 16:44:55.198821 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.198698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7842-a63762" event={"ID":"5ef37b85-1aee-454c-ac5e-181f5d903e23","Type":"ContainerDied","Data":"dae5ff3e596262e500d2e389503f3b72806b4a0c7736f17e58a540ab7fdbf3c5"}
Sep 08 16:44:55.215477 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.215445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:55.244706 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.244677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-envoy\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.244847 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.244713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63eddb5e-3624-4563-a1da-1272d8226ba3-istiod-ca-cert\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.244847 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.244739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-token\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.244847 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.244765    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-credential-socket\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.244847 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.244845    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-workload-socket\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.245072 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.245024    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-podinfo\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.245147 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.245098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-data\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.245147 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.245137    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xtvf\" (UniqueName: \"kubernetes.io/projected/63eddb5e-3624-4563-a1da-1272d8226ba3-kube-api-access-8xtvf\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.245265 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.245178    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-workload-socket\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.245265 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.245195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-workload-certs\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.245265 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.245224    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-credential-socket\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.245450 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.245432    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63eddb5e-3624-4563-a1da-1272d8226ba3-istiod-ca-cert\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.245521 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.245453    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-data\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.245521 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.245515    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-workload-certs\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.247094 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.247070    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-envoy\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.247332 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.247315    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-podinfo\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.255079 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.255052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xtvf\" (UniqueName: \"kubernetes.io/projected/63eddb5e-3624-4563-a1da-1272d8226ba3-kube-api-access-8xtvf\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.255317 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.255296    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-token\") pod \"e2e-api-a-61f413-openshift-default-c9445fd78-btsns\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") " pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.360494 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.360404    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:55.642145 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.642112    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"]
Sep 08 16:44:55.643232 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:44:55.643204    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63eddb5e_3624_4563_a1da_1272d8226ba3.slice/crio-92da137b38749033a2a97e0fb8a38d6c760e244f32c71e4109751eaf73ce194d WatchSource:0}: Error finding container 92da137b38749033a2a97e0fb8a38d6c760e244f32c71e4109751eaf73ce194d: Status 404 returned error can't find the container with id 92da137b38749033a2a97e0fb8a38d6c760e244f32c71e4109751eaf73ce194d
Sep 08 16:44:55.645852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.645818    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:44:55.645954 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.645885    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:44:55.645954 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:55.645914    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:44:56.205865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.205826    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns" event={"ID":"63eddb5e-3624-4563-a1da-1272d8226ba3","Type":"ContainerStarted","Data":"46e2b30a96874d5054ca6c4e5091b41a3aab68af9fd3b165ebba6e1da82fc1ee"}
Sep 08 16:44:56.206024 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.205918    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns" event={"ID":"63eddb5e-3624-4563-a1da-1272d8226ba3","Type":"ContainerStarted","Data":"92da137b38749033a2a97e0fb8a38d6c760e244f32c71e4109751eaf73ce194d"}
Sep 08 16:44:56.235216 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.235158    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns" podStartSLOduration=1.235142309 podStartE2EDuration="1.235142309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:44:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:44:56.233732054 +0000 UTC m=+1338.818293674" watchObservedRunningTime="2026-09-08 16:44:56.235142309 +0000 UTC m=+1338.819703927"
Sep 08 16:44:56.338138 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.338109    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7842-a63762"
Sep 08 16:44:56.361161 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.361128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:56.362257 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.362225    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7842-a63762_5ef37b85-1aee-454c-ac5e-181f5d903e23/mt-curl-7842-a63762/0.log"
Sep 08 16:44:56.367410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.367387    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:56.387900 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.387870    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7842-a63762"]
Sep 08 16:44:56.394181 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.394156    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7842-a63762"]
Sep 08 16:44:56.459661 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.459532    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x95g\" (UniqueName: \"kubernetes.io/projected/5ef37b85-1aee-454c-ac5e-181f5d903e23-kube-api-access-4x95g\") pod \"5ef37b85-1aee-454c-ac5e-181f5d903e23\" (UID: \"5ef37b85-1aee-454c-ac5e-181f5d903e23\") "
Sep 08 16:44:56.461733 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.461700    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef37b85-1aee-454c-ac5e-181f5d903e23-kube-api-access-4x95g" (OuterVolumeSpecName: "kube-api-access-4x95g") pod "5ef37b85-1aee-454c-ac5e-181f5d903e23" (UID: "5ef37b85-1aee-454c-ac5e-181f5d903e23"). InnerVolumeSpecName "kube-api-access-4x95g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:44:56.515634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.515575    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7842-c9cff9"]
Sep 08 16:44:56.516004 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.515990    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef37b85-1aee-454c-ac5e-181f5d903e23" containerName="mt-curl-7842-a63762"
Sep 08 16:44:56.516065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.516005    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef37b85-1aee-454c-ac5e-181f5d903e23" containerName="mt-curl-7842-a63762"
Sep 08 16:44:56.516105 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.516079    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ef37b85-1aee-454c-ac5e-181f5d903e23" containerName="mt-curl-7842-a63762"
Sep 08 16:44:56.519121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.519105    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7842-c9cff9"
Sep 08 16:44:56.523325 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.523299    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7842-c9cff9"]
Sep 08 16:44:56.561297 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.561263    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x95g\" (UniqueName: \"kubernetes.io/projected/5ef37b85-1aee-454c-ac5e-181f5d903e23-kube-api-access-4x95g\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:44:56.662782 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.662740    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6kqb\" (UniqueName: \"kubernetes.io/projected/b2dad0b9-17e4-4de8-8f15-82c691e49417-kube-api-access-x6kqb\") pod \"mt-curl-7842-c9cff9\" (UID: \"b2dad0b9-17e4-4de8-8f15-82c691e49417\") " pod="opendatahub/mt-curl-7842-c9cff9"
Sep 08 16:44:56.764078 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.763985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6kqb\" (UniqueName: \"kubernetes.io/projected/b2dad0b9-17e4-4de8-8f15-82c691e49417-kube-api-access-x6kqb\") pod \"mt-curl-7842-c9cff9\" (UID: \"b2dad0b9-17e4-4de8-8f15-82c691e49417\") " pod="opendatahub/mt-curl-7842-c9cff9"
Sep 08 16:44:56.773750 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.773723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6kqb\" (UniqueName: \"kubernetes.io/projected/b2dad0b9-17e4-4de8-8f15-82c691e49417-kube-api-access-x6kqb\") pod \"mt-curl-7842-c9cff9\" (UID: \"b2dad0b9-17e4-4de8-8f15-82c691e49417\") " pod="opendatahub/mt-curl-7842-c9cff9"
Sep 08 16:44:56.829669 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:56.829597    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7842-c9cff9"
Sep 08 16:44:57.101770 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:57.101741    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7842-c9cff9"]
Sep 08 16:44:57.104222 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:44:57.104193    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2dad0b9_17e4_4de8_8f15_82c691e49417.slice/crio-aa00d05d2468003ccf763e2ca6fa88bd9311d0947a4163954694aeba9dd24c7c WatchSource:0}: Error finding container aa00d05d2468003ccf763e2ca6fa88bd9311d0947a4163954694aeba9dd24c7c: Status 404 returned error can't find the container with id aa00d05d2468003ccf763e2ca6fa88bd9311d0947a4163954694aeba9dd24c7c
Sep 08 16:44:57.213005 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:57.212979    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7842-a63762"
Sep 08 16:44:57.213181 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:57.213022    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cfd079a7b49f5721150dd8414113324fae593bc40a41c9ddbb22551fd505e34"
Sep 08 16:44:57.214197 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:57.214168    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7842-c9cff9" event={"ID":"b2dad0b9-17e4-4de8-8f15-82c691e49417","Type":"ContainerStarted","Data":"aa00d05d2468003ccf763e2ca6fa88bd9311d0947a4163954694aeba9dd24c7c"}
Sep 08 16:44:57.214492 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:57.214472    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:57.215459 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:57.215439    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:44:57.236933 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:44:57.236907    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7842-a63762\" is forbidden: User \"system:node:ip-10-0-139-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-55.ec2.internal' and this object" podUID="5ef37b85-1aee-454c-ac5e-181f5d903e23" pod="opendatahub/mt-curl-7842-a63762"
Sep 08 16:44:58.004588 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:44:58.004547    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7842-a63762\" is forbidden: User \"system:node:ip-10-0-139-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-55.ec2.internal' and this object" podUID="5ef37b85-1aee-454c-ac5e-181f5d903e23" pod="opendatahub/mt-curl-7842-a63762"
Sep 08 16:44:58.006715 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:58.006689    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ef37b85-1aee-454c-ac5e-181f5d903e23" path="/var/lib/kubelet/pods/5ef37b85-1aee-454c-ac5e-181f5d903e23/volumes"
Sep 08 16:44:58.221843 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:58.221812    2562 generic.go:356] "Generic (PLEG): container finished" podID="b2dad0b9-17e4-4de8-8f15-82c691e49417" containerID="9e91014cd6f16d066f7f3e4a646e262a97daad0d5ab2f24fddde1061053d8a8d" exitCode=0
Sep 08 16:44:58.222010 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:58.221907    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7842-c9cff9" event={"ID":"b2dad0b9-17e4-4de8-8f15-82c691e49417","Type":"ContainerDied","Data":"9e91014cd6f16d066f7f3e4a646e262a97daad0d5ab2f24fddde1061053d8a8d"}
Sep 08 16:44:58.250936 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:58.250896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:58.348435 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:58.348396    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:59.377343 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:59.377315    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7842-c9cff9"
Sep 08 16:44:59.388415 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:59.388391    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6kqb\" (UniqueName: \"kubernetes.io/projected/b2dad0b9-17e4-4de8-8f15-82c691e49417-kube-api-access-x6kqb\") pod \"b2dad0b9-17e4-4de8-8f15-82c691e49417\" (UID: \"b2dad0b9-17e4-4de8-8f15-82c691e49417\") "
Sep 08 16:44:59.390477 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:59.390446    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2dad0b9-17e4-4de8-8f15-82c691e49417-kube-api-access-x6kqb" (OuterVolumeSpecName: "kube-api-access-x6kqb") pod "b2dad0b9-17e4-4de8-8f15-82c691e49417" (UID: "b2dad0b9-17e4-4de8-8f15-82c691e49417"). InnerVolumeSpecName "kube-api-access-x6kqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:44:59.404633 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:59.404562    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:59.406689 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:59.406664    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7842-c9cff9_b2dad0b9-17e4-4de8-8f15-82c691e49417/mt-curl-7842-c9cff9/0.log"
Sep 08 16:44:59.438867 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:59.438839    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7842-c9cff9"]
Sep 08 16:44:59.442132 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:59.442109    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7842-c9cff9"]
Sep 08 16:44:59.489975 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:59.489889    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6kqb\" (UniqueName: \"kubernetes.io/projected/b2dad0b9-17e4-4de8-8f15-82c691e49417-kube-api-access-x6kqb\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:44:59.496320 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:59.496278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:59.752840 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:59.752761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:59.981332 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:44:59.981283    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:00.009006 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.008919    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2dad0b9-17e4-4de8-8f15-82c691e49417" path="/var/lib/kubelet/pods/b2dad0b9-17e4-4de8-8f15-82c691e49417/volumes"
Sep 08 16:45:00.074042 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.074005    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:00.157418 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.157382    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8"]
Sep 08 16:45:00.157799 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.157785    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2dad0b9-17e4-4de8-8f15-82c691e49417" containerName="mt-curl-7842-c9cff9"
Sep 08 16:45:00.157799 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.157800    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2dad0b9-17e4-4de8-8f15-82c691e49417" containerName="mt-curl-7842-c9cff9"
Sep 08 16:45:00.157938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.157891    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2dad0b9-17e4-4de8-8f15-82c691e49417" containerName="mt-curl-7842-c9cff9"
Sep 08 16:45:00.161137 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.161117    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8"
Sep 08 16:45:00.164252 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.164229    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzslb\""
Sep 08 16:45:00.171789 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.171722    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8"
Sep 08 16:45:00.174447 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.174417    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8"]
Sep 08 16:45:00.194988 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.194955    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814765-76npc"]
Sep 08 16:45:00.216902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.207988    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814765-76npc"
Sep 08 16:45:00.216902 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.216190    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:45:00.220633 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.217367    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg"]
Sep 08 16:45:00.231647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.229907    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814765-76npc"]
Sep 08 16:45:00.231647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.230051    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg"
Sep 08 16:45:00.241733 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.240778    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg"]
Sep 08 16:45:00.255632 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.255587    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7842-c9cff9"
Sep 08 16:45:00.255887 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.255713    2562 scope.go:117] "RemoveContainer" containerID="9e91014cd6f16d066f7f3e4a646e262a97daad0d5ab2f24fddde1061053d8a8d"
Sep 08 16:45:00.268430 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.268406    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814765-76npc"
Sep 08 16:45:00.278699 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.278592    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg"
Sep 08 16:45:00.511065 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.511038    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8"]
Sep 08 16:45:00.512740 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:45:00.512678    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449c6606_a6f5_40e0_91d3_755c73675904.slice/crio-cd0f0d5a4488eb74394a8791ec45183c93a805999932981b6a888203b61b5512 WatchSource:0}: Error finding container cd0f0d5a4488eb74394a8791ec45183c93a805999932981b6a888203b61b5512: Status 404 returned error can't find the container with id cd0f0d5a4488eb74394a8791ec45183c93a805999932981b6a888203b61b5512
Sep 08 16:45:00.569618 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.569574    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814765-76npc"]
Sep 08 16:45:00.570958 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:45:00.570929    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1259cfa_a80d_4392_80dd_45c270ad54ae.slice/crio-fe99ea70fd24524f96e2c63592cfe2bb28c33838d95a8218fc5afcfe0445446f WatchSource:0}: Error finding container fe99ea70fd24524f96e2c63592cfe2bb28c33838d95a8218fc5afcfe0445446f: Status 404 returned error can't find the container with id fe99ea70fd24524f96e2c63592cfe2bb28c33838d95a8218fc5afcfe0445446f
Sep 08 16:45:00.573349 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:00.573323    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg"]
Sep 08 16:45:00.575193 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:45:00.575167    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74aea4d_b6c2_4234_9160_e9bd6e9f3dc3.slice/crio-0f73aa70a4d1960b2e786a6cf93ba7c79a2a40d6d1aa60baae00d906e55d418c WatchSource:0}: Error finding container 0f73aa70a4d1960b2e786a6cf93ba7c79a2a40d6d1aa60baae00d906e55d418c: Status 404 returned error can't find the container with id 0f73aa70a4d1960b2e786a6cf93ba7c79a2a40d6d1aa60baae00d906e55d418c
Sep 08 16:45:01.264137 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:01.264102    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8" event={"ID":"449c6606-a6f5-40e0-91d3-755c73675904","Type":"ContainerStarted","Data":"abbec772a5e2dbab6b4375f621ed1930629f1078a2f82ad3abeebb311171ba6d"}
Sep 08 16:45:01.264315 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:01.264162    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8" event={"ID":"449c6606-a6f5-40e0-91d3-755c73675904","Type":"ContainerStarted","Data":"cd0f0d5a4488eb74394a8791ec45183c93a805999932981b6a888203b61b5512"}
Sep 08 16:45:01.265627 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:01.265582    2562 generic.go:356] "Generic (PLEG): container finished" podID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3" containerID="5262c11abd0734c40f9734642489c06d37b4c2ce65a30f193f2d8fdbccaa934c" exitCode=7
Sep 08 16:45:01.265737 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:01.265635    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg" event={"ID":"d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3","Type":"ContainerDied","Data":"5262c11abd0734c40f9734642489c06d37b4c2ce65a30f193f2d8fdbccaa934c"}
Sep 08 16:45:01.265737 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:01.265680    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg" event={"ID":"d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3","Type":"ContainerStarted","Data":"0f73aa70a4d1960b2e786a6cf93ba7c79a2a40d6d1aa60baae00d906e55d418c"}
Sep 08 16:45:01.265835 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:01.265823    2562 scope.go:117] "RemoveContainer" containerID="5262c11abd0734c40f9734642489c06d37b4c2ce65a30f193f2d8fdbccaa934c"
Sep 08 16:45:01.267313 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:01.267291    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814765-76npc" event={"ID":"e1259cfa-a80d-4392-80dd-45c270ad54ae","Type":"ContainerStarted","Data":"5ca3ddd84acc52a66fb84fa384574d20993c94f960d6903f2d214cd1f811dbdc"}
Sep 08 16:45:01.267410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:01.267326    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814765-76npc" event={"ID":"e1259cfa-a80d-4392-80dd-45c270ad54ae","Type":"ContainerStarted","Data":"fe99ea70fd24524f96e2c63592cfe2bb28c33838d95a8218fc5afcfe0445446f"}
Sep 08 16:45:01.278262 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:01.278224    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8" podStartSLOduration=1.278210377 podStartE2EDuration="1.278210377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:45:01.276935382 +0000 UTC m=+1343.861497002" watchObservedRunningTime="2026-09-08 16:45:01.278210377 +0000 UTC m=+1343.862771995"
Sep 08 16:45:01.305912 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:01.305870    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814765-76npc" podStartSLOduration=1.305855823 podStartE2EDuration="1.305855823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:45:01.30516812 +0000 UTC m=+1343.889729741" watchObservedRunningTime="2026-09-08 16:45:01.305855823 +0000 UTC m=+1343.890417442"
Sep 08 16:45:02.155572 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:02.155539    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"]
Sep 08 16:45:02.175950 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:02.175869    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:02.275452 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:02.275423    2562 generic.go:356] "Generic (PLEG): container finished" podID="449c6606-a6f5-40e0-91d3-755c73675904" containerID="abbec772a5e2dbab6b4375f621ed1930629f1078a2f82ad3abeebb311171ba6d" exitCode=0
Sep 08 16:45:02.275639 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:02.275519    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8" event={"ID":"449c6606-a6f5-40e0-91d3-755c73675904","Type":"ContainerDied","Data":"abbec772a5e2dbab6b4375f621ed1930629f1078a2f82ad3abeebb311171ba6d"}
Sep 08 16:45:02.277449 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:02.277420    2562 generic.go:356] "Generic (PLEG): container finished" podID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3" containerID="36f9b8d874e7d5eeb63356062f19aacaf1be1e7ddd2f268ebe2103ad4eb7abb2" exitCode=7
Sep 08 16:45:02.277589 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:02.277501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg" event={"ID":"d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3","Type":"ContainerDied","Data":"36f9b8d874e7d5eeb63356062f19aacaf1be1e7ddd2f268ebe2103ad4eb7abb2"}
Sep 08 16:45:02.277589 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:02.277562    2562 scope.go:117] "RemoveContainer" containerID="5262c11abd0734c40f9734642489c06d37b4c2ce65a30f193f2d8fdbccaa934c"
Sep 08 16:45:02.277744 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:02.277729    2562 scope.go:117] "RemoveContainer" containerID="36f9b8d874e7d5eeb63356062f19aacaf1be1e7ddd2f268ebe2103ad4eb7abb2"
Sep 08 16:45:02.278050 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:45:02.278025    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg_odh-ai-gateway-infra(d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg" podUID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3"
Sep 08 16:45:02.279186 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:02.279165    2562 generic.go:356] "Generic (PLEG): container finished" podID="e1259cfa-a80d-4392-80dd-45c270ad54ae" containerID="5ca3ddd84acc52a66fb84fa384574d20993c94f960d6903f2d214cd1f811dbdc" exitCode=0
Sep 08 16:45:02.279345 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:02.279247    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814765-76npc" event={"ID":"e1259cfa-a80d-4392-80dd-45c270ad54ae","Type":"ContainerDied","Data":"5ca3ddd84acc52a66fb84fa384574d20993c94f960d6903f2d214cd1f811dbdc"}
Sep 08 16:45:03.238928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:03.238895    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"]
Sep 08 16:45:03.257121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:03.257088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:03.286428 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:03.286403    2562 scope.go:117] "RemoveContainer" containerID="36f9b8d874e7d5eeb63356062f19aacaf1be1e7ddd2f268ebe2103ad4eb7abb2"
Sep 08 16:45:03.287180 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:45:03.286704    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg_odh-ai-gateway-infra(d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg" podUID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3"
Sep 08 16:45:03.475355 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:03.475335    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8"
Sep 08 16:45:03.483387 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:03.478692    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814765-76npc"
Sep 08 16:45:04.293884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:04.293796    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8"
Sep 08 16:45:04.293884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:04.293840    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8" event={"ID":"449c6606-a6f5-40e0-91d3-755c73675904","Type":"ContainerDied","Data":"cd0f0d5a4488eb74394a8791ec45183c93a805999932981b6a888203b61b5512"}
Sep 08 16:45:04.294373 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:04.293891    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd0f0d5a4488eb74394a8791ec45183c93a805999932981b6a888203b61b5512"
Sep 08 16:45:04.295332 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:04.295311    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814765-76npc" event={"ID":"e1259cfa-a80d-4392-80dd-45c270ad54ae","Type":"ContainerDied","Data":"fe99ea70fd24524f96e2c63592cfe2bb28c33838d95a8218fc5afcfe0445446f"}
Sep 08 16:45:04.295443 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:04.295351    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe99ea70fd24524f96e2c63592cfe2bb28c33838d95a8218fc5afcfe0445446f"
Sep 08 16:45:04.295443 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:04.295319    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814765-76npc"
Sep 08 16:45:15.268022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:15.267981    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:45:15.967477 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:15.967439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:15.999727 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:15.999699    2562 scope.go:117] "RemoveContainer" containerID="36f9b8d874e7d5eeb63356062f19aacaf1be1e7ddd2f268ebe2103ad4eb7abb2"
Sep 08 16:45:16.085895 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:16.085863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:17.174885 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.174843    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2" podUID="cb399046-84e6-463a-af25-75718a5492cb" containerName="main" containerID="cri-o://09450eabb1c5c64a1e04f7937622aaf9169a20b04eb7c83e49688520348641d6" gracePeriod=45
Sep 08 16:45:17.378085 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.378054    2562 generic.go:356] "Generic (PLEG): container finished" podID="cb399046-84e6-463a-af25-75718a5492cb" containerID="09450eabb1c5c64a1e04f7937622aaf9169a20b04eb7c83e49688520348641d6" exitCode=0
Sep 08 16:45:17.378336 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.378138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2" event={"ID":"cb399046-84e6-463a-af25-75718a5492cb","Type":"ContainerDied","Data":"09450eabb1c5c64a1e04f7937622aaf9169a20b04eb7c83e49688520348641d6"}
Sep 08 16:45:17.380415 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.380390    2562 generic.go:356] "Generic (PLEG): container finished" podID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3" containerID="80720d16b825a314e2c6e57a8d354f50fa91449d2ac487d74b874bec8ae074f0" exitCode=0
Sep 08 16:45:17.380550 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.380437    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg" event={"ID":"d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3","Type":"ContainerDied","Data":"80720d16b825a314e2c6e57a8d354f50fa91449d2ac487d74b874bec8ae074f0"}
Sep 08 16:45:17.380550 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.380503    2562 scope.go:117] "RemoveContainer" containerID="36f9b8d874e7d5eeb63356062f19aacaf1be1e7ddd2f268ebe2103ad4eb7abb2"
Sep 08 16:45:17.433946 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.433919    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:45:17.592589 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.592506    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb399046-84e6-463a-af25-75718a5492cb-tls-certs\") pod \"cb399046-84e6-463a-af25-75718a5492cb\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") "
Sep 08 16:45:17.592589 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.592550    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-home\") pod \"cb399046-84e6-463a-af25-75718a5492cb\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") "
Sep 08 16:45:17.592589 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.592573    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5jqn\" (UniqueName: \"kubernetes.io/projected/cb399046-84e6-463a-af25-75718a5492cb-kube-api-access-v5jqn\") pod \"cb399046-84e6-463a-af25-75718a5492cb\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") "
Sep 08 16:45:17.592887 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.592704    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-tmp-dir\") pod \"cb399046-84e6-463a-af25-75718a5492cb\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") "
Sep 08 16:45:17.592887 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.592749    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-model-cache\") pod \"cb399046-84e6-463a-af25-75718a5492cb\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") "
Sep 08 16:45:17.592887 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.592784    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-dshm\") pod \"cb399046-84e6-463a-af25-75718a5492cb\" (UID: \"cb399046-84e6-463a-af25-75718a5492cb\") "
Sep 08 16:45:17.593032 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.592923    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-home" (OuterVolumeSpecName: "home") pod "cb399046-84e6-463a-af25-75718a5492cb" (UID: "cb399046-84e6-463a-af25-75718a5492cb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:17.593112 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.593074    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cb399046-84e6-463a-af25-75718a5492cb" (UID: "cb399046-84e6-463a-af25-75718a5492cb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:17.593169 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.593083    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-model-cache" (OuterVolumeSpecName: "model-cache") pod "cb399046-84e6-463a-af25-75718a5492cb" (UID: "cb399046-84e6-463a-af25-75718a5492cb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:17.593239 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.593225    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:45:17.593297 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.593241    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:45:17.593297 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.593250    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:45:17.595078 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.595050    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb399046-84e6-463a-af25-75718a5492cb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cb399046-84e6-463a-af25-75718a5492cb" (UID: "cb399046-84e6-463a-af25-75718a5492cb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:45:17.595472 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.595454    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-dshm" (OuterVolumeSpecName: "dshm") pod "cb399046-84e6-463a-af25-75718a5492cb" (UID: "cb399046-84e6-463a-af25-75718a5492cb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:17.595555 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.595491    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb399046-84e6-463a-af25-75718a5492cb-kube-api-access-v5jqn" (OuterVolumeSpecName: "kube-api-access-v5jqn") pod "cb399046-84e6-463a-af25-75718a5492cb" (UID: "cb399046-84e6-463a-af25-75718a5492cb"). InnerVolumeSpecName "kube-api-access-v5jqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:45:17.694871 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.694830    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb399046-84e6-463a-af25-75718a5492cb-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:45:17.694871 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.694871    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb399046-84e6-463a-af25-75718a5492cb-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:45:17.695080 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:17.694890    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5jqn\" (UniqueName: \"kubernetes.io/projected/cb399046-84e6-463a-af25-75718a5492cb-kube-api-access-v5jqn\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:45:18.260347 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.260302    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd" podUID="ced24944-cae2-4839-a3e6-b8e37d472a3c" containerName="main" containerID="cri-o://7182b1853d69660f68a498c98f482a553b46c0b405d2c1ee17213c8fb300848e" gracePeriod=45
Sep 08 16:45:18.392625 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.392583    2562 generic.go:356] "Generic (PLEG): container finished" podID="ced24944-cae2-4839-a3e6-b8e37d472a3c" containerID="7182b1853d69660f68a498c98f482a553b46c0b405d2c1ee17213c8fb300848e" exitCode=0
Sep 08 16:45:18.392747 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.392655    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd" event={"ID":"ced24944-cae2-4839-a3e6-b8e37d472a3c","Type":"ContainerDied","Data":"7182b1853d69660f68a498c98f482a553b46c0b405d2c1ee17213c8fb300848e"}
Sep 08 16:45:18.394633 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.394496    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2" event={"ID":"cb399046-84e6-463a-af25-75718a5492cb","Type":"ContainerDied","Data":"fdf8fe3e4818eea3183b121539c219e0573e2d25c656eca66b89138104f3cf94"}
Sep 08 16:45:18.394633 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.394526    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"
Sep 08 16:45:18.394633 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.394543    2562 scope.go:117] "RemoveContainer" containerID="09450eabb1c5c64a1e04f7937622aaf9169a20b04eb7c83e49688520348641d6"
Sep 08 16:45:18.409255 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.409218    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg"]
Sep 08 16:45:18.434292 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.431685    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"]
Sep 08 16:45:18.439777 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.439738    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/sub-test-model-a4942b-kserve-57446c59b7-445w2"]
Sep 08 16:45:18.539888 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.539859    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:45:18.559562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.559536    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg"
Sep 08 16:45:18.705500 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.705461    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ced24944-cae2-4839-a3e6-b8e37d472a3c-tls-certs\") pod \"ced24944-cae2-4839-a3e6-b8e37d472a3c\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") "
Sep 08 16:45:18.705684 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.705518    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-home\") pod \"ced24944-cae2-4839-a3e6-b8e37d472a3c\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") "
Sep 08 16:45:18.705684 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.705573    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27lh6\" (UniqueName: \"kubernetes.io/projected/ced24944-cae2-4839-a3e6-b8e37d472a3c-kube-api-access-27lh6\") pod \"ced24944-cae2-4839-a3e6-b8e37d472a3c\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") "
Sep 08 16:45:18.705684 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.705666    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-tmp-dir\") pod \"ced24944-cae2-4839-a3e6-b8e37d472a3c\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") "
Sep 08 16:45:18.705815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.705698    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-model-cache\") pod \"ced24944-cae2-4839-a3e6-b8e37d472a3c\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") "
Sep 08 16:45:18.705815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.705758    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-dshm\") pod \"ced24944-cae2-4839-a3e6-b8e37d472a3c\" (UID: \"ced24944-cae2-4839-a3e6-b8e37d472a3c\") "
Sep 08 16:45:18.705922 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.705849    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-home" (OuterVolumeSpecName: "home") pod "ced24944-cae2-4839-a3e6-b8e37d472a3c" (UID: "ced24944-cae2-4839-a3e6-b8e37d472a3c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:18.705980 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.705922    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ced24944-cae2-4839-a3e6-b8e37d472a3c" (UID: "ced24944-cae2-4839-a3e6-b8e37d472a3c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:18.706077 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.706033    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-model-cache" (OuterVolumeSpecName: "model-cache") pod "ced24944-cae2-4839-a3e6-b8e37d472a3c" (UID: "ced24944-cae2-4839-a3e6-b8e37d472a3c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:18.706971 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.706756    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:45:18.706971 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.706788    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:45:18.706971 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.706805    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:45:18.708557 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.708523    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced24944-cae2-4839-a3e6-b8e37d472a3c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ced24944-cae2-4839-a3e6-b8e37d472a3c" (UID: "ced24944-cae2-4839-a3e6-b8e37d472a3c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:45:18.708694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.708600    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced24944-cae2-4839-a3e6-b8e37d472a3c-kube-api-access-27lh6" (OuterVolumeSpecName: "kube-api-access-27lh6") pod "ced24944-cae2-4839-a3e6-b8e37d472a3c" (UID: "ced24944-cae2-4839-a3e6-b8e37d472a3c"). InnerVolumeSpecName "kube-api-access-27lh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:45:18.715106 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.715081    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-dshm" (OuterVolumeSpecName: "dshm") pod "ced24944-cae2-4839-a3e6-b8e37d472a3c" (UID: "ced24944-cae2-4839-a3e6-b8e37d472a3c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:18.807646 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.807532    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ced24944-cae2-4839-a3e6-b8e37d472a3c-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:45:18.807646 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.807572    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27lh6\" (UniqueName: \"kubernetes.io/projected/ced24944-cae2-4839-a3e6-b8e37d472a3c-kube-api-access-27lh6\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:45:18.807646 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:18.807582    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ced24944-cae2-4839-a3e6-b8e37d472a3c-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:45:19.403513 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:19.403483    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg"
Sep 08 16:45:19.403513 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:19.403493    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg" event={"ID":"d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3","Type":"ContainerDied","Data":"0f73aa70a4d1960b2e786a6cf93ba7c79a2a40d6d1aa60baae00d906e55d418c"}
Sep 08 16:45:19.404019 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:19.403547    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f73aa70a4d1960b2e786a6cf93ba7c79a2a40d6d1aa60baae00d906e55d418c"
Sep 08 16:45:19.404923 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:19.404899    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd" event={"ID":"ced24944-cae2-4839-a3e6-b8e37d472a3c","Type":"ContainerDied","Data":"adddc38817b32d15ea56d44a88720a6dbed985d587f9e9c2e18e4bccd08d516c"}
Sep 08 16:45:19.405052 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:19.404933    2562 scope.go:117] "RemoveContainer" containerID="7182b1853d69660f68a498c98f482a553b46c0b405d2c1ee17213c8fb300848e"
Sep 08 16:45:19.405052 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:19.404955    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"
Sep 08 16:45:19.435451 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:19.435418    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"]
Sep 08 16:45:19.438828 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:19.438774    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/sub-test-model-823397-kserve-5564495767-l8fbd"]
Sep 08 16:45:19.447870 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:19.447846    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg"]
Sep 08 16:45:19.451883 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:19.451859    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-61f413-29814765-p7qgg"]
Sep 08 16:45:20.007141 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:20.007110    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb399046-84e6-463a-af25-75718a5492cb" path="/var/lib/kubelet/pods/cb399046-84e6-463a-af25-75718a5492cb/volumes"
Sep 08 16:45:20.026547 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:20.007502    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ced24944-cae2-4839-a3e6-b8e37d472a3c" path="/var/lib/kubelet/pods/ced24944-cae2-4839-a3e6-b8e37d472a3c/volumes"
Sep 08 16:45:20.026547 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:20.007765    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3" path="/var/lib/kubelet/pods/d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3/volumes"
Sep 08 16:45:20.412058 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:20.411966    2562 generic.go:356] "Generic (PLEG): container finished" podID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerID="46e2b30a96874d5054ca6c4e5091b41a3aab68af9fd3b165ebba6e1da82fc1ee" exitCode=0
Sep 08 16:45:20.412058 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:20.412040    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns" event={"ID":"63eddb5e-3624-4563-a1da-1272d8226ba3","Type":"ContainerDied","Data":"46e2b30a96874d5054ca6c4e5091b41a3aab68af9fd3b165ebba6e1da82fc1ee"}
Sep 08 16:45:20.412561 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:20.412540    2562 scope.go:117] "RemoveContainer" containerID="46e2b30a96874d5054ca6c4e5091b41a3aab68af9fd3b165ebba6e1da82fc1ee"
Sep 08 16:45:20.413719 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:20.413692    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:45:20.413837 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:20.413772    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:45:20.413837 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:20.413818    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:45:21.421859 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:21.421812    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns" event={"ID":"63eddb5e-3624-4563-a1da-1272d8226ba3","Type":"ContainerStarted","Data":"3e310e317d77818565c50e65a5bd89ce23efecff13e91ee4c1d41cd5df8ab0f0"}
Sep 08 16:45:22.361223 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:22.361183    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:45:22.361420 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:22.361398    2562 patch_prober.go:28] interesting pod/e2e-api-a-61f413-openshift-default-c9445fd78-btsns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 08 16:45:22.361481 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:22.361444    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns" podUID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 08 16:45:23.252934 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:23.252890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:23.360832 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:23.360800    2562 patch_prober.go:28] interesting pod/e2e-api-a-61f413-openshift-default-c9445fd78-btsns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 08 16:45:23.361001 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:23.360859    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns" podUID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 08 16:45:23.739052 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:23.739018    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:24.050745 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.050660    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"]
Sep 08 16:45:24.051508 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.051479    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced24944-cae2-4839-a3e6-b8e37d472a3c" containerName="main"
Sep 08 16:45:24.051682 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.051668    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced24944-cae2-4839-a3e6-b8e37d472a3c" containerName="main"
Sep 08 16:45:24.051801 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.051787    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1259cfa-a80d-4392-80dd-45c270ad54ae" containerName="cleanup"
Sep 08 16:45:24.051893 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.051882    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1259cfa-a80d-4392-80dd-45c270ad54ae" containerName="cleanup"
Sep 08 16:45:24.051993 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.051982    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb399046-84e6-463a-af25-75718a5492cb" containerName="main"
Sep 08 16:45:24.052077 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.052067    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb399046-84e6-463a-af25-75718a5492cb" containerName="main"
Sep 08 16:45:24.052164 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.052154    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3" containerName="cleanup"
Sep 08 16:45:24.052238 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.052229    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3" containerName="cleanup"
Sep 08 16:45:24.052337 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.052326    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="449c6606-a6f5-40e0-91d3-755c73675904" containerName="cleanup"
Sep 08 16:45:24.052419 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.052408    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="449c6606-a6f5-40e0-91d3-755c73675904" containerName="cleanup"
Sep 08 16:45:24.052497 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.052488    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3" containerName="cleanup"
Sep 08 16:45:24.052573 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.052564    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3" containerName="cleanup"
Sep 08 16:45:24.052808 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.052791    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="449c6606-a6f5-40e0-91d3-755c73675904" containerName="cleanup"
Sep 08 16:45:24.052918 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.052906    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3" containerName="cleanup"
Sep 08 16:45:24.053015 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.053003    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3" containerName="cleanup"
Sep 08 16:45:24.053101 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.053091    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ced24944-cae2-4839-a3e6-b8e37d472a3c" containerName="main"
Sep 08 16:45:24.053181 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.053171    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3" containerName="cleanup"
Sep 08 16:45:24.053276 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.053266    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1259cfa-a80d-4392-80dd-45c270ad54ae" containerName="cleanup"
Sep 08 16:45:24.053360 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.053349    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb399046-84e6-463a-af25-75718a5492cb" containerName="main"
Sep 08 16:45:24.056448 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.056415    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"]
Sep 08 16:45:24.056585 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.056561    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.059643 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.059593    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f2ae08-openshift-default-dockercfg-ptmtd\""
Sep 08 16:45:24.061736 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.061708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:24.165270 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.165234    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-envoy\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.165565 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.165543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-workload-certs\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.165800 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.165781    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-credential-socket\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.165923 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.165910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-token\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.166016 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.166003    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-data\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.166104 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.166092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6mp5\" (UniqueName: \"kubernetes.io/projected/296e3e27-7196-4a56-9c0f-0435f9d5edf3-kube-api-access-b6mp5\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.166202 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.166188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-workload-socket\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.166336 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.166323    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-podinfo\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.166428 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.166416    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istiod-ca-cert\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.268142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.268103    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-credential-socket\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.268638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.268163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-token\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.268638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.268193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-data\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.268638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.268219    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6mp5\" (UniqueName: \"kubernetes.io/projected/296e3e27-7196-4a56-9c0f-0435f9d5edf3-kube-api-access-b6mp5\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.268638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.268248    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-workload-socket\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.268638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.268311    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-podinfo\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.268638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.268345    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istiod-ca-cert\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.268638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.268565    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-credential-socket\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.269053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.268722    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-workload-socket\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.269053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.268956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-envoy\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.269053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.268998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-workload-certs\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.269242 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.269212    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istiod-ca-cert\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.269310 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.269293    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-data\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.269372 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.269351    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-workload-certs\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.270960 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.270934    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-envoy\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.271109 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.271086    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-podinfo\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.279658 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.279636    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-token\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.279942 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.279926    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6mp5\" (UniqueName: \"kubernetes.io/projected/296e3e27-7196-4a56-9c0f-0435f9d5edf3-kube-api-access-b6mp5\") pod \"e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") " pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.361353 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.361247    2562 patch_prober.go:28] interesting pod/e2e-api-a-61f413-openshift-default-c9445fd78-btsns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 08 16:45:24.361353 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.361341    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns" podUID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 08 16:45:24.368022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.367994    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:24.416354 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.416320    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:24.672436 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.672401    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"]
Sep 08 16:45:24.673698 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:45:24.673669    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod296e3e27_7196_4a56_9c0f_0435f9d5edf3.slice/crio-e8b02885478ab631888d96feb0382042a011cff61f095e1ea5f026f346271942 WatchSource:0}: Error finding container e8b02885478ab631888d96feb0382042a011cff61f095e1ea5f026f346271942: Status 404 returned error can't find the container with id e8b02885478ab631888d96feb0382042a011cff61f095e1ea5f026f346271942
Sep 08 16:45:24.675928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.675898    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:45:24.675999 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.675964    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:45:24.675999 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.675994    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:45:24.900973 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:24.900937    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:25.361882 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:25.361844    2562 patch_prober.go:28] interesting pod/e2e-api-a-61f413-openshift-default-c9445fd78-btsns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 08 16:45:25.362275 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:25.361899    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns" podUID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 08 16:45:25.458994 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:25.458951    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" event={"ID":"296e3e27-7196-4a56-9c0f-0435f9d5edf3","Type":"ContainerStarted","Data":"4918371022f3e1ce6795e7bcf039a1e976564d77264809e95e1c8ad6788916ba"}
Sep 08 16:45:25.459205 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:25.459031    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" event={"ID":"296e3e27-7196-4a56-9c0f-0435f9d5edf3","Type":"ContainerStarted","Data":"e8b02885478ab631888d96feb0382042a011cff61f095e1ea5f026f346271942"}
Sep 08 16:45:25.479984 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:25.479936    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" podStartSLOduration=1.479920758 podStartE2EDuration="1.479920758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:45:25.477358649 +0000 UTC m=+1368.061920269" watchObservedRunningTime="2026-09-08 16:45:25.479920758 +0000 UTC m=+1368.064482376"
Sep 08 16:45:26.361058 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:26.361022    2562 patch_prober.go:28] interesting pod/e2e-api-a-61f413-openshift-default-c9445fd78-btsns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 08 16:45:26.361233 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:26.361081    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns" podUID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 08 16:45:26.368732 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:26.368702    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:26.373720 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:26.373699    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:26.465793 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:26.465755    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:26.466913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:26.466896    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:27.214744 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:27.214708    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:45:27.365465 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:27.365433    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:45:27.400012 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:27.399964    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:27.473426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:27.473338    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:45:27.490249 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:27.490213    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:28.566538 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:28.566497    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:28.667465 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:28.667426    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:28.770776 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:28.770735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:29.100143 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:29.100109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:29.199062 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:29.199016    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:36.854140 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:36.854104    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:45:37.565831 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.565793    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"]
Sep 08 16:45:37.566270 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.566254    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3" containerName="cleanup"
Sep 08 16:45:37.566327 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.566272    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74aea4d-b6c2-4234-9160-e9bd6e9f3dc3" containerName="cleanup"
Sep 08 16:45:37.568496 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.568474    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.571301 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.571276    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-a4942b\"/\"default-dockercfg-vg2fx\""
Sep 08 16:45:37.571419 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.571396    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-a4942b\"/\"openshift-service-ca.crt\""
Sep 08 16:45:37.572246 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.572221    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-a4942b\"/\"rate-test-model-a4942b-kserve-self-signed-certs\""
Sep 08 16:45:37.572246 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.572237    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-a4942b\"/\"kube-root-ca.crt\""
Sep 08 16:45:37.593342 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.593312    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"]
Sep 08 16:45:37.614836 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.614802    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:37.699238 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.699203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-dshm\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.699426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.699258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-home\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.699426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.699314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4843c8a-6633-4c32-9f75-58cad16b32aa-tls-certs\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.699426 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.699358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-model-cache\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.699638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.699490    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-tmp-dir\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.699638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.699530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdm2n\" (UniqueName: \"kubernetes.io/projected/c4843c8a-6633-4c32-9f75-58cad16b32aa-kube-api-access-cdm2n\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.800210 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.800175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-model-cache\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.800389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.800252    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-tmp-dir\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.800389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.800269    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdm2n\" (UniqueName: \"kubernetes.io/projected/c4843c8a-6633-4c32-9f75-58cad16b32aa-kube-api-access-cdm2n\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.800389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.800319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-dshm\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.800389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.800371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-home\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.800642 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.800397    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4843c8a-6633-4c32-9f75-58cad16b32aa-tls-certs\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.800725 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.800644    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-model-cache\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.800725 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.800655    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-tmp-dir\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.800812 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.800753    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-home\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.802542 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.802513    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-dshm\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.803579 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.803558    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-a4942b\"/\"rate-test-model-a4942b-kserve-self-signed-certs\""
Sep 08 16:45:37.809744 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.809723    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-a4942b\"/\"kube-root-ca.crt\""
Sep 08 16:45:37.812941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.812919    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4843c8a-6633-4c32-9f75-58cad16b32aa-tls-certs\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.820309 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.820245    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-a4942b\"/\"openshift-service-ca.crt\""
Sep 08 16:45:37.830771 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.830750    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdm2n\" (UniqueName: \"kubernetes.io/projected/c4843c8a-6633-4c32-9f75-58cad16b32aa-kube-api-access-cdm2n\") pod \"rate-test-model-a4942b-kserve-68f8f596c9-nc4bh\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") " pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:37.882824 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.882800    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-a4942b\"/\"default-dockercfg-vg2fx\""
Sep 08 16:45:37.889706 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:37.889683    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:38.164883 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:38.164856    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"]
Sep 08 16:45:38.166131 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:45:38.166110    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4843c8a_6633_4c32_9f75_58cad16b32aa.slice/crio-1e67421fbb704c3812a8aaf504df3fe01e8ae1da8d5b953260c7cfec49f6c996 WatchSource:0}: Error finding container 1e67421fbb704c3812a8aaf504df3fe01e8ae1da8d5b953260c7cfec49f6c996: Status 404 returned error can't find the container with id 1e67421fbb704c3812a8aaf504df3fe01e8ae1da8d5b953260c7cfec49f6c996
Sep 08 16:45:38.540069 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:38.540028    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh" event={"ID":"c4843c8a-6633-4c32-9f75-58cad16b32aa","Type":"ContainerStarted","Data":"cfef1d116b02845d9524065f4870f853ad3f185d3d966037ef6252a962c8d2cb"}
Sep 08 16:45:38.540285 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:38.540080    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh" event={"ID":"c4843c8a-6633-4c32-9f75-58cad16b32aa","Type":"ContainerStarted","Data":"1e67421fbb704c3812a8aaf504df3fe01e8ae1da8d5b953260c7cfec49f6c996"}
Sep 08 16:45:38.558899 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:38.558849    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh" podStartSLOduration=1.558836192 podStartE2EDuration="1.558836192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:45:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:45:38.557537006 +0000 UTC m=+1381.142098639" watchObservedRunningTime="2026-09-08 16:45:38.558836192 +0000 UTC m=+1381.143397812"
Sep 08 16:45:47.889905 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:47.889810    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:47.890309 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:47.890080    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:47.902991 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:47.902907    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:48.603159 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:48.603126    2562 generic.go:356] "Generic (PLEG): container finished" podID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerID="4918371022f3e1ce6795e7bcf039a1e976564d77264809e95e1c8ad6788916ba" exitCode=0
Sep 08 16:45:48.603345 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:48.603198    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" event={"ID":"296e3e27-7196-4a56-9c0f-0435f9d5edf3","Type":"ContainerDied","Data":"4918371022f3e1ce6795e7bcf039a1e976564d77264809e95e1c8ad6788916ba"}
Sep 08 16:45:48.603730 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:48.603703    2562 scope.go:117] "RemoveContainer" containerID="4918371022f3e1ce6795e7bcf039a1e976564d77264809e95e1c8ad6788916ba"
Sep 08 16:45:48.604986 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:48.604955    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:45:48.605050 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:48.605027    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:45:48.605087 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:48.605065    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:45:48.618724 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:48.618696    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:45:49.611215 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:49.611179    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" event={"ID":"296e3e27-7196-4a56-9c0f-0435f9d5edf3","Type":"ContainerStarted","Data":"f262c395a8e1c7b1d7b5aad16be455db1825fe93782568ff380a0fd9c470eb4b"}
Sep 08 16:45:50.078728 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:50.078690    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:45:50.368866 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:50.368767    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:50.369084 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:50.369060    2562 patch_prober.go:28] interesting pod/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 08 16:45:50.369137 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:50.369110    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 08 16:45:51.368958 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:51.368918    2562 patch_prober.go:28] interesting pod/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 08 16:45:51.369334 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:51.368996    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 08 16:45:52.368752 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:52.368715    2562 patch_prober.go:28] interesting pod/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 08 16:45:52.368928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:52.368781    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 08 16:45:52.391635 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:52.391584    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:53.368525 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:53.368485    2562 patch_prober.go:28] interesting pod/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 08 16:45:53.368739 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:53.368552    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 08 16:45:54.369117 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:54.369072    2562 patch_prober.go:28] interesting pod/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 08 16:45:54.369529 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:54.369135    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 08 16:45:54.400297 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:54.400242    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:55.335952 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.335911    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt"]
Sep 08 16:45:55.338492 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.338476    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt"
Sep 08 16:45:55.341061 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.341031    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzslb\""
Sep 08 16:45:55.341061 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.341036    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:45:55.348022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.347990    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt"]
Sep 08 16:45:55.368974 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.368939    2562 patch_prober.go:28] interesting pod/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 08 16:45:55.369171 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.368999    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 08 16:45:55.483831 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.483784    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:55.485937 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.485913    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c53dfce-dd68-4803-8fc9-d52ea25493e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-61f413-ctcqt\" (UID: \"7c53dfce-dd68-4803-8fc9-d52ea25493e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt"
Sep 08 16:45:55.587269 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.587172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c53dfce-dd68-4803-8fc9-d52ea25493e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-61f413-ctcqt\" (UID: \"7c53dfce-dd68-4803-8fc9-d52ea25493e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt"
Sep 08 16:45:55.587821 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.587803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c53dfce-dd68-4803-8fc9-d52ea25493e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-61f413-ctcqt\" (UID: \"7c53dfce-dd68-4803-8fc9-d52ea25493e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt"
Sep 08 16:45:55.650567 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.650529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt"
Sep 08 16:45:55.929680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.929647    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt"]
Sep 08 16:45:55.930674 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:45:55.930650    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c53dfce_dd68_4803_8fc9_d52ea25493e6.slice/crio-f99782a840477b81f6842ac7eb4203de303c8f2db68f1787322480187ed8b466 WatchSource:0}: Error finding container f99782a840477b81f6842ac7eb4203de303c8f2db68f1787322480187ed8b466: Status 404 returned error can't find the container with id f99782a840477b81f6842ac7eb4203de303c8f2db68f1787322480187ed8b466
Sep 08 16:45:55.976365 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.976336    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"]
Sep 08 16:45:55.979300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.979278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:55.984427 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.984407    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-823397\"/\"kube-root-ca.crt\""
Sep 08 16:45:55.984520 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.984455    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-823397\"/\"openshift-service-ca.crt\""
Sep 08 16:45:55.984820 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.984803    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-823397\"/\"default-dockercfg-ntzvq\""
Sep 08 16:45:55.984913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:55.984847    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-823397\"/\"rate-test-model-823397-kserve-self-signed-certs\""
Sep 08 16:45:56.009432 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.009408    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"]
Sep 08 16:45:56.051361 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.051304    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:56.091770 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.091729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpzp6\" (UniqueName: \"kubernetes.io/projected/15da9566-2438-4973-a927-79d2fbd3b017-kube-api-access-qpzp6\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.091965 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.091778    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15da9566-2438-4973-a927-79d2fbd3b017-tls-certs\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.091965 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.091838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-home\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.091965 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.091900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-dshm\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.091965 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.091941    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-model-cache\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.091965 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.091962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-tmp-dir\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.192557 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.192526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpzp6\" (UniqueName: \"kubernetes.io/projected/15da9566-2438-4973-a927-79d2fbd3b017-kube-api-access-qpzp6\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.192772 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.192569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15da9566-2438-4973-a927-79d2fbd3b017-tls-certs\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.192772 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.192593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-home\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.192772 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.192655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-dshm\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.192772 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.192683    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-model-cache\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.192772 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.192699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-tmp-dir\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.193188 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.193167    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-model-cache\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.193257 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.193187    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-home\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.193257 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.193220    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-tmp-dir\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.194852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.194831    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-dshm\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.195147 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.195128    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15da9566-2438-4973-a927-79d2fbd3b017-tls-certs\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.201798 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.201779    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpzp6\" (UniqueName: \"kubernetes.io/projected/15da9566-2438-4973-a927-79d2fbd3b017-kube-api-access-qpzp6\") pod \"rate-test-model-823397-kserve-67587b7b6c-w6tzm\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") " pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.288433 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.288397    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:45:56.373243 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.373216    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:56.373619 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.373588    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:56.374330 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.374313    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:45:56.594458 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.594433    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"]
Sep 08 16:45:56.596940 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:45:56.596916    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15da9566_2438_4973_a927_79d2fbd3b017.slice/crio-319d71c2df78579927b01777216e5eced6ae28306bb6a6c457e25871c39c4c5c WatchSource:0}: Error finding container 319d71c2df78579927b01777216e5eced6ae28306bb6a6c457e25871c39c4c5c: Status 404 returned error can't find the container with id 319d71c2df78579927b01777216e5eced6ae28306bb6a6c457e25871c39c4c5c
Sep 08 16:45:56.665379 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.665346    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm" event={"ID":"15da9566-2438-4973-a927-79d2fbd3b017","Type":"ContainerStarted","Data":"ba2b33629eba65f8d3903af72984f1d6c754abf663a72f8f05804210ca0ee343"}
Sep 08 16:45:56.665516 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.665398    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm" event={"ID":"15da9566-2438-4973-a927-79d2fbd3b017","Type":"ContainerStarted","Data":"319d71c2df78579927b01777216e5eced6ae28306bb6a6c457e25871c39c4c5c"}
Sep 08 16:45:56.667010 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.666985    2562 generic.go:356] "Generic (PLEG): container finished" podID="7c53dfce-dd68-4803-8fc9-d52ea25493e6" containerID="3de3f2d41412a0c09599a7162aa6667ef09a313671ea6d166582da52c69a9f95" exitCode=0
Sep 08 16:45:56.667112 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.667071    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt" event={"ID":"7c53dfce-dd68-4803-8fc9-d52ea25493e6","Type":"ContainerDied","Data":"3de3f2d41412a0c09599a7162aa6667ef09a313671ea6d166582da52c69a9f95"}
Sep 08 16:45:56.667163 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.667122    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt" event={"ID":"7c53dfce-dd68-4803-8fc9-d52ea25493e6","Type":"ContainerStarted","Data":"f99782a840477b81f6842ac7eb4203de303c8f2db68f1787322480187ed8b466"}
Sep 08 16:45:56.684829 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:56.684785    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm" podStartSLOduration=1.684768768 podStartE2EDuration="1.684768768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:45:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:45:56.68346104 +0000 UTC m=+1399.268022660" watchObservedRunningTime="2026-09-08 16:45:56.684768768 +0000 UTC m=+1399.269330387"
Sep 08 16:45:57.802276 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:57.802247    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt"
Sep 08 16:45:57.911389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:57.911360    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c53dfce-dd68-4803-8fc9-d52ea25493e6-maas-api-service-ca\") pod \"7c53dfce-dd68-4803-8fc9-d52ea25493e6\" (UID: \"7c53dfce-dd68-4803-8fc9-d52ea25493e6\") "
Sep 08 16:45:57.911700 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:57.911679    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c53dfce-dd68-4803-8fc9-d52ea25493e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7c53dfce-dd68-4803-8fc9-d52ea25493e6" (UID: "7c53dfce-dd68-4803-8fc9-d52ea25493e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:45:58.012773 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:58.012748    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c53dfce-dd68-4803-8fc9-d52ea25493e6-maas-api-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:45:58.680015 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:58.679982    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt"
Sep 08 16:45:58.680176 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:58.680030    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt" event={"ID":"7c53dfce-dd68-4803-8fc9-d52ea25493e6","Type":"ContainerDied","Data":"f99782a840477b81f6842ac7eb4203de303c8f2db68f1787322480187ed8b466"}
Sep 08 16:45:58.680176 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:45:58.680084    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f99782a840477b81f6842ac7eb4203de303c8f2db68f1787322480187ed8b466"
Sep 08 16:46:02.977361 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:02.977322    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:46:06.289151 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:06.289112    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:46:06.289528 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:06.289197    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:46:06.301650 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:06.301629    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:46:06.737884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:06.737853    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:46:11.025800 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:11.025760    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:11.111593 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:11.111561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:11.190735 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:11.190700    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:11.278008 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:11.277920    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt"]
Sep 08 16:46:11.279782 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:11.279748    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:11.283777 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:11.283745    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61f413-ctcqt"]
Sep 08 16:46:11.348709 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:11.348670    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:11.683316 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:11.683227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:12.006394 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:12.006362    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c53dfce-dd68-4803-8fc9-d52ea25493e6" path="/var/lib/kubelet/pods/7c53dfce-dd68-4803-8fc9-d52ea25493e6/volumes"
Sep 08 16:46:17.121005 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:17.120970    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:46:17.717079 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:17.717044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:17.789950 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:17.789915    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:17.975205 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:17.975109    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"]
Sep 08 16:46:17.975403 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:17.975378    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns" podUID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerName="istio-proxy" containerID="cri-o://3e310e317d77818565c50e65a5bd89ce23efecff13e91ee4c1d41cd5df8ab0f0" gracePeriod=30
Sep 08 16:46:18.003935 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.003902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:18.365905 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.365826    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct"]
Sep 08 16:46:18.366273 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.366205    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c53dfce-dd68-4803-8fc9-d52ea25493e6" containerName="revoke-keys"
Sep 08 16:46:18.366273 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.366216    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c53dfce-dd68-4803-8fc9-d52ea25493e6" containerName="revoke-keys"
Sep 08 16:46:18.366346 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.366282    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c53dfce-dd68-4803-8fc9-d52ea25493e6" containerName="revoke-keys"
Sep 08 16:46:18.369640 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.369597    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct"
Sep 08 16:46:18.371927 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.371907    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:46:18.372066 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.371937    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzslb\""
Sep 08 16:46:18.376969 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.376943    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct"]
Sep 08 16:46:18.502020 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.501964    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55ac4717-1742-464b-b97b-3e85c0e851a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f2ae08-6psct\" (UID: \"55ac4717-1742-464b-b97b-3e85c0e851a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct"
Sep 08 16:46:18.535056 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.535017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:18.603393 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.603351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55ac4717-1742-464b-b97b-3e85c0e851a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f2ae08-6psct\" (UID: \"55ac4717-1742-464b-b97b-3e85c0e851a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct"
Sep 08 16:46:18.604094 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.604069    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55ac4717-1742-464b-b97b-3e85c0e851a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f2ae08-6psct\" (UID: \"55ac4717-1742-464b-b97b-3e85c0e851a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct"
Sep 08 16:46:18.682323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.682240    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct"
Sep 08 16:46:18.969783 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:18.969754    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct"]
Sep 08 16:46:18.970720 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:46:18.970686    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55ac4717_1742_464b_b97b_3e85c0e851a0.slice/crio-a7400f2cb4986d2aa038e386e4284ab6f8af6a7c31f176fe87276b9011499ed3 WatchSource:0}: Error finding container a7400f2cb4986d2aa038e386e4284ab6f8af6a7c31f176fe87276b9011499ed3: Status 404 returned error can't find the container with id a7400f2cb4986d2aa038e386e4284ab6f8af6a7c31f176fe87276b9011499ed3
Sep 08 16:46:19.811820 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:19.811786    2562 generic.go:356] "Generic (PLEG): container finished" podID="55ac4717-1742-464b-b97b-3e85c0e851a0" containerID="62d0e2b5ab52a45a8b5369469ccdd296072392c5f06a5056c9b094eda24834a9" exitCode=0
Sep 08 16:46:19.812209 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:19.811873    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct" event={"ID":"55ac4717-1742-464b-b97b-3e85c0e851a0","Type":"ContainerDied","Data":"62d0e2b5ab52a45a8b5369469ccdd296072392c5f06a5056c9b094eda24834a9"}
Sep 08 16:46:19.812209 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:19.811925    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct" event={"ID":"55ac4717-1742-464b-b97b-3e85c0e851a0","Type":"ContainerStarted","Data":"a7400f2cb4986d2aa038e386e4284ab6f8af6a7c31f176fe87276b9011499ed3"}
Sep 08 16:46:20.951270 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:20.951241    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct"
Sep 08 16:46:21.032415 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:21.032384    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55ac4717-1742-464b-b97b-3e85c0e851a0-maas-api-service-ca\") pod \"55ac4717-1742-464b-b97b-3e85c0e851a0\" (UID: \"55ac4717-1742-464b-b97b-3e85c0e851a0\") "
Sep 08 16:46:21.032744 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:21.032721    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55ac4717-1742-464b-b97b-3e85c0e851a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "55ac4717-1742-464b-b97b-3e85c0e851a0" (UID: "55ac4717-1742-464b-b97b-3e85c0e851a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:46:21.133802 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:21.133526    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55ac4717-1742-464b-b97b-3e85c0e851a0-maas-api-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:21.825562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:21.825529    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct"
Sep 08 16:46:21.825779 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:21.825524    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct" event={"ID":"55ac4717-1742-464b-b97b-3e85c0e851a0","Type":"ContainerDied","Data":"a7400f2cb4986d2aa038e386e4284ab6f8af6a7c31f176fe87276b9011499ed3"}
Sep 08 16:46:21.825779 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:21.825656    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7400f2cb4986d2aa038e386e4284ab6f8af6a7c31f176fe87276b9011499ed3"
Sep 08 16:46:23.239102 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.239043    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:46:23.357072 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357037    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-data\") pod \"63eddb5e-3624-4563-a1da-1272d8226ba3\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") "
Sep 08 16:46:23.357264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357088    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-envoy\") pod \"63eddb5e-3624-4563-a1da-1272d8226ba3\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") "
Sep 08 16:46:23.357264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357123    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-credential-socket\") pod \"63eddb5e-3624-4563-a1da-1272d8226ba3\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") "
Sep 08 16:46:23.357264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357142    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-workload-certs\") pod \"63eddb5e-3624-4563-a1da-1272d8226ba3\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") "
Sep 08 16:46:23.357264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357183    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63eddb5e-3624-4563-a1da-1272d8226ba3-istiod-ca-cert\") pod \"63eddb5e-3624-4563-a1da-1272d8226ba3\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") "
Sep 08 16:46:23.357264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357205    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xtvf\" (UniqueName: \"kubernetes.io/projected/63eddb5e-3624-4563-a1da-1272d8226ba3-kube-api-access-8xtvf\") pod \"63eddb5e-3624-4563-a1da-1272d8226ba3\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") "
Sep 08 16:46:23.357264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357228    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-podinfo\") pod \"63eddb5e-3624-4563-a1da-1272d8226ba3\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") "
Sep 08 16:46:23.357551 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357287    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-token\") pod \"63eddb5e-3624-4563-a1da-1272d8226ba3\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") "
Sep 08 16:46:23.357551 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357310    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-workload-socket\") pod \"63eddb5e-3624-4563-a1da-1272d8226ba3\" (UID: \"63eddb5e-3624-4563-a1da-1272d8226ba3\") "
Sep 08 16:46:23.357551 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357332    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-data" (OuterVolumeSpecName: "istio-data") pod "63eddb5e-3624-4563-a1da-1272d8226ba3" (UID: "63eddb5e-3624-4563-a1da-1272d8226ba3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:23.357551 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357467    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63eddb5e-3624-4563-a1da-1272d8226ba3" (UID: "63eddb5e-3624-4563-a1da-1272d8226ba3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:23.357780 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357701    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63eddb5e-3624-4563-a1da-1272d8226ba3" (UID: "63eddb5e-3624-4563-a1da-1272d8226ba3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:23.357842 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357827    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:23.357896 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357852    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:23.357896 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357867    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:23.357896 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.357882    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63eddb5e-3624-4563-a1da-1272d8226ba3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63eddb5e-3624-4563-a1da-1272d8226ba3" (UID: "63eddb5e-3624-4563-a1da-1272d8226ba3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:46:23.358058 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.358037    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63eddb5e-3624-4563-a1da-1272d8226ba3" (UID: "63eddb5e-3624-4563-a1da-1272d8226ba3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:23.359475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.359448    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63eddb5e-3624-4563-a1da-1272d8226ba3" (UID: "63eddb5e-3624-4563-a1da-1272d8226ba3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:23.359619 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.359456    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-token" (OuterVolumeSpecName: "istio-token") pod "63eddb5e-3624-4563-a1da-1272d8226ba3" (UID: "63eddb5e-3624-4563-a1da-1272d8226ba3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:46:23.359739 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.359719    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63eddb5e-3624-4563-a1da-1272d8226ba3" (UID: "63eddb5e-3624-4563-a1da-1272d8226ba3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:46:23.359838 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.359822    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63eddb5e-3624-4563-a1da-1272d8226ba3-kube-api-access-8xtvf" (OuterVolumeSpecName: "kube-api-access-8xtvf") pod "63eddb5e-3624-4563-a1da-1272d8226ba3" (UID: "63eddb5e-3624-4563-a1da-1272d8226ba3"). InnerVolumeSpecName "kube-api-access-8xtvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:46:23.458781 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.458754    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63eddb5e-3624-4563-a1da-1272d8226ba3-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:23.458781 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.458778    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xtvf\" (UniqueName: \"kubernetes.io/projected/63eddb5e-3624-4563-a1da-1272d8226ba3-kube-api-access-8xtvf\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:23.458938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.458788    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:23.458938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.458798    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:23.458938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.458805    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:23.458938 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.458812    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63eddb5e-3624-4563-a1da-1272d8226ba3-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:23.840472 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.840436    2562 generic.go:356] "Generic (PLEG): container finished" podID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerID="3e310e317d77818565c50e65a5bd89ce23efecff13e91ee4c1d41cd5df8ab0f0" exitCode=0
Sep 08 16:46:23.840653 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.840482    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns" event={"ID":"63eddb5e-3624-4563-a1da-1272d8226ba3","Type":"ContainerDied","Data":"3e310e317d77818565c50e65a5bd89ce23efecff13e91ee4c1d41cd5df8ab0f0"}
Sep 08 16:46:23.840653 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.840547    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns" event={"ID":"63eddb5e-3624-4563-a1da-1272d8226ba3","Type":"ContainerDied","Data":"92da137b38749033a2a97e0fb8a38d6c760e244f32c71e4109751eaf73ce194d"}
Sep 08 16:46:23.840653 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.840569    2562 scope.go:117] "RemoveContainer" containerID="3e310e317d77818565c50e65a5bd89ce23efecff13e91ee4c1d41cd5df8ab0f0"
Sep 08 16:46:23.840653 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.840497    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"
Sep 08 16:46:23.851463 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.851444    2562 scope.go:117] "RemoveContainer" containerID="46e2b30a96874d5054ca6c4e5091b41a3aab68af9fd3b165ebba6e1da82fc1ee"
Sep 08 16:46:23.859972 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.859915    2562 scope.go:117] "RemoveContainer" containerID="3e310e317d77818565c50e65a5bd89ce23efecff13e91ee4c1d41cd5df8ab0f0"
Sep 08 16:46:23.860941 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:46:23.860918    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e310e317d77818565c50e65a5bd89ce23efecff13e91ee4c1d41cd5df8ab0f0\": container with ID starting with 3e310e317d77818565c50e65a5bd89ce23efecff13e91ee4c1d41cd5df8ab0f0 not found: ID does not exist" containerID="3e310e317d77818565c50e65a5bd89ce23efecff13e91ee4c1d41cd5df8ab0f0"
Sep 08 16:46:23.861024 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.860946    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e310e317d77818565c50e65a5bd89ce23efecff13e91ee4c1d41cd5df8ab0f0"} err="failed to get container status \"3e310e317d77818565c50e65a5bd89ce23efecff13e91ee4c1d41cd5df8ab0f0\": rpc error: code = NotFound desc = could not find container \"3e310e317d77818565c50e65a5bd89ce23efecff13e91ee4c1d41cd5df8ab0f0\": container with ID starting with 3e310e317d77818565c50e65a5bd89ce23efecff13e91ee4c1d41cd5df8ab0f0 not found: ID does not exist"
Sep 08 16:46:23.861024 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.860964    2562 scope.go:117] "RemoveContainer" containerID="46e2b30a96874d5054ca6c4e5091b41a3aab68af9fd3b165ebba6e1da82fc1ee"
Sep 08 16:46:23.861235 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:46:23.861217    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46e2b30a96874d5054ca6c4e5091b41a3aab68af9fd3b165ebba6e1da82fc1ee\": container with ID starting with 46e2b30a96874d5054ca6c4e5091b41a3aab68af9fd3b165ebba6e1da82fc1ee not found: ID does not exist" containerID="46e2b30a96874d5054ca6c4e5091b41a3aab68af9fd3b165ebba6e1da82fc1ee"
Sep 08 16:46:23.861315 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.861240    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46e2b30a96874d5054ca6c4e5091b41a3aab68af9fd3b165ebba6e1da82fc1ee"} err="failed to get container status \"46e2b30a96874d5054ca6c4e5091b41a3aab68af9fd3b165ebba6e1da82fc1ee\": rpc error: code = NotFound desc = could not find container \"46e2b30a96874d5054ca6c4e5091b41a3aab68af9fd3b165ebba6e1da82fc1ee\": container with ID starting with 46e2b30a96874d5054ca6c4e5091b41a3aab68af9fd3b165ebba6e1da82fc1ee not found: ID does not exist"
Sep 08 16:46:23.863253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.863232    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"]
Sep 08 16:46:23.868714 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:23.868693    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns"]
Sep 08 16:46:24.013402 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:24.013372    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63eddb5e-3624-4563-a1da-1272d8226ba3" path="/var/lib/kubelet/pods/63eddb5e-3624-4563-a1da-1272d8226ba3/volumes"
Sep 08 16:46:24.920574 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:24.920538    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:28.577252 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:28.577215    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:31.958063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:31.958028    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:34.211500 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:34.211466    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:34.283523 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:34.283487    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:34.406910 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:34.406867    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct"]
Sep 08 16:46:34.409212 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:34.409192    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2ae08-6psct"]
Sep 08 16:46:34.480176 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:34.480084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:34.545394 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:34.545361    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:35.038932 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:35.038896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:36.005823 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:36.005792    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55ac4717-1742-464b-b97b-3e85c0e851a0" path="/var/lib/kubelet/pods/55ac4717-1742-464b-b97b-3e85c0e851a0/volumes"
Sep 08 16:46:38.134599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:38.134566    2562 scope.go:117] "RemoveContainer" containerID="c562afaa6218bb58d152212085a87786a7d1b9aa0e8ff73d8e2821d000d44ab4"
Sep 08 16:46:38.950288 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:38.950255    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:46:40.507536 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:40.507495    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:40.573206 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:40.573171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:40.796132 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:40.796055    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"]
Sep 08 16:46:40.796308 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:40.796285    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy" containerID="cri-o://f262c395a8e1c7b1d7b5aad16be455db1825fe93782568ff380a0fd9c470eb4b" gracePeriod=30
Sep 08 16:46:41.012217 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.012176    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:41.247842 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.247812    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b"]
Sep 08 16:46:41.248168 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.248157    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55ac4717-1742-464b-b97b-3e85c0e851a0" containerName="revoke-keys"
Sep 08 16:46:41.248213 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.248170    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="55ac4717-1742-464b-b97b-3e85c0e851a0" containerName="revoke-keys"
Sep 08 16:46:41.248213 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.248184    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerName="istio-proxy"
Sep 08 16:46:41.248213 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.248190    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerName="istio-proxy"
Sep 08 16:46:41.248316 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.248257    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerName="istio-proxy"
Sep 08 16:46:41.248316 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.248264    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerName="istio-proxy"
Sep 08 16:46:41.248316 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.248270    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="55ac4717-1742-464b-b97b-3e85c0e851a0" containerName="revoke-keys"
Sep 08 16:46:41.251242 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.251227    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b"
Sep 08 16:46:41.253648 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.253598    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzslb\""
Sep 08 16:46:41.253648 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.253597    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:46:41.261934 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.261910    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b"]
Sep 08 16:46:41.345142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.345109    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c96a074-311a-436c-9f82-443263ac6399-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b\" (UID: \"8c96a074-311a-436c-9f82-443263ac6399\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b"
Sep 08 16:46:41.359995 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.359961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:41.375597 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.375564    2562 patch_prober.go:28] interesting pod/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 16:46:41.375730 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.375640    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 16:46:41.446489 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.446448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c96a074-311a-436c-9f82-443263ac6399-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b\" (UID: \"8c96a074-311a-436c-9f82-443263ac6399\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b"
Sep 08 16:46:41.447105 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.447086    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c96a074-311a-436c-9f82-443263ac6399-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b\" (UID: \"8c96a074-311a-436c-9f82-443263ac6399\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b"
Sep 08 16:46:41.562656 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.562564    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b"
Sep 08 16:46:41.843147 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.843076    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b"]
Sep 08 16:46:41.847163 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:46:41.847140    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c96a074_311a_436c_9f82_443263ac6399.slice/crio-3dab8be19048f68ce931fc10d9e8f3c104bccf1e59f34a482e8829cef832eb68 WatchSource:0}: Error finding container 3dab8be19048f68ce931fc10d9e8f3c104bccf1e59f34a482e8829cef832eb68: Status 404 returned error can't find the container with id 3dab8be19048f68ce931fc10d9e8f3c104bccf1e59f34a482e8829cef832eb68
Sep 08 16:46:41.949748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:41.949718    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b" event={"ID":"8c96a074-311a-436c-9f82-443263ac6399","Type":"ContainerStarted","Data":"3dab8be19048f68ce931fc10d9e8f3c104bccf1e59f34a482e8829cef832eb68"}
Sep 08 16:46:42.784956 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:42.784926    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"]
Sep 08 16:46:42.836039 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:42.836009    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:42.957183 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:42.957151    2562 generic.go:356] "Generic (PLEG): container finished" podID="8c96a074-311a-436c-9f82-443263ac6399" containerID="c598b332eaaf159ea5bc24e8a7f744086db1c12c61661ff03cc0545bdf9ab7e3" exitCode=0
Sep 08 16:46:42.957383 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:42.957245    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b" event={"ID":"8c96a074-311a-436c-9f82-443263ac6399","Type":"ContainerDied","Data":"c598b332eaaf159ea5bc24e8a7f744086db1c12c61661ff03cc0545bdf9ab7e3"}
Sep 08 16:46:43.830140 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:43.830105    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"]
Sep 08 16:46:44.032647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.032596    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:44.094682 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.094630    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b"
Sep 08 16:46:44.169089 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.169062    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c96a074-311a-436c-9f82-443263ac6399-maas-api-service-ca\") pod \"8c96a074-311a-436c-9f82-443263ac6399\" (UID: \"8c96a074-311a-436c-9f82-443263ac6399\") "
Sep 08 16:46:44.169388 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.169364    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c96a074-311a-436c-9f82-443263ac6399-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8c96a074-311a-436c-9f82-443263ac6399" (UID: "8c96a074-311a-436c-9f82-443263ac6399"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:46:44.269980 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.269949    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c96a074-311a-436c-9f82-443263ac6399-maas-api-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:44.327736 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.327708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:44.619067 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.619038    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"]
Sep 08 16:46:44.619407 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.619395    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c96a074-311a-436c-9f82-443263ac6399" containerName="revoke-keys"
Sep 08 16:46:44.619456 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.619408    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c96a074-311a-436c-9f82-443263ac6399" containerName="revoke-keys"
Sep 08 16:46:44.619456 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.619421    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerName="istio-proxy"
Sep 08 16:46:44.619456 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.619426    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63eddb5e-3624-4563-a1da-1272d8226ba3" containerName="istio-proxy"
Sep 08 16:46:44.619553 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.619489    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c96a074-311a-436c-9f82-443263ac6399" containerName="revoke-keys"
Sep 08 16:46:44.622270 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.622255    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.624754 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.624732    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-55a703-openshift-default-dockercfg-dz2k5\""
Sep 08 16:46:44.634224 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.634202    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"]
Sep 08 16:46:44.634852 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.634825    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:44.673176 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.673150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc154a47-8734-462f-844d-0a5e5679dc76-istio-podinfo\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.673300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.673191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grplg\" (UniqueName: \"kubernetes.io/projected/bc154a47-8734-462f-844d-0a5e5679dc76-kube-api-access-grplg\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.673300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.673224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-credential-socket\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.673300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.673247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc154a47-8734-462f-844d-0a5e5679dc76-istio-token\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.673300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.673270    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-istio-envoy\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.673300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.673284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-istio-data\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.673478 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.673355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-workload-certs\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.673478 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.673418    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc154a47-8734-462f-844d-0a5e5679dc76-istiod-ca-cert\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.673478 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.673444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-workload-socket\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.774557 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.774521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-credential-socket\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.774557 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.774559    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc154a47-8734-462f-844d-0a5e5679dc76-istio-token\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.774831 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.774582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-istio-envoy\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.774831 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.774598    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-istio-data\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.774831 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.774677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-workload-certs\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.774831 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.774764    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc154a47-8734-462f-844d-0a5e5679dc76-istiod-ca-cert\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.774831 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.774793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-workload-socket\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.774831 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.774823    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc154a47-8734-462f-844d-0a5e5679dc76-istio-podinfo\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.775158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.774868    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grplg\" (UniqueName: \"kubernetes.io/projected/bc154a47-8734-462f-844d-0a5e5679dc76-kube-api-access-grplg\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.775158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.774964    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-credential-socket\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.775558 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.775529    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc154a47-8734-462f-844d-0a5e5679dc76-istiod-ca-cert\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.775558 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.775549    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-istio-data\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.775801 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.775534    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-workload-certs\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.775801 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.775593    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-workload-socket\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.777050 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.777030    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-istio-envoy\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.777399 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.777382    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc154a47-8734-462f-844d-0a5e5679dc76-istio-podinfo\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.782711 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.782681    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc154a47-8734-462f-844d-0a5e5679dc76-istio-token\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.782936 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.782913    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grplg\" (UniqueName: \"kubernetes.io/projected/bc154a47-8734-462f-844d-0a5e5679dc76-kube-api-access-grplg\") pod \"e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") " pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.935286 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.935218    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:44.972591 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.972558    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b"
Sep 08 16:46:44.972774 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.972603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b" event={"ID":"8c96a074-311a-436c-9f82-443263ac6399","Type":"ContainerDied","Data":"3dab8be19048f68ce931fc10d9e8f3c104bccf1e59f34a482e8829cef832eb68"}
Sep 08 16:46:44.972774 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:44.972694    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3dab8be19048f68ce931fc10d9e8f3c104bccf1e59f34a482e8829cef832eb68"
Sep 08 16:46:45.060760 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:45.060729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:45.219448 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:45.219418    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"]
Sep 08 16:46:45.221259 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:46:45.221238    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc154a47_8734_462f_844d_0a5e5679dc76.slice/crio-a0319d14e944d3991f76927fe57f22077704ad1cdc76ce20d9b52386224fb814 WatchSource:0}: Error finding container a0319d14e944d3991f76927fe57f22077704ad1cdc76ce20d9b52386224fb814: Status 404 returned error can't find the container with id a0319d14e944d3991f76927fe57f22077704ad1cdc76ce20d9b52386224fb814
Sep 08 16:46:45.224199 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:45.224159    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:46:45.224269 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:45.224255    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:46:45.224325 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:45.224307    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:46:45.980676 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:45.980643    2562 generic.go:356] "Generic (PLEG): container finished" podID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerID="f262c395a8e1c7b1d7b5aad16be455db1825fe93782568ff380a0fd9c470eb4b" exitCode=0
Sep 08 16:46:45.981053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:45.980730    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" event={"ID":"296e3e27-7196-4a56-9c0f-0435f9d5edf3","Type":"ContainerDied","Data":"f262c395a8e1c7b1d7b5aad16be455db1825fe93782568ff380a0fd9c470eb4b"}
Sep 08 16:46:45.981053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:45.980803    2562 scope.go:117] "RemoveContainer" containerID="4918371022f3e1ce6795e7bcf039a1e976564d77264809e95e1c8ad6788916ba"
Sep 08 16:46:45.983745 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:45.983718    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8" event={"ID":"bc154a47-8734-462f-844d-0a5e5679dc76","Type":"ContainerStarted","Data":"39b700f2ac2c7c4762ed62835736803d544762f390e6a0170ff736b10be078f7"}
Sep 08 16:46:45.983889 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:45.983770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8" event={"ID":"bc154a47-8734-462f-844d-0a5e5679dc76","Type":"ContainerStarted","Data":"a0319d14e944d3991f76927fe57f22077704ad1cdc76ce20d9b52386224fb814"}
Sep 08 16:46:46.007275 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.007222    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8" podStartSLOduration=2.007198321 podStartE2EDuration="2.007198321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:46:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:46:46.004681124 +0000 UTC m=+1448.589242745" watchObservedRunningTime="2026-09-08 16:46:46.007198321 +0000 UTC m=+1448.591759943"
Sep 08 16:46:46.049189 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.049169    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:46:46.088694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.088639    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-credential-socket\") pod \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") "
Sep 08 16:46:46.088694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.088673    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-envoy\") pod \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") "
Sep 08 16:46:46.088694 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.088692    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-workload-socket\") pod \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") "
Sep 08 16:46:46.088941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.088714    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-data\") pod \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") "
Sep 08 16:46:46.088941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.088737    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-token\") pod \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") "
Sep 08 16:46:46.088941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.088765    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istiod-ca-cert\") pod \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") "
Sep 08 16:46:46.088941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.088841    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6mp5\" (UniqueName: \"kubernetes.io/projected/296e3e27-7196-4a56-9c0f-0435f9d5edf3-kube-api-access-b6mp5\") pod \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") "
Sep 08 16:46:46.088941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.088913    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-podinfo\") pod \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") "
Sep 08 16:46:46.089210 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.088950    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "296e3e27-7196-4a56-9c0f-0435f9d5edf3" (UID: "296e3e27-7196-4a56-9c0f-0435f9d5edf3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:46.089210 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.088971    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-workload-certs\") pod \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\" (UID: \"296e3e27-7196-4a56-9c0f-0435f9d5edf3\") "
Sep 08 16:46:46.089210 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.088985    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-data" (OuterVolumeSpecName: "istio-data") pod "296e3e27-7196-4a56-9c0f-0435f9d5edf3" (UID: "296e3e27-7196-4a56-9c0f-0435f9d5edf3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:46.089364 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.089297    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "296e3e27-7196-4a56-9c0f-0435f9d5edf3" (UID: "296e3e27-7196-4a56-9c0f-0435f9d5edf3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:46.089419 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.089403    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:46.089478 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.089422    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:46.089478 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.089438    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:46.089776 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.089233    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "296e3e27-7196-4a56-9c0f-0435f9d5edf3" (UID: "296e3e27-7196-4a56-9c0f-0435f9d5edf3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:46:46.089776 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.089718    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "296e3e27-7196-4a56-9c0f-0435f9d5edf3" (UID: "296e3e27-7196-4a56-9c0f-0435f9d5edf3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:46.091375 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.091342    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "296e3e27-7196-4a56-9c0f-0435f9d5edf3" (UID: "296e3e27-7196-4a56-9c0f-0435f9d5edf3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:46.091491 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.091470    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "296e3e27-7196-4a56-9c0f-0435f9d5edf3" (UID: "296e3e27-7196-4a56-9c0f-0435f9d5edf3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:46:46.091555 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.091488    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/296e3e27-7196-4a56-9c0f-0435f9d5edf3-kube-api-access-b6mp5" (OuterVolumeSpecName: "kube-api-access-b6mp5") pod "296e3e27-7196-4a56-9c0f-0435f9d5edf3" (UID: "296e3e27-7196-4a56-9c0f-0435f9d5edf3"). InnerVolumeSpecName "kube-api-access-b6mp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:46:46.091555 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.091496    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-token" (OuterVolumeSpecName: "istio-token") pod "296e3e27-7196-4a56-9c0f-0435f9d5edf3" (UID: "296e3e27-7196-4a56-9c0f-0435f9d5edf3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:46:46.190304 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.190263    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6mp5\" (UniqueName: \"kubernetes.io/projected/296e3e27-7196-4a56-9c0f-0435f9d5edf3-kube-api-access-b6mp5\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:46.190304 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.190303    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:46.190490 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.190317    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:46.190490 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.190329    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:46.190490 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.190340    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:46.190490 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.190353    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/296e3e27-7196-4a56-9c0f-0435f9d5edf3-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:46.935780 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.935749    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:46.940709 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.940688    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:46.991176 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.991148    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"
Sep 08 16:46:46.991563 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.991187    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97" event={"ID":"296e3e27-7196-4a56-9c0f-0435f9d5edf3","Type":"ContainerDied","Data":"e8b02885478ab631888d96feb0382042a011cff61f095e1ea5f026f346271942"}
Sep 08 16:46:46.991563 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.991246    2562 scope.go:117] "RemoveContainer" containerID="f262c395a8e1c7b1d7b5aad16be455db1825fe93782568ff380a0fd9c470eb4b"
Sep 08 16:46:46.991845 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.991827    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:46.992823 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:46.992419    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:46:47.059798 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:47.059767    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"]
Sep 08 16:46:47.065428 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:47.065402    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97"]
Sep 08 16:46:47.984701 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:47.984666    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:48.007390 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:48.007356    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" path="/var/lib/kubelet/pods/296e3e27-7196-4a56-9c0f-0435f9d5edf3/volumes"
Sep 08 16:46:48.082290 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:48.082255    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:49.132272 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:49.132235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:49.233701 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:49.233669    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:49.440461 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:49.440423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:49.747552 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:49.747474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:49.847732 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:49.847692    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:50.503594 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:50.503561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:51.109108 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:51.109066    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:51.712777 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:51.712742    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:51.924264 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:51.924231    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:51.967647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:51.967562    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b"]
Sep 08 16:46:51.971820 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:51.971793    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5a3b57-6lr8b"]
Sep 08 16:46:52.006458 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:52.006434    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c96a074-311a-436c-9f82-443263ac6399" path="/var/lib/kubelet/pods/8c96a074-311a-436c-9f82-443263ac6399/volumes"
Sep 08 16:46:52.319102 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:52.319015    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:52.420342 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:52.420302    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:57.365478 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:57.365442    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:46:57.805567 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:57.805524    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh" podUID="c4843c8a-6633-4c32-9f75-58cad16b32aa" containerName="main" containerID="cri-o://cfef1d116b02845d9524065f4870f853ad3f185d3d966037ef6252a962c8d2cb" gracePeriod=45
Sep 08 16:46:58.059277 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.059210    2562 generic.go:356] "Generic (PLEG): container finished" podID="c4843c8a-6633-4c32-9f75-58cad16b32aa" containerID="cfef1d116b02845d9524065f4870f853ad3f185d3d966037ef6252a962c8d2cb" exitCode=0
Sep 08 16:46:58.059394 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.059281    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh" event={"ID":"c4843c8a-6633-4c32-9f75-58cad16b32aa","Type":"ContainerDied","Data":"cfef1d116b02845d9524065f4870f853ad3f185d3d966037ef6252a962c8d2cb"}
Sep 08 16:46:58.059394 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.059319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh" event={"ID":"c4843c8a-6633-4c32-9f75-58cad16b32aa","Type":"ContainerDied","Data":"1e67421fbb704c3812a8aaf504df3fe01e8ae1da8d5b953260c7cfec49f6c996"}
Sep 08 16:46:58.059394 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.059331    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e67421fbb704c3812a8aaf504df3fe01e8ae1da8d5b953260c7cfec49f6c996"
Sep 08 16:46:58.063245 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.063227    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:46:58.211435 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.211397    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-dshm\") pod \"c4843c8a-6633-4c32-9f75-58cad16b32aa\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") "
Sep 08 16:46:58.211435 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.211436    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-home\") pod \"c4843c8a-6633-4c32-9f75-58cad16b32aa\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") "
Sep 08 16:46:58.211678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.211500    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-tmp-dir\") pod \"c4843c8a-6633-4c32-9f75-58cad16b32aa\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") "
Sep 08 16:46:58.211678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.211519    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-model-cache\") pod \"c4843c8a-6633-4c32-9f75-58cad16b32aa\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") "
Sep 08 16:46:58.211678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.211547    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4843c8a-6633-4c32-9f75-58cad16b32aa-tls-certs\") pod \"c4843c8a-6633-4c32-9f75-58cad16b32aa\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") "
Sep 08 16:46:58.211678 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.211600    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdm2n\" (UniqueName: \"kubernetes.io/projected/c4843c8a-6633-4c32-9f75-58cad16b32aa-kube-api-access-cdm2n\") pod \"c4843c8a-6633-4c32-9f75-58cad16b32aa\" (UID: \"c4843c8a-6633-4c32-9f75-58cad16b32aa\") "
Sep 08 16:46:58.211899 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.211782    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-home" (OuterVolumeSpecName: "home") pod "c4843c8a-6633-4c32-9f75-58cad16b32aa" (UID: "c4843c8a-6633-4c32-9f75-58cad16b32aa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:58.211899 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.211795    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c4843c8a-6633-4c32-9f75-58cad16b32aa" (UID: "c4843c8a-6633-4c32-9f75-58cad16b32aa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:58.211899 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.211806    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-model-cache" (OuterVolumeSpecName: "model-cache") pod "c4843c8a-6633-4c32-9f75-58cad16b32aa" (UID: "c4843c8a-6633-4c32-9f75-58cad16b32aa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:58.212053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.211993    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:58.212053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.212014    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:58.212053 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.212029    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:58.213857 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.213826    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4843c8a-6633-4c32-9f75-58cad16b32aa-kube-api-access-cdm2n" (OuterVolumeSpecName: "kube-api-access-cdm2n") pod "c4843c8a-6633-4c32-9f75-58cad16b32aa" (UID: "c4843c8a-6633-4c32-9f75-58cad16b32aa"). InnerVolumeSpecName "kube-api-access-cdm2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:46:58.214056 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.214037    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-dshm" (OuterVolumeSpecName: "dshm") pod "c4843c8a-6633-4c32-9f75-58cad16b32aa" (UID: "c4843c8a-6633-4c32-9f75-58cad16b32aa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:58.214125 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.214073    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4843c8a-6633-4c32-9f75-58cad16b32aa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c4843c8a-6633-4c32-9f75-58cad16b32aa" (UID: "c4843c8a-6633-4c32-9f75-58cad16b32aa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:46:58.313135 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.313049    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdm2n\" (UniqueName: \"kubernetes.io/projected/c4843c8a-6633-4c32-9f75-58cad16b32aa-kube-api-access-cdm2n\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:58.313135 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.313079    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4843c8a-6633-4c32-9f75-58cad16b32aa-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:58.313135 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.313089    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4843c8a-6633-4c32-9f75-58cad16b32aa-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:58.740162 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.740116    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:58.841751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.841715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:58.849883 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:58.849849    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm" podUID="15da9566-2438-4973-a927-79d2fbd3b017" containerName="main" containerID="cri-o://ba2b33629eba65f8d3903af72984f1d6c754abf663a72f8f05804210ca0ee343" gracePeriod=45
Sep 08 16:46:59.001893 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.001788    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"]
Sep 08 16:46:59.002105 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.002033    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" containerName="istio-proxy" containerID="cri-o://b6aae7cec50fe87cbed9c10fd558fd2b08822d5fe013051bdd2f256f68c56b90" gracePeriod=30
Sep 08 16:46:59.049951 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.049529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:59.068809 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.068759    2562 generic.go:356] "Generic (PLEG): container finished" podID="15da9566-2438-4973-a927-79d2fbd3b017" containerID="ba2b33629eba65f8d3903af72984f1d6c754abf663a72f8f05804210ca0ee343" exitCode=0
Sep 08 16:46:59.068973 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.068833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm" event={"ID":"15da9566-2438-4973-a927-79d2fbd3b017","Type":"ContainerDied","Data":"ba2b33629eba65f8d3903af72984f1d6c754abf663a72f8f05804210ca0ee343"}
Sep 08 16:46:59.068973 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.068940    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"
Sep 08 16:46:59.102509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.102475    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"]
Sep 08 16:46:59.102766 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.102741    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-a4942b/rate-test-model-a4942b-kserve-68f8f596c9-nc4bh"]
Sep 08 16:46:59.158912 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.158881    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:46:59.341884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.339922    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15da9566-2438-4973-a927-79d2fbd3b017-tls-certs\") pod \"15da9566-2438-4973-a927-79d2fbd3b017\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") "
Sep 08 16:46:59.341884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.340007    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-tmp-dir\") pod \"15da9566-2438-4973-a927-79d2fbd3b017\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") "
Sep 08 16:46:59.341884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.340053    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-dshm\") pod \"15da9566-2438-4973-a927-79d2fbd3b017\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") "
Sep 08 16:46:59.341884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.340091    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpzp6\" (UniqueName: \"kubernetes.io/projected/15da9566-2438-4973-a927-79d2fbd3b017-kube-api-access-qpzp6\") pod \"15da9566-2438-4973-a927-79d2fbd3b017\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") "
Sep 08 16:46:59.341884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.340136    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-home\") pod \"15da9566-2438-4973-a927-79d2fbd3b017\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") "
Sep 08 16:46:59.341884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.340166    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-model-cache\") pod \"15da9566-2438-4973-a927-79d2fbd3b017\" (UID: \"15da9566-2438-4973-a927-79d2fbd3b017\") "
Sep 08 16:46:59.341884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.340823    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-model-cache" (OuterVolumeSpecName: "model-cache") pod "15da9566-2438-4973-a927-79d2fbd3b017" (UID: "15da9566-2438-4973-a927-79d2fbd3b017"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:59.341884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.341085    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-home" (OuterVolumeSpecName: "home") pod "15da9566-2438-4973-a927-79d2fbd3b017" (UID: "15da9566-2438-4973-a927-79d2fbd3b017"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:59.341884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.341868    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "15da9566-2438-4973-a927-79d2fbd3b017" (UID: "15da9566-2438-4973-a927-79d2fbd3b017"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:59.349011 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.348978    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-dshm" (OuterVolumeSpecName: "dshm") pod "15da9566-2438-4973-a927-79d2fbd3b017" (UID: "15da9566-2438-4973-a927-79d2fbd3b017"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:59.349011 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.348986    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15da9566-2438-4973-a927-79d2fbd3b017-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "15da9566-2438-4973-a927-79d2fbd3b017" (UID: "15da9566-2438-4973-a927-79d2fbd3b017"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:46:59.349187 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.349045    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15da9566-2438-4973-a927-79d2fbd3b017-kube-api-access-qpzp6" (OuterVolumeSpecName: "kube-api-access-qpzp6") pod "15da9566-2438-4973-a927-79d2fbd3b017" (UID: "15da9566-2438-4973-a927-79d2fbd3b017"). InnerVolumeSpecName "kube-api-access-qpzp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:46:59.355303 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.355276    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r"]
Sep 08 16:46:59.355687 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.355674    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy"
Sep 08 16:46:59.355748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.355689    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy"
Sep 08 16:46:59.355748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.355697    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15da9566-2438-4973-a927-79d2fbd3b017" containerName="main"
Sep 08 16:46:59.355748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.355703    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="15da9566-2438-4973-a927-79d2fbd3b017" containerName="main"
Sep 08 16:46:59.355748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.355718    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy"
Sep 08 16:46:59.355748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.355724    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy"
Sep 08 16:46:59.355748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.355731    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4843c8a-6633-4c32-9f75-58cad16b32aa" containerName="main"
Sep 08 16:46:59.355748 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.355736    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4843c8a-6633-4c32-9f75-58cad16b32aa" containerName="main"
Sep 08 16:46:59.355992 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.355788    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="15da9566-2438-4973-a927-79d2fbd3b017" containerName="main"
Sep 08 16:46:59.355992 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.355797    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy"
Sep 08 16:46:59.355992 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.355810    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4843c8a-6633-4c32-9f75-58cad16b32aa" containerName="main"
Sep 08 16:46:59.359309 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.359294    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r"
Sep 08 16:46:59.361767 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.361748    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:46:59.361836 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.361801    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzslb\""
Sep 08 16:46:59.365743 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.365724    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r"]
Sep 08 16:46:59.444208 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.444170    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:59.444208 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.444207    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpzp6\" (UniqueName: \"kubernetes.io/projected/15da9566-2438-4973-a927-79d2fbd3b017-kube-api-access-qpzp6\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:59.444489 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.444223    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:59.444489 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.444236    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:59.444489 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.444249    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15da9566-2438-4973-a927-79d2fbd3b017-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:59.444489 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.444295    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15da9566-2438-4973-a927-79d2fbd3b017-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:46:59.490887 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.490850    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:59.545704 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.545654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a7592bd-879b-45be-89e2-289cc8535222-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r\" (UID: \"3a7592bd-879b-45be-89e2-289cc8535222\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r"
Sep 08 16:46:59.647305 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.647217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a7592bd-879b-45be-89e2-289cc8535222-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r\" (UID: \"3a7592bd-879b-45be-89e2-289cc8535222\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r"
Sep 08 16:46:59.647878 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.647859    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a7592bd-879b-45be-89e2-289cc8535222-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r\" (UID: \"3a7592bd-879b-45be-89e2-289cc8535222\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r"
Sep 08 16:46:59.671713 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.671687    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r"
Sep 08 16:46:59.955507 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:46:59.955480    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r"]
Sep 08 16:46:59.956270 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:46:59.956238    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7592bd_879b_45be_89e2_289cc8535222.slice/crio-9c7152d23a3b1a551d34f502ce1b18b6b8854b2f0284aaa9f0066783c8e94767 WatchSource:0}: Error finding container 9c7152d23a3b1a551d34f502ce1b18b6b8854b2f0284aaa9f0066783c8e94767: Status 404 returned error can't find the container with id 9c7152d23a3b1a551d34f502ce1b18b6b8854b2f0284aaa9f0066783c8e94767
Sep 08 16:47:00.006286 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:00.006261    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4843c8a-6633-4c32-9f75-58cad16b32aa" path="/var/lib/kubelet/pods/c4843c8a-6633-4c32-9f75-58cad16b32aa/volumes"
Sep 08 16:47:00.075758 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:00.075730    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"
Sep 08 16:47:00.075955 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:00.075769    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm" event={"ID":"15da9566-2438-4973-a927-79d2fbd3b017","Type":"ContainerDied","Data":"319d71c2df78579927b01777216e5eced6ae28306bb6a6c457e25871c39c4c5c"}
Sep 08 16:47:00.075955 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:00.075827    2562 scope.go:117] "RemoveContainer" containerID="ba2b33629eba65f8d3903af72984f1d6c754abf663a72f8f05804210ca0ee343"
Sep 08 16:47:00.077206 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:00.077185    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r" event={"ID":"3a7592bd-879b-45be-89e2-289cc8535222","Type":"ContainerStarted","Data":"9c7152d23a3b1a551d34f502ce1b18b6b8854b2f0284aaa9f0066783c8e94767"}
Sep 08 16:47:00.091787 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:00.091760    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"]
Sep 08 16:47:00.096388 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:00.096366    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-823397/rate-test-model-823397-kserve-67587b7b6c-w6tzm"]
Sep 08 16:47:01.085235 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:01.085202    2562 generic.go:356] "Generic (PLEG): container finished" podID="3a7592bd-879b-45be-89e2-289cc8535222" containerID="3b8d718bebeb53266fe96a77b4230812e55d9d356e06dd8e838ed742ac612251" exitCode=0
Sep 08 16:47:01.085578 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:01.085290    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r" event={"ID":"3a7592bd-879b-45be-89e2-289cc8535222","Type":"ContainerDied","Data":"3b8d718bebeb53266fe96a77b4230812e55d9d356e06dd8e838ed742ac612251"}
Sep 08 16:47:02.006232 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:02.006198    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15da9566-2438-4973-a927-79d2fbd3b017" path="/var/lib/kubelet/pods/15da9566-2438-4973-a927-79d2fbd3b017/volumes"
Sep 08 16:47:02.267311 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:02.267291    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r"
Sep 08 16:47:02.275045 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:02.275025    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a7592bd-879b-45be-89e2-289cc8535222-maas-api-service-ca\") pod \"3a7592bd-879b-45be-89e2-289cc8535222\" (UID: \"3a7592bd-879b-45be-89e2-289cc8535222\") "
Sep 08 16:47:02.275361 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:02.275340    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a7592bd-879b-45be-89e2-289cc8535222-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3a7592bd-879b-45be-89e2-289cc8535222" (UID: "3a7592bd-879b-45be-89e2-289cc8535222"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:47:02.376388 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:02.376353    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a7592bd-879b-45be-89e2-289cc8535222-maas-api-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:03.097717 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:03.097690    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r"
Sep 08 16:47:03.097717 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:03.097711    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r" event={"ID":"3a7592bd-879b-45be-89e2-289cc8535222","Type":"ContainerDied","Data":"9c7152d23a3b1a551d34f502ce1b18b6b8854b2f0284aaa9f0066783c8e94767"}
Sep 08 16:47:03.097915 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:03.097757    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c7152d23a3b1a551d34f502ce1b18b6b8854b2f0284aaa9f0066783c8e94767"
Sep 08 16:47:04.276771 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.276714    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:47:04.293373 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.293344    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a624588-6e7a-470e-9fb0-560dd334d301-istio-podinfo\") pod \"7a624588-6e7a-470e-9fb0-560dd334d301\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") "
Sep 08 16:47:04.293506 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.293401    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-workload-certs\") pod \"7a624588-6e7a-470e-9fb0-560dd334d301\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") "
Sep 08 16:47:04.293506 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.293425    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-istio-data\") pod \"7a624588-6e7a-470e-9fb0-560dd334d301\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") "
Sep 08 16:47:04.293506 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.293452    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a624588-6e7a-470e-9fb0-560dd334d301-istiod-ca-cert\") pod \"7a624588-6e7a-470e-9fb0-560dd334d301\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") "
Sep 08 16:47:04.293708 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.293516    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-istio-envoy\") pod \"7a624588-6e7a-470e-9fb0-560dd334d301\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") "
Sep 08 16:47:04.293708 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.293533    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a624588-6e7a-470e-9fb0-560dd334d301-istio-token\") pod \"7a624588-6e7a-470e-9fb0-560dd334d301\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") "
Sep 08 16:47:04.293708 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.293559    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-workload-socket\") pod \"7a624588-6e7a-470e-9fb0-560dd334d301\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") "
Sep 08 16:47:04.293708 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.293588    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-credential-socket\") pod \"7a624588-6e7a-470e-9fb0-560dd334d301\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") "
Sep 08 16:47:04.293904 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.293721    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6nwm\" (UniqueName: \"kubernetes.io/projected/7a624588-6e7a-470e-9fb0-560dd334d301-kube-api-access-n6nwm\") pod \"7a624588-6e7a-470e-9fb0-560dd334d301\" (UID: \"7a624588-6e7a-470e-9fb0-560dd334d301\") "
Sep 08 16:47:04.293904 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.293750    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a624588-6e7a-470e-9fb0-560dd334d301" (UID: "7a624588-6e7a-470e-9fb0-560dd334d301"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:04.293904 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.293763    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a624588-6e7a-470e-9fb0-560dd334d301" (UID: "7a624588-6e7a-470e-9fb0-560dd334d301"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:04.294064 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.293910    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a624588-6e7a-470e-9fb0-560dd334d301" (UID: "7a624588-6e7a-470e-9fb0-560dd334d301"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:04.294064 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.293988    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a624588-6e7a-470e-9fb0-560dd334d301" (UID: "7a624588-6e7a-470e-9fb0-560dd334d301"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:04.294064 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.294051    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a624588-6e7a-470e-9fb0-560dd334d301-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a624588-6e7a-470e-9fb0-560dd334d301" (UID: "7a624588-6e7a-470e-9fb0-560dd334d301"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:47:04.294204 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.294069    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:04.294204 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.294086    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:04.294204 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.294100    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:04.294204 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.294113    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:04.295570 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.295538    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a624588-6e7a-470e-9fb0-560dd334d301-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a624588-6e7a-470e-9fb0-560dd334d301" (UID: "7a624588-6e7a-470e-9fb0-560dd334d301"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:47:04.295724 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.295696    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a624588-6e7a-470e-9fb0-560dd334d301-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a624588-6e7a-470e-9fb0-560dd334d301" (UID: "7a624588-6e7a-470e-9fb0-560dd334d301"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:47:04.296184 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.296164    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a624588-6e7a-470e-9fb0-560dd334d301" (UID: "7a624588-6e7a-470e-9fb0-560dd334d301"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:04.296184 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.296170    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a624588-6e7a-470e-9fb0-560dd334d301-kube-api-access-n6nwm" (OuterVolumeSpecName: "kube-api-access-n6nwm") pod "7a624588-6e7a-470e-9fb0-560dd334d301" (UID: "7a624588-6e7a-470e-9fb0-560dd334d301"). InnerVolumeSpecName "kube-api-access-n6nwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:47:04.394977 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.394951    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a624588-6e7a-470e-9fb0-560dd334d301-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:04.394977 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.394974    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a624588-6e7a-470e-9fb0-560dd334d301-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:04.394977 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.394983    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6nwm\" (UniqueName: \"kubernetes.io/projected/7a624588-6e7a-470e-9fb0-560dd334d301-kube-api-access-n6nwm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:04.395158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.394991    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a624588-6e7a-470e-9fb0-560dd334d301-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:04.395158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:04.395001    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a624588-6e7a-470e-9fb0-560dd334d301-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:05.115916 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:05.115883    2562 generic.go:356] "Generic (PLEG): container finished" podID="7a624588-6e7a-470e-9fb0-560dd334d301" containerID="b6aae7cec50fe87cbed9c10fd558fd2b08822d5fe013051bdd2f256f68c56b90" exitCode=0
Sep 08 16:47:05.116099 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:05.115933    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"
Sep 08 16:47:05.116099 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:05.115941    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" event={"ID":"7a624588-6e7a-470e-9fb0-560dd334d301","Type":"ContainerDied","Data":"b6aae7cec50fe87cbed9c10fd558fd2b08822d5fe013051bdd2f256f68c56b90"}
Sep 08 16:47:05.116099 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:05.115982    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr" event={"ID":"7a624588-6e7a-470e-9fb0-560dd334d301","Type":"ContainerDied","Data":"bc5452c76eb500ea9f425efc907cab6559602f4bc6d9f1249894daac357a3920"}
Sep 08 16:47:05.116099 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:05.116004    2562 scope.go:117] "RemoveContainer" containerID="b6aae7cec50fe87cbed9c10fd558fd2b08822d5fe013051bdd2f256f68c56b90"
Sep 08 16:47:05.126233 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:05.126068    2562 scope.go:117] "RemoveContainer" containerID="3899a83b213c5fba75171efca27e9e7185229b83fafb5b0ce408b721611a6436"
Sep 08 16:47:05.134443 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:05.134424    2562 scope.go:117] "RemoveContainer" containerID="b6aae7cec50fe87cbed9c10fd558fd2b08822d5fe013051bdd2f256f68c56b90"
Sep 08 16:47:05.134748 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:47:05.134728    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6aae7cec50fe87cbed9c10fd558fd2b08822d5fe013051bdd2f256f68c56b90\": container with ID starting with b6aae7cec50fe87cbed9c10fd558fd2b08822d5fe013051bdd2f256f68c56b90 not found: ID does not exist" containerID="b6aae7cec50fe87cbed9c10fd558fd2b08822d5fe013051bdd2f256f68c56b90"
Sep 08 16:47:05.134847 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:05.134763    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6aae7cec50fe87cbed9c10fd558fd2b08822d5fe013051bdd2f256f68c56b90"} err="failed to get container status \"b6aae7cec50fe87cbed9c10fd558fd2b08822d5fe013051bdd2f256f68c56b90\": rpc error: code = NotFound desc = could not find container \"b6aae7cec50fe87cbed9c10fd558fd2b08822d5fe013051bdd2f256f68c56b90\": container with ID starting with b6aae7cec50fe87cbed9c10fd558fd2b08822d5fe013051bdd2f256f68c56b90 not found: ID does not exist"
Sep 08 16:47:05.134847 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:05.134787    2562 scope.go:117] "RemoveContainer" containerID="3899a83b213c5fba75171efca27e9e7185229b83fafb5b0ce408b721611a6436"
Sep 08 16:47:05.135069 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:47:05.135051    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3899a83b213c5fba75171efca27e9e7185229b83fafb5b0ce408b721611a6436\": container with ID starting with 3899a83b213c5fba75171efca27e9e7185229b83fafb5b0ce408b721611a6436 not found: ID does not exist" containerID="3899a83b213c5fba75171efca27e9e7185229b83fafb5b0ce408b721611a6436"
Sep 08 16:47:05.135115 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:05.135075    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3899a83b213c5fba75171efca27e9e7185229b83fafb5b0ce408b721611a6436"} err="failed to get container status \"3899a83b213c5fba75171efca27e9e7185229b83fafb5b0ce408b721611a6436\": rpc error: code = NotFound desc = could not find container \"3899a83b213c5fba75171efca27e9e7185229b83fafb5b0ce408b721611a6436\": container with ID starting with 3899a83b213c5fba75171efca27e9e7185229b83fafb5b0ce408b721611a6436 not found: ID does not exist"
Sep 08 16:47:05.143530 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:05.143502    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"]
Sep 08 16:47:05.146718 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:05.146697    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr"]
Sep 08 16:47:06.006917 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:06.006880    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" path="/var/lib/kubelet/pods/7a624588-6e7a-470e-9fb0-560dd334d301/volumes"
Sep 08 16:47:08.135337 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:08.135307    2562 generic.go:356] "Generic (PLEG): container finished" podID="bc154a47-8734-462f-844d-0a5e5679dc76" containerID="39b700f2ac2c7c4762ed62835736803d544762f390e6a0170ff736b10be078f7" exitCode=0
Sep 08 16:47:08.135780 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:08.135385    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8" event={"ID":"bc154a47-8734-462f-844d-0a5e5679dc76","Type":"ContainerDied","Data":"39b700f2ac2c7c4762ed62835736803d544762f390e6a0170ff736b10be078f7"}
Sep 08 16:47:08.135780 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:08.135751    2562 scope.go:117] "RemoveContainer" containerID="39b700f2ac2c7c4762ed62835736803d544762f390e6a0170ff736b10be078f7"
Sep 08 16:47:08.136727 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:08.136704    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:47:08.136780 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:08.136765    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:47:08.136816 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:08.136803    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:47:09.147597 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:09.147561    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8" event={"ID":"bc154a47-8734-462f-844d-0a5e5679dc76","Type":"ContainerStarted","Data":"b0ed1f39fc191f642f61e65a11151ec6c28b205376ec54773dc95c92d735a3bb"}
Sep 08 16:47:09.936383 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:09.936349    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:47:09.936728 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:09.936705    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 08 16:47:09.936891 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:09.936868    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8" podUID="bc154a47-8734-462f-844d-0a5e5679dc76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 08 16:47:10.061638 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:10.061591    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r"]
Sep 08 16:47:10.063816 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:10.063795    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b0b77f-w8h9r"]
Sep 08 16:47:10.936787 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:10.936323    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 08 16:47:10.936787 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:10.936386    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8" podUID="bc154a47-8734-462f-844d-0a5e5679dc76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 08 16:47:10.943302 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:10.943214    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:11.043072 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:11.043039    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:11.936049 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:11.936005    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 08 16:47:11.936362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:11.936085    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8" podUID="bc154a47-8734-462f-844d-0a5e5679dc76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 08 16:47:12.006789 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:12.006758    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a7592bd-879b-45be-89e2-289cc8535222" path="/var/lib/kubelet/pods/3a7592bd-879b-45be-89e2-289cc8535222/volumes"
Sep 08 16:47:12.936207 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:12.936168    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 08 16:47:12.936509 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:12.936478    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8" podUID="bc154a47-8734-462f-844d-0a5e5679dc76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 08 16:47:12.985829 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:12.985797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:13.465219 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.465183    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:47:13.677932 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.677899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:13.936090 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.936005    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 08 16:47:13.936355 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.936328    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8" podUID="bc154a47-8734-462f-844d-0a5e5679dc76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 08 16:47:13.949303 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.949268    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"]
Sep 08 16:47:13.949951 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.949930    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" containerName="istio-proxy"
Sep 08 16:47:13.950063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.949954    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" containerName="istio-proxy"
Sep 08 16:47:13.950063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.949967    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a7592bd-879b-45be-89e2-289cc8535222" containerName="revoke-keys"
Sep 08 16:47:13.950063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.949976    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a7592bd-879b-45be-89e2-289cc8535222" containerName="revoke-keys"
Sep 08 16:47:13.950063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.949991    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" containerName="istio-proxy"
Sep 08 16:47:13.950063 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.949999    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" containerName="istio-proxy"
Sep 08 16:47:13.950327 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.950091    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="296e3e27-7196-4a56-9c0f-0435f9d5edf3" containerName="istio-proxy"
Sep 08 16:47:13.950327 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.950102    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" containerName="istio-proxy"
Sep 08 16:47:13.950327 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.950113    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a624588-6e7a-470e-9fb0-560dd334d301" containerName="istio-proxy"
Sep 08 16:47:13.950327 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.950122    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a7592bd-879b-45be-89e2-289cc8535222" containerName="revoke-keys"
Sep 08 16:47:13.966639 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.966579    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:13.967734 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.967709    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"]
Sep 08 16:47:13.969001 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.968978    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-e30975-openshift-default-dockercfg-s4cdm\""
Sep 08 16:47:13.984647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:13.984599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:14.087413 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.087377    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg4xh\" (UniqueName: \"kubernetes.io/projected/041d9586-6e2a-4099-ab67-06e7d2344cd6-kube-api-access-wg4xh\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.087413 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.087414    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-data\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.087634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.087453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-workload-socket\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.087634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.087503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/041d9586-6e2a-4099-ab67-06e7d2344cd6-istiod-ca-cert\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.087634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.087530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-podinfo\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.087634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.087556    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-envoy\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.087634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.087593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-workload-certs\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.087634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.087624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-token\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.087835 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.087674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-credential-socket\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.188919 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.188817    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-envoy\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.188919 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.188889    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-workload-certs\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.188919 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.188917    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-token\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.189213 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.188957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-credential-socket\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.189213 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.189002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg4xh\" (UniqueName: \"kubernetes.io/projected/041d9586-6e2a-4099-ab67-06e7d2344cd6-kube-api-access-wg4xh\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.189213 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.189033    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-data\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.189213 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.189101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-workload-socket\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.189213 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.189138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/041d9586-6e2a-4099-ab67-06e7d2344cd6-istiod-ca-cert\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.189213 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.189172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-podinfo\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.189544 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.189343    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-workload-certs\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.189544 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.189526    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-data\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.189688 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.189603    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-workload-socket\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.189886 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.189806    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-credential-socket\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.190281 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.190256    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/041d9586-6e2a-4099-ab67-06e7d2344cd6-istiod-ca-cert\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.191746 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.191727    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-envoy\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.191952 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.191935    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-podinfo\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.198138 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.198117    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-token\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.198269 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.198250    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg4xh\" (UniqueName: \"kubernetes.io/projected/041d9586-6e2a-4099-ab67-06e7d2344cd6-kube-api-access-wg4xh\") pod \"e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") " pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.204487 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.204459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:14.278905 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.278864    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:14.568434 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.568399    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"]
Sep 08 16:47:14.571518 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:47:14.571492    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041d9586_6e2a_4099_ab67_06e7d2344cd6.slice/crio-1eceb059992fe6d1f363d2df52b24ef329b4b84e366dc47783cfb80397487c49 WatchSource:0}: Error finding container 1eceb059992fe6d1f363d2df52b24ef329b4b84e366dc47783cfb80397487c49: Status 404 returned error can't find the container with id 1eceb059992fe6d1f363d2df52b24ef329b4b84e366dc47783cfb80397487c49
Sep 08 16:47:14.573756 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.573725    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:47:14.573846 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.573790    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:47:14.573846 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.573815    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:47:14.940146 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.940119    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:47:14.940493 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.940474    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:47:14.941117 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:14.941098    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:47:15.183670 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:15.183638    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz" event={"ID":"041d9586-6e2a-4099-ab67-06e7d2344cd6","Type":"ContainerStarted","Data":"b108674fa4ecd7220efd30116b2d7d2fc02f615ee5225e738763de7725cf8b7c"}
Sep 08 16:47:15.183856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:15.183688    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz" event={"ID":"041d9586-6e2a-4099-ab67-06e7d2344cd6","Type":"ContainerStarted","Data":"1eceb059992fe6d1f363d2df52b24ef329b4b84e366dc47783cfb80397487c49"}
Sep 08 16:47:15.202766 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:15.202683    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz" podStartSLOduration=2.202668092 podStartE2EDuration="2.202668092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:47:15.201638518 +0000 UTC m=+1477.786200138" watchObservedRunningTime="2026-09-08 16:47:15.202668092 +0000 UTC m=+1477.787229711"
Sep 08 16:47:15.279654 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:15.279629    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:15.284495 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:15.284473    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:16.189532 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:16.189501    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:16.190369 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:16.190348    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:16.664722 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:16.664672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:16.731655 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:16.731599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:16.902591 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:16.902557    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"]
Sep 08 16:47:16.902818 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:16.902794    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf" podUID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerName="istio-proxy" containerID="cri-o://50818b14d805f5f94eaaf796d774fba8147a612ec885485088b35b9247219408" gracePeriod=30
Sep 08 16:47:16.924315 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:16.924240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:17.229483 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:17.229445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:17.341268 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:17.341227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:18.345369 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:18.345323    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:18.444497 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:18.444465    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:18.544299 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:18.544257    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:18.845221 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:18.845182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:18.919300 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:18.919249    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:22.143423 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.143400    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:47:22.226673 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.226637    2562 generic.go:356] "Generic (PLEG): container finished" podID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerID="50818b14d805f5f94eaaf796d774fba8147a612ec885485088b35b9247219408" exitCode=0
Sep 08 16:47:22.226819 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.226686    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"
Sep 08 16:47:22.226819 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.226725    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf" event={"ID":"2eb365ca-f0d9-4d3d-a897-bc0187243c02","Type":"ContainerDied","Data":"50818b14d805f5f94eaaf796d774fba8147a612ec885485088b35b9247219408"}
Sep 08 16:47:22.226819 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.226778    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf" event={"ID":"2eb365ca-f0d9-4d3d-a897-bc0187243c02","Type":"ContainerDied","Data":"493f2d804004f5257df255e5bdf39cb6ebd0c1cbf37c8524c9ec631733775f2e"}
Sep 08 16:47:22.226819 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.226801    2562 scope.go:117] "RemoveContainer" containerID="50818b14d805f5f94eaaf796d774fba8147a612ec885485088b35b9247219408"
Sep 08 16:47:22.235683 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.235665    2562 scope.go:117] "RemoveContainer" containerID="12ca995e73146bab0b4ece1e402db6754884b328898a913b54648764d400360b"
Sep 08 16:47:22.243782 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.243766    2562 scope.go:117] "RemoveContainer" containerID="50818b14d805f5f94eaaf796d774fba8147a612ec885485088b35b9247219408"
Sep 08 16:47:22.244048 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:47:22.244029    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50818b14d805f5f94eaaf796d774fba8147a612ec885485088b35b9247219408\": container with ID starting with 50818b14d805f5f94eaaf796d774fba8147a612ec885485088b35b9247219408 not found: ID does not exist" containerID="50818b14d805f5f94eaaf796d774fba8147a612ec885485088b35b9247219408"
Sep 08 16:47:22.244093 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.244057    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50818b14d805f5f94eaaf796d774fba8147a612ec885485088b35b9247219408"} err="failed to get container status \"50818b14d805f5f94eaaf796d774fba8147a612ec885485088b35b9247219408\": rpc error: code = NotFound desc = could not find container \"50818b14d805f5f94eaaf796d774fba8147a612ec885485088b35b9247219408\": container with ID starting with 50818b14d805f5f94eaaf796d774fba8147a612ec885485088b35b9247219408 not found: ID does not exist"
Sep 08 16:47:22.244093 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.244074    2562 scope.go:117] "RemoveContainer" containerID="12ca995e73146bab0b4ece1e402db6754884b328898a913b54648764d400360b"
Sep 08 16:47:22.244298 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:47:22.244283    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12ca995e73146bab0b4ece1e402db6754884b328898a913b54648764d400360b\": container with ID starting with 12ca995e73146bab0b4ece1e402db6754884b328898a913b54648764d400360b not found: ID does not exist" containerID="12ca995e73146bab0b4ece1e402db6754884b328898a913b54648764d400360b"
Sep 08 16:47:22.244340 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.244302    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12ca995e73146bab0b4ece1e402db6754884b328898a913b54648764d400360b"} err="failed to get container status \"12ca995e73146bab0b4ece1e402db6754884b328898a913b54648764d400360b\": rpc error: code = NotFound desc = could not find container \"12ca995e73146bab0b4ece1e402db6754884b328898a913b54648764d400360b\": container with ID starting with 12ca995e73146bab0b4ece1e402db6754884b328898a913b54648764d400360b not found: ID does not exist"
Sep 08 16:47:22.268128 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268093    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-workload-socket\") pod \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") "
Sep 08 16:47:22.268211 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268139    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-podinfo\") pod \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") "
Sep 08 16:47:22.268211 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268174    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-data\") pod \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") "
Sep 08 16:47:22.268316 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268215    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-workload-certs\") pod \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") "
Sep 08 16:47:22.268316 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268243    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istiod-ca-cert\") pod \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") "
Sep 08 16:47:22.268423 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268343    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-token\") pod \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") "
Sep 08 16:47:22.268423 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268374    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-envoy\") pod \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") "
Sep 08 16:47:22.268423 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268387    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2eb365ca-f0d9-4d3d-a897-bc0187243c02" (UID: "2eb365ca-f0d9-4d3d-a897-bc0187243c02"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:22.268582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268436    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kb4c\" (UniqueName: \"kubernetes.io/projected/2eb365ca-f0d9-4d3d-a897-bc0187243c02-kube-api-access-5kb4c\") pod \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") "
Sep 08 16:47:22.268582 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268497    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-credential-socket\") pod \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\" (UID: \"2eb365ca-f0d9-4d3d-a897-bc0187243c02\") "
Sep 08 16:47:22.268766 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268495    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-data" (OuterVolumeSpecName: "istio-data") pod "2eb365ca-f0d9-4d3d-a897-bc0187243c02" (UID: "2eb365ca-f0d9-4d3d-a897-bc0187243c02"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:22.268846 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268756    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2eb365ca-f0d9-4d3d-a897-bc0187243c02" (UID: "2eb365ca-f0d9-4d3d-a897-bc0187243c02"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:22.268846 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268513    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2eb365ca-f0d9-4d3d-a897-bc0187243c02" (UID: "2eb365ca-f0d9-4d3d-a897-bc0187243c02"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:22.268846 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268780    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2eb365ca-f0d9-4d3d-a897-bc0187243c02" (UID: "2eb365ca-f0d9-4d3d-a897-bc0187243c02"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:47:22.269003 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.268981    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:22.269042 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.269008    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:22.269042 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.269021    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:22.269042 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.269033    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:22.269163 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.269045    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:22.270462 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.270430    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2eb365ca-f0d9-4d3d-a897-bc0187243c02" (UID: "2eb365ca-f0d9-4d3d-a897-bc0187243c02"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:22.270554 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.270453    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-token" (OuterVolumeSpecName: "istio-token") pod "2eb365ca-f0d9-4d3d-a897-bc0187243c02" (UID: "2eb365ca-f0d9-4d3d-a897-bc0187243c02"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:47:22.270779 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.270747    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2eb365ca-f0d9-4d3d-a897-bc0187243c02" (UID: "2eb365ca-f0d9-4d3d-a897-bc0187243c02"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:47:22.270851 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.270802    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb365ca-f0d9-4d3d-a897-bc0187243c02-kube-api-access-5kb4c" (OuterVolumeSpecName: "kube-api-access-5kb4c") pod "2eb365ca-f0d9-4d3d-a897-bc0187243c02" (UID: "2eb365ca-f0d9-4d3d-a897-bc0187243c02"). InnerVolumeSpecName "kube-api-access-5kb4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:47:22.370202 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.370168    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:22.370202 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.370201    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:22.370328 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.370232    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb365ca-f0d9-4d3d-a897-bc0187243c02-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:22.370328 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.370240    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kb4c\" (UniqueName: \"kubernetes.io/projected/2eb365ca-f0d9-4d3d-a897-bc0187243c02-kube-api-access-5kb4c\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:47:22.557293 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.557243    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"]
Sep 08 16:47:22.559484 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:22.559461    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf"]
Sep 08 16:47:24.006142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:24.006101    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" path="/var/lib/kubelet/pods/2eb365ca-f0d9-4d3d-a897-bc0187243c02/volumes"
Sep 08 16:47:26.157616 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:26.157579    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:47:36.311837 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:36.311803    2562 generic.go:356] "Generic (PLEG): container finished" podID="041d9586-6e2a-4099-ab67-06e7d2344cd6" containerID="b108674fa4ecd7220efd30116b2d7d2fc02f615ee5225e738763de7725cf8b7c" exitCode=0
Sep 08 16:47:36.312265 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:36.311876    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz" event={"ID":"041d9586-6e2a-4099-ab67-06e7d2344cd6","Type":"ContainerDied","Data":"b108674fa4ecd7220efd30116b2d7d2fc02f615ee5225e738763de7725cf8b7c"}
Sep 08 16:47:36.312265 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:36.312261    2562 scope.go:117] "RemoveContainer" containerID="b108674fa4ecd7220efd30116b2d7d2fc02f615ee5225e738763de7725cf8b7c"
Sep 08 16:47:36.313301 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:36.313277    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:47:36.313356 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:36.313339    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:47:36.313394 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:36.313369    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:47:37.320140 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:37.320109    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz" event={"ID":"041d9586-6e2a-4099-ab67-06e7d2344cd6","Type":"ContainerStarted","Data":"e3804590ef1cc6bd65ba436e755ecbd8e92844938835f7c3e0e50fd53ab6d11e"}
Sep 08 16:47:38.160751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:38.160720    2562 scope.go:117] "RemoveContainer" containerID="ab2cd8044417cb60055a6125b4feed8751580eab1ac2c864f707306a4d43dff0"
Sep 08 16:47:38.278983 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:38.278950    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:38.279174 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:38.279148    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 08 16:47:38.279278 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:38.279207    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz" podUID="041d9586-6e2a-4099-ab67-06e7d2344cd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 08 16:47:39.279217 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:39.279181    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 08 16:47:39.279644 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:39.279246    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz" podUID="041d9586-6e2a-4099-ab67-06e7d2344cd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 08 16:47:40.280002 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:40.279966    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 08 16:47:40.280405 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:40.280021    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz" podUID="041d9586-6e2a-4099-ab67-06e7d2344cd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 08 16:47:41.279949 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:41.279908    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 08 16:47:41.280161 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:41.279975    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz" podUID="041d9586-6e2a-4099-ab67-06e7d2344cd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 08 16:47:42.430599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:42.430559    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:42.431142 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:42.430967    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:42.431709 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:42.431691    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:47:42.785342 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:47:42.785305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:12.560703 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.560623    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"]
Sep 08 16:48:12.561158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.561138    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerName="istio-proxy"
Sep 08 16:48:12.561204 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.561163    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerName="istio-proxy"
Sep 08 16:48:12.561284 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.561273    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerName="istio-proxy"
Sep 08 16:48:12.561320 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.561288    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerName="istio-proxy"
Sep 08 16:48:12.563225 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.563210    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.566803 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.566776    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-55a703\"/\"kube-root-ca.crt\""
Sep 08 16:48:12.566929 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.566861    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-55a703\"/\"openshift-service-ca.crt\""
Sep 08 16:48:12.566929 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.566859    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-55a703\"/\"default-dockercfg-gncpr\""
Sep 08 16:48:12.567045 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.566859    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-55a703\"/\"ipp-route-55a703-kserve-self-signed-certs\""
Sep 08 16:48:12.573095 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.573072    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"]
Sep 08 16:48:12.585666 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.585637    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:12.632660 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.632595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-tmp-dir\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.632814 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.632758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a245a347-5594-4251-a0c1-81b7501f6ce2-tls-certs\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.632934 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.632903    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-model-cache\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.633038 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.632968    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbgwp\" (UniqueName: \"kubernetes.io/projected/a245a347-5594-4251-a0c1-81b7501f6ce2-kube-api-access-nbgwp\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.633038 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.633031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-home\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.633141 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.633055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-dshm\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.734469 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.734437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a245a347-5594-4251-a0c1-81b7501f6ce2-tls-certs\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.734647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.734487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-model-cache\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.734647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.734513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbgwp\" (UniqueName: \"kubernetes.io/projected/a245a347-5594-4251-a0c1-81b7501f6ce2-kube-api-access-nbgwp\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.734647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.734551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-home\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.734647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.734567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-dshm\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.734647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.734589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-tmp-dir\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.735067 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.735034    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-home\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.735182 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.735068    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-model-cache\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.735182 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.735117    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-tmp-dir\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.736826 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.736805    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-dshm\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.736935 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.736910    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a245a347-5594-4251-a0c1-81b7501f6ce2-tls-certs\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.742520 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.742496    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbgwp\" (UniqueName: \"kubernetes.io/projected/a245a347-5594-4251-a0c1-81b7501f6ce2-kube-api-access-nbgwp\") pod \"ipp-route-55a703-kserve-5d4cc49859-mxm5g\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") " pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:12.873934 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:12.873840    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:13.153583 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:13.153509    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"]
Sep 08 16:48:13.156816 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:48:13.156792    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda245a347_5594_4251_a0c1_81b7501f6ce2.slice/crio-02142c357e26cddc0e105dfa52f0f44fe930c5a9e47a1d13ebe8a659a0f9ce69 WatchSource:0}: Error finding container 02142c357e26cddc0e105dfa52f0f44fe930c5a9e47a1d13ebe8a659a0f9ce69: Status 404 returned error can't find the container with id 02142c357e26cddc0e105dfa52f0f44fe930c5a9e47a1d13ebe8a659a0f9ce69
Sep 08 16:48:13.536998 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:13.536964    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g" event={"ID":"a245a347-5594-4251-a0c1-81b7501f6ce2","Type":"ContainerStarted","Data":"f9383e1d0be9c2b7f9f328b4adc3b9cb41d69db12272a07a05410a3509d99944"}
Sep 08 16:48:13.536998 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:13.537005    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g" event={"ID":"a245a347-5594-4251-a0c1-81b7501f6ce2","Type":"ContainerStarted","Data":"02142c357e26cddc0e105dfa52f0f44fe930c5a9e47a1d13ebe8a659a0f9ce69"}
Sep 08 16:48:13.554956 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:13.554912    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g" podStartSLOduration=1.5548968840000001 podStartE2EDuration="1.554896884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:48:13.553124236 +0000 UTC m=+1536.137685856" watchObservedRunningTime="2026-09-08 16:48:13.554896884 +0000 UTC m=+1536.139458503"
Sep 08 16:48:16.363262 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:16.363229    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:48:22.874739 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:22.874703    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:22.875125 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:22.874765    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:22.886737 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:22.886714    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:23.606441 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:23.606410    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:48:38.197316 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:38.197286    2562 scope.go:117] "RemoveContainer" containerID="1bd88e322b40a8a8e342e48836d513c00afde7afa4f4a73c6d99da0982c66f20"
Sep 08 16:48:47.565215 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:47.565176    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:48:54.426775 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.426736    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:54.740201 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.740171    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"]
Sep 08 16:48:54.740557 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.740545    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerName="istio-proxy"
Sep 08 16:48:54.740628 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.740559    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb365ca-f0d9-4d3d-a897-bc0187243c02" containerName="istio-proxy"
Sep 08 16:48:54.742875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.742858    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.745687 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.745666    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-804182-openshift-default-dockercfg-bgldd\""
Sep 08 16:48:54.759391 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.759364    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"]
Sep 08 16:48:54.799117 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.799093    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-workload-socket\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.799256 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.799125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-podinfo\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.799256 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.799155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qckb6\" (UniqueName: \"kubernetes.io/projected/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-kube-api-access-qckb6\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.799256 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.799199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-data\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.799256 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.799224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-token\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.799256 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.799251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istiod-ca-cert\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.799537 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.799307    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-envoy\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.799537 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.799341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-workload-certs\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.799537 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.799364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-credential-socket\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.900171 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.900132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istiod-ca-cert\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.900362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.900201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-envoy\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.900362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.900234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-workload-certs\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.900362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.900276    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-credential-socket\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.900362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.900338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-workload-socket\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.900508 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.900367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-podinfo\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.900508 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.900410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qckb6\" (UniqueName: \"kubernetes.io/projected/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-kube-api-access-qckb6\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.900508 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.900451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-data\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.900508 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.900495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-token\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.900742 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.900714    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-workload-certs\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.901002 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.900974    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istiod-ca-cert\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.901146 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.901129    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-credential-socket\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.901221 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.901142    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-workload-socket\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.901221 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.901171    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-data\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.902634 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.902592    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-envoy\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.903019 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.903000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-podinfo\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.909681 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.909653    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qckb6\" (UniqueName: \"kubernetes.io/projected/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-kube-api-access-qckb6\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:54.909681 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:54.909677    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-token\") pod \"e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") " pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:55.052342 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:55.052247    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:55.338048 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:55.335143    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"]
Sep 08 16:48:55.339031 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:48:55.339000    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7077fb1a_a6b2_4d14_960e_7e2b0ffbccec.slice/crio-1c709defed5c430ff9d97bbf56bce8d13ce0ab80b3d262aee81d941162bc3926 WatchSource:0}: Error finding container 1c709defed5c430ff9d97bbf56bce8d13ce0ab80b3d262aee81d941162bc3926: Status 404 returned error can't find the container with id 1c709defed5c430ff9d97bbf56bce8d13ce0ab80b3d262aee81d941162bc3926
Sep 08 16:48:55.341338 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:55.341304    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:48:55.341430 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:55.341371    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:48:55.341430 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:55.341399    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:48:55.771048 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:55.771013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:55.781225 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:55.781193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" event={"ID":"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec","Type":"ContainerStarted","Data":"ef4d43f8fee12053a520331b37f967e4936cdce887e734bff6b415fd55825d05"}
Sep 08 16:48:55.781366 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:55.781245    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" event={"ID":"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec","Type":"ContainerStarted","Data":"1c709defed5c430ff9d97bbf56bce8d13ce0ab80b3d262aee81d941162bc3926"}
Sep 08 16:48:55.807790 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:55.807741    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" podStartSLOduration=1.807723158 podStartE2EDuration="1.807723158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:48:55.805201785 +0000 UTC m=+1578.389763404" watchObservedRunningTime="2026-09-08 16:48:55.807723158 +0000 UTC m=+1578.392284838"
Sep 08 16:48:56.053050 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:56.052964    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:56.058374 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:56.058344    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:56.787329 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:56.787298    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:56.788221 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:56.788203    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:48:57.749312 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:57.749278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:57.827134 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:57.827102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:58.898244 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:58.898207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:58.999905 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:58.999861    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:59.225542 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:59.225507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:59.394204 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:59.394170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:59.494584 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:48:59.494481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:07.064817 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:07.064781    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:49:22.731361 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:22.731321    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:23.443521 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:23.443479    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w"]
Sep 08 16:49:23.446886 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:23.446859    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w"
Sep 08 16:49:23.449541 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:23.449514    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzslb\""
Sep 08 16:49:23.449871 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:23.449587    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:49:23.454145 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:23.454116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w"]
Sep 08 16:49:23.579905 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:23.579873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/991dd5db-6bc0-4990-8c0b-208c694d0fc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w\" (UID: \"991dd5db-6bc0-4990-8c0b-208c694d0fc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w"
Sep 08 16:49:23.681462 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:23.681422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/991dd5db-6bc0-4990-8c0b-208c694d0fc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w\" (UID: \"991dd5db-6bc0-4990-8c0b-208c694d0fc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w"
Sep 08 16:49:23.682069 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:23.682049    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/991dd5db-6bc0-4990-8c0b-208c694d0fc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w\" (UID: \"991dd5db-6bc0-4990-8c0b-208c694d0fc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w"
Sep 08 16:49:23.760401 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:23.760318    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w"
Sep 08 16:49:24.041927 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:24.041037    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w"]
Sep 08 16:49:24.043176 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:49:24.043139    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991dd5db_6bc0_4990_8c0b_208c694d0fc1.slice/crio-0e6b6fc098c40c2acb5ad3b2c04564549b49914e4d7c2d86f940cc9dfc64c23a WatchSource:0}: Error finding container 0e6b6fc098c40c2acb5ad3b2c04564549b49914e4d7c2d86f940cc9dfc64c23a: Status 404 returned error can't find the container with id 0e6b6fc098c40c2acb5ad3b2c04564549b49914e4d7c2d86f940cc9dfc64c23a
Sep 08 16:49:24.967032 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:24.966993    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w" event={"ID":"991dd5db-6bc0-4990-8c0b-208c694d0fc1","Type":"ContainerStarted","Data":"5bef15cb6350e03f6eeebb6e735030715d59804d54588260230269117bf4e05f"}
Sep 08 16:49:24.967424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:24.967090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w" event={"ID":"991dd5db-6bc0-4990-8c0b-208c694d0fc1","Type":"ContainerStarted","Data":"0e6b6fc098c40c2acb5ad3b2c04564549b49914e4d7c2d86f940cc9dfc64c23a"}
Sep 08 16:49:24.983742 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:24.983699    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w" podStartSLOduration=1.983686247 podStartE2EDuration="1.983686247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:49:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:49:24.982408115 +0000 UTC m=+1607.566969734" watchObservedRunningTime="2026-09-08 16:49:24.983686247 +0000 UTC m=+1607.568247866"
Sep 08 16:49:25.974806 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:25.974773    2562 generic.go:356] "Generic (PLEG): container finished" podID="991dd5db-6bc0-4990-8c0b-208c694d0fc1" containerID="5bef15cb6350e03f6eeebb6e735030715d59804d54588260230269117bf4e05f" exitCode=0
Sep 08 16:49:25.975215 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:25.974866    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w" event={"ID":"991dd5db-6bc0-4990-8c0b-208c694d0fc1","Type":"ContainerDied","Data":"5bef15cb6350e03f6eeebb6e735030715d59804d54588260230269117bf4e05f"}
Sep 08 16:49:27.141403 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:27.141370    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w"
Sep 08 16:49:27.214945 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:27.214903    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/991dd5db-6bc0-4990-8c0b-208c694d0fc1-maas-api-service-ca\") pod \"991dd5db-6bc0-4990-8c0b-208c694d0fc1\" (UID: \"991dd5db-6bc0-4990-8c0b-208c694d0fc1\") "
Sep 08 16:49:27.215308 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:27.215269    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/991dd5db-6bc0-4990-8c0b-208c694d0fc1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "991dd5db-6bc0-4990-8c0b-208c694d0fc1" (UID: "991dd5db-6bc0-4990-8c0b-208c694d0fc1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:49:27.316438 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:27.316352    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/991dd5db-6bc0-4990-8c0b-208c694d0fc1-maas-api-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:49:27.829762 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:27.829720    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:49:27.829927 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:27.829778    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:49:27.990060 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:27.990030    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w"
Sep 08 16:49:27.990220 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:27.990033    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w" event={"ID":"991dd5db-6bc0-4990-8c0b-208c694d0fc1","Type":"ContainerDied","Data":"0e6b6fc098c40c2acb5ad3b2c04564549b49914e4d7c2d86f940cc9dfc64c23a"}
Sep 08 16:49:27.990220 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:27.990155    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e6b6fc098c40c2acb5ad3b2c04564549b49914e4d7c2d86f940cc9dfc64c23a"
Sep 08 16:49:29.484204 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:29.484170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:29.565878 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:29.565845    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:29.641460 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:29.641424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:29.696668 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:29.696636    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w"]
Sep 08 16:49:29.702406 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:29.702381    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-804182-pds8w"]
Sep 08 16:49:29.720279 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:29.720250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:30.005354 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:30.005325    2562 generic.go:356] "Generic (PLEG): container finished" podID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerID="ef4d43f8fee12053a520331b37f967e4936cdce887e734bff6b415fd55825d05" exitCode=0
Sep 08 16:49:30.005647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:30.005603    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="991dd5db-6bc0-4990-8c0b-208c694d0fc1" path="/var/lib/kubelet/pods/991dd5db-6bc0-4990-8c0b-208c694d0fc1/volumes"
Sep 08 16:49:30.005965 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:30.005944    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" event={"ID":"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec","Type":"ContainerDied","Data":"ef4d43f8fee12053a520331b37f967e4936cdce887e734bff6b415fd55825d05"}
Sep 08 16:49:30.006395 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:30.006376    2562 scope.go:117] "RemoveContainer" containerID="ef4d43f8fee12053a520331b37f967e4936cdce887e734bff6b415fd55825d05"
Sep 08 16:49:30.007490 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:30.007435    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:49:30.007566 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:30.007526    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:49:30.007566 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:30.007558    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 16:49:30.081654 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:30.081600    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:31.013178 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:31.013147    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" event={"ID":"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec","Type":"ContainerStarted","Data":"644167bf12a40e952e3f6973651b361b6e7bb0c9f336fcaaa57adf785b58900f"}
Sep 08 16:49:31.052765 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:31.052730    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:49:31.052932 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:31.052913    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 08 16:49:31.052978 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:31.052959    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 08 16:49:32.053381 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:32.053344    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 08 16:49:32.053855 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:32.053411    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 08 16:49:33.053233 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:33.053197    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 08 16:49:33.053418 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:33.053262    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 08 16:49:33.855935 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:33.855899    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:49:34.053278 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:34.053239    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 08 16:49:34.053474 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:34.053296    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 08 16:49:35.053318 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:35.053283    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 08 16:49:35.053500 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:35.053335    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 08 16:49:36.042659 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:36.042620    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:36.052929 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:36.052898    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 08 16:49:36.053104 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:36.052949    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 08 16:49:36.143622 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:36.143575    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:36.311865 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:36.311783    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"]
Sep 08 16:49:36.312044 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:36.312019    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy" containerID="cri-o://644167bf12a40e952e3f6973651b361b6e7bb0c9f336fcaaa57adf785b58900f" gracePeriod=30
Sep 08 16:49:36.329219 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:36.329190    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:40.213533 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:40.213503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:41.574644 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.574598    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:49:41.643456 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.643431    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-credential-socket\") pod \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") "
Sep 08 16:49:41.643636 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.643473    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-data\") pod \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") "
Sep 08 16:49:41.643636 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.643528    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-podinfo\") pod \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") "
Sep 08 16:49:41.643636 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.643553    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-envoy\") pod \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") "
Sep 08 16:49:41.643636 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.643581    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qckb6\" (UniqueName: \"kubernetes.io/projected/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-kube-api-access-qckb6\") pod \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") "
Sep 08 16:49:41.643856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.643716    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" (UID: "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:49:41.643856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.643748    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-workload-certs\") pod \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") "
Sep 08 16:49:41.643856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.643803    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istiod-ca-cert\") pod \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") "
Sep 08 16:49:41.643856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.643830    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-workload-socket\") pod \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") "
Sep 08 16:49:41.643856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.643830    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-data" (OuterVolumeSpecName: "istio-data") pod "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" (UID: "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:49:41.643856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.643847    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-token\") pod \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\" (UID: \"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec\") "
Sep 08 16:49:41.644172 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.644019    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" (UID: "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:49:41.644172 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.644068    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" (UID: "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:49:41.644298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.644170    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" (UID: "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:49:41.644298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.644267    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:49:41.644298 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.644292    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:49:41.644459 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.644306    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:49:41.644459 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.644319    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:49:41.644459 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.644331    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:49:41.645802 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.645771    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-kube-api-access-qckb6" (OuterVolumeSpecName: "kube-api-access-qckb6") pod "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" (UID: "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec"). InnerVolumeSpecName "kube-api-access-qckb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:49:41.645913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.645809    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" (UID: "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:49:41.645913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.645815    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" (UID: "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:49:41.645999 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.645974    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-token" (OuterVolumeSpecName: "istio-token") pod "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" (UID: "7077fb1a-a6b2-4d14-960e-7e2b0ffbccec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:49:41.745561 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.745533    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:49:41.745561 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.745556    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:49:41.745733 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.745564    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qckb6\" (UniqueName: \"kubernetes.io/projected/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-kube-api-access-qckb6\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:49:41.745733 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:41.745575    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:49:42.088599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:42.088565    2562 generic.go:356] "Generic (PLEG): container finished" podID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerID="644167bf12a40e952e3f6973651b361b6e7bb0c9f336fcaaa57adf785b58900f" exitCode=0
Sep 08 16:49:42.088773 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:42.088629    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"
Sep 08 16:49:42.088773 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:42.088647    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" event={"ID":"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec","Type":"ContainerDied","Data":"644167bf12a40e952e3f6973651b361b6e7bb0c9f336fcaaa57adf785b58900f"}
Sep 08 16:49:42.088773 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:42.088705    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv" event={"ID":"7077fb1a-a6b2-4d14-960e-7e2b0ffbccec","Type":"ContainerDied","Data":"1c709defed5c430ff9d97bbf56bce8d13ce0ab80b3d262aee81d941162bc3926"}
Sep 08 16:49:42.088773 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:42.088727    2562 scope.go:117] "RemoveContainer" containerID="644167bf12a40e952e3f6973651b361b6e7bb0c9f336fcaaa57adf785b58900f"
Sep 08 16:49:42.097596 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:42.097576    2562 scope.go:117] "RemoveContainer" containerID="ef4d43f8fee12053a520331b37f967e4936cdce887e734bff6b415fd55825d05"
Sep 08 16:49:42.106444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:42.106427    2562 scope.go:117] "RemoveContainer" containerID="644167bf12a40e952e3f6973651b361b6e7bb0c9f336fcaaa57adf785b58900f"
Sep 08 16:49:42.106729 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:49:42.106710    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"644167bf12a40e952e3f6973651b361b6e7bb0c9f336fcaaa57adf785b58900f\": container with ID starting with 644167bf12a40e952e3f6973651b361b6e7bb0c9f336fcaaa57adf785b58900f not found: ID does not exist" containerID="644167bf12a40e952e3f6973651b361b6e7bb0c9f336fcaaa57adf785b58900f"
Sep 08 16:49:42.106790 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:42.106737    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"644167bf12a40e952e3f6973651b361b6e7bb0c9f336fcaaa57adf785b58900f"} err="failed to get container status \"644167bf12a40e952e3f6973651b361b6e7bb0c9f336fcaaa57adf785b58900f\": rpc error: code = NotFound desc = could not find container \"644167bf12a40e952e3f6973651b361b6e7bb0c9f336fcaaa57adf785b58900f\": container with ID starting with 644167bf12a40e952e3f6973651b361b6e7bb0c9f336fcaaa57adf785b58900f not found: ID does not exist"
Sep 08 16:49:42.106790 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:42.106753    2562 scope.go:117] "RemoveContainer" containerID="ef4d43f8fee12053a520331b37f967e4936cdce887e734bff6b415fd55825d05"
Sep 08 16:49:42.107037 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:49:42.107018    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef4d43f8fee12053a520331b37f967e4936cdce887e734bff6b415fd55825d05\": container with ID starting with ef4d43f8fee12053a520331b37f967e4936cdce887e734bff6b415fd55825d05 not found: ID does not exist" containerID="ef4d43f8fee12053a520331b37f967e4936cdce887e734bff6b415fd55825d05"
Sep 08 16:49:42.107079 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:42.107042    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef4d43f8fee12053a520331b37f967e4936cdce887e734bff6b415fd55825d05"} err="failed to get container status \"ef4d43f8fee12053a520331b37f967e4936cdce887e734bff6b415fd55825d05\": rpc error: code = NotFound desc = could not find container \"ef4d43f8fee12053a520331b37f967e4936cdce887e734bff6b415fd55825d05\": container with ID starting with ef4d43f8fee12053a520331b37f967e4936cdce887e734bff6b415fd55825d05 not found: ID does not exist"
Sep 08 16:49:42.107989 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:42.107971    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"]
Sep 08 16:49:42.112793 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:42.112775    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv"]
Sep 08 16:49:44.006393 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:44.006362    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" path="/var/lib/kubelet/pods/7077fb1a-a6b2-4d14-960e-7e2b0ffbccec/volumes"
Sep 08 16:49:53.451588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:53.451554    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:49:55.489519 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:55.489480    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:56.095427 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:56.095394    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:56.192974 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:56.192935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:56.293323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:56.293291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:56.793456 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:56.793407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:56.888717 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:49:56.888675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:01.736089 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:01.736052    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"]
Sep 08 16:50:02.191802 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:02.191770    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:06.359459 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:06.359421    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:50:16.755488 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:16.755429    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g" podUID="a245a347-5594-4251-a0c1-81b7501f6ce2" containerName="main" containerID="cri-o://f9383e1d0be9c2b7f9f328b4adc3b9cb41d69db12272a07a05410a3509d99944" gracePeriod=45
Sep 08 16:50:17.006156 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.006102    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:50:17.154103 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.154076    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-model-cache\") pod \"a245a347-5594-4251-a0c1-81b7501f6ce2\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") "
Sep 08 16:50:17.154278 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.154131    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a245a347-5594-4251-a0c1-81b7501f6ce2-tls-certs\") pod \"a245a347-5594-4251-a0c1-81b7501f6ce2\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") "
Sep 08 16:50:17.154278 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.154157    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbgwp\" (UniqueName: \"kubernetes.io/projected/a245a347-5594-4251-a0c1-81b7501f6ce2-kube-api-access-nbgwp\") pod \"a245a347-5594-4251-a0c1-81b7501f6ce2\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") "
Sep 08 16:50:17.154278 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.154185    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-tmp-dir\") pod \"a245a347-5594-4251-a0c1-81b7501f6ce2\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") "
Sep 08 16:50:17.154278 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.154246    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-dshm\") pod \"a245a347-5594-4251-a0c1-81b7501f6ce2\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") "
Sep 08 16:50:17.154503 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.154323    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-home\") pod \"a245a347-5594-4251-a0c1-81b7501f6ce2\" (UID: \"a245a347-5594-4251-a0c1-81b7501f6ce2\") "
Sep 08 16:50:17.154503 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.154340    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-model-cache" (OuterVolumeSpecName: "model-cache") pod "a245a347-5594-4251-a0c1-81b7501f6ce2" (UID: "a245a347-5594-4251-a0c1-81b7501f6ce2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:50:17.154653 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.154528    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a245a347-5594-4251-a0c1-81b7501f6ce2" (UID: "a245a347-5594-4251-a0c1-81b7501f6ce2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:50:17.154653 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.154631    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-home" (OuterVolumeSpecName: "home") pod "a245a347-5594-4251-a0c1-81b7501f6ce2" (UID: "a245a347-5594-4251-a0c1-81b7501f6ce2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:50:17.154769 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.154749    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:17.154829 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.154767    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:17.154829 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.154780    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:17.156413 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.156386    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-dshm" (OuterVolumeSpecName: "dshm") pod "a245a347-5594-4251-a0c1-81b7501f6ce2" (UID: "a245a347-5594-4251-a0c1-81b7501f6ce2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:50:17.156413 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.156398    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a245a347-5594-4251-a0c1-81b7501f6ce2-kube-api-access-nbgwp" (OuterVolumeSpecName: "kube-api-access-nbgwp") pod "a245a347-5594-4251-a0c1-81b7501f6ce2" (UID: "a245a347-5594-4251-a0c1-81b7501f6ce2"). InnerVolumeSpecName "kube-api-access-nbgwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:50:17.156553 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.156457    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a245a347-5594-4251-a0c1-81b7501f6ce2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a245a347-5594-4251-a0c1-81b7501f6ce2" (UID: "a245a347-5594-4251-a0c1-81b7501f6ce2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:50:17.256141 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.256112    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a245a347-5594-4251-a0c1-81b7501f6ce2-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:17.256141 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.256136    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbgwp\" (UniqueName: \"kubernetes.io/projected/a245a347-5594-4251-a0c1-81b7501f6ce2-kube-api-access-nbgwp\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:17.256141 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.256147    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a245a347-5594-4251-a0c1-81b7501f6ce2-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:17.293287 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.293211    2562 generic.go:356] "Generic (PLEG): container finished" podID="a245a347-5594-4251-a0c1-81b7501f6ce2" containerID="f9383e1d0be9c2b7f9f328b4adc3b9cb41d69db12272a07a05410a3509d99944" exitCode=0
Sep 08 16:50:17.293287 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.293258    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"
Sep 08 16:50:17.293485 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.293297    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g" event={"ID":"a245a347-5594-4251-a0c1-81b7501f6ce2","Type":"ContainerDied","Data":"f9383e1d0be9c2b7f9f328b4adc3b9cb41d69db12272a07a05410a3509d99944"}
Sep 08 16:50:17.293485 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.293353    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g" event={"ID":"a245a347-5594-4251-a0c1-81b7501f6ce2","Type":"ContainerDied","Data":"02142c357e26cddc0e105dfa52f0f44fe930c5a9e47a1d13ebe8a659a0f9ce69"}
Sep 08 16:50:17.293485 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.293378    2562 scope.go:117] "RemoveContainer" containerID="f9383e1d0be9c2b7f9f328b4adc3b9cb41d69db12272a07a05410a3509d99944"
Sep 08 16:50:17.303199 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.303179    2562 scope.go:117] "RemoveContainer" containerID="f9383e1d0be9c2b7f9f328b4adc3b9cb41d69db12272a07a05410a3509d99944"
Sep 08 16:50:17.303465 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:50:17.303447    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9383e1d0be9c2b7f9f328b4adc3b9cb41d69db12272a07a05410a3509d99944\": container with ID starting with f9383e1d0be9c2b7f9f328b4adc3b9cb41d69db12272a07a05410a3509d99944 not found: ID does not exist" containerID="f9383e1d0be9c2b7f9f328b4adc3b9cb41d69db12272a07a05410a3509d99944"
Sep 08 16:50:17.303514 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.303474    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9383e1d0be9c2b7f9f328b4adc3b9cb41d69db12272a07a05410a3509d99944"} err="failed to get container status \"f9383e1d0be9c2b7f9f328b4adc3b9cb41d69db12272a07a05410a3509d99944\": rpc error: code = NotFound desc = could not find container \"f9383e1d0be9c2b7f9f328b4adc3b9cb41d69db12272a07a05410a3509d99944\": container with ID starting with f9383e1d0be9c2b7f9f328b4adc3b9cb41d69db12272a07a05410a3509d99944 not found: ID does not exist"
Sep 08 16:50:17.323739 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.323708    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"]
Sep 08 16:50:17.332016 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:17.331994    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-55a703/ipp-route-55a703-kserve-5d4cc49859-mxm5g"]
Sep 08 16:50:18.005306 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:18.005274    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a245a347-5594-4251-a0c1-81b7501f6ce2" path="/var/lib/kubelet/pods/a245a347-5594-4251-a0c1-81b7501f6ce2/volumes"
Sep 08 16:50:25.770661 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:25.770619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:38.023049 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:38.023014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:38.446318 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:38.446286    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:39.160662 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:39.160594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:44.908667 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:44.908631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:45.012322 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.012283    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:45.195390 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.195360    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"]
Sep 08 16:50:45.195581 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.195561    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8" podUID="bc154a47-8734-462f-844d-0a5e5679dc76" containerName="istio-proxy" containerID="cri-o://b0ed1f39fc191f642f61e65a11151ec6c28b205376ec54773dc95c92d735a3bb" gracePeriod=30
Sep 08 16:50:45.220970 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.220936    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:45.655899 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.655814    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2"]
Sep 08 16:50:45.656176 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.656164    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy"
Sep 08 16:50:45.656226 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.656178    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy"
Sep 08 16:50:45.656226 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.656191    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy"
Sep 08 16:50:45.656226 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.656196    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy"
Sep 08 16:50:45.656226 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.656205    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="991dd5db-6bc0-4990-8c0b-208c694d0fc1" containerName="revoke-keys"
Sep 08 16:50:45.656226 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.656212    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="991dd5db-6bc0-4990-8c0b-208c694d0fc1" containerName="revoke-keys"
Sep 08 16:50:45.656226 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.656219    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a245a347-5594-4251-a0c1-81b7501f6ce2" containerName="main"
Sep 08 16:50:45.656226 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.656224    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a245a347-5594-4251-a0c1-81b7501f6ce2" containerName="main"
Sep 08 16:50:45.656473 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.656287    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy"
Sep 08 16:50:45.656473 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.656297    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a245a347-5594-4251-a0c1-81b7501f6ce2" containerName="main"
Sep 08 16:50:45.656473 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.656303    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7077fb1a-a6b2-4d14-960e-7e2b0ffbccec" containerName="istio-proxy"
Sep 08 16:50:45.656473 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.656309    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="991dd5db-6bc0-4990-8c0b-208c694d0fc1" containerName="revoke-keys"
Sep 08 16:50:45.659410 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.659389    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2"
Sep 08 16:50:45.661887 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.661865    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzslb\""
Sep 08 16:50:45.662354 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.662336    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:50:45.669502 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.669467    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2"]
Sep 08 16:50:45.690795 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.690769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/184a597d-589a-491b-af17-acb4764ec15d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2\" (UID: \"184a597d-589a-491b-af17-acb4764ec15d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2"
Sep 08 16:50:45.701744 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.701716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:45.791194 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.791164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/184a597d-589a-491b-af17-acb4764ec15d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2\" (UID: \"184a597d-589a-491b-af17-acb4764ec15d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2"
Sep 08 16:50:45.791810 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.791784    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/184a597d-589a-491b-af17-acb4764ec15d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2\" (UID: \"184a597d-589a-491b-af17-acb4764ec15d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2"
Sep 08 16:50:45.971462 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:45.971436    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2"
Sep 08 16:50:46.241553 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:46.241531    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2"]
Sep 08 16:50:46.243277 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:50:46.243249    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184a597d_589a_491b_af17_acb4764ec15d.slice/crio-44247008fb02e70faa9b83393d78ea749624d5c22d888917f2acc236c47abc87 WatchSource:0}: Error finding container 44247008fb02e70faa9b83393d78ea749624d5c22d888917f2acc236c47abc87: Status 404 returned error can't find the container with id 44247008fb02e70faa9b83393d78ea749624d5c22d888917f2acc236c47abc87
Sep 08 16:50:46.459891 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:46.459856    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2" event={"ID":"184a597d-589a-491b-af17-acb4764ec15d","Type":"ContainerStarted","Data":"44247008fb02e70faa9b83393d78ea749624d5c22d888917f2acc236c47abc87"}
Sep 08 16:50:47.466351 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:47.466314    2562 generic.go:356] "Generic (PLEG): container finished" podID="184a597d-589a-491b-af17-acb4764ec15d" containerID="84d8208e35e67a4133e9db3cf0450413ea2aad469b2763949e2a73f144b9e770" exitCode=0
Sep 08 16:50:47.466746 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:47.466396    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2" event={"ID":"184a597d-589a-491b-af17-acb4764ec15d","Type":"ContainerDied","Data":"84d8208e35e67a4133e9db3cf0450413ea2aad469b2763949e2a73f144b9e770"}
Sep 08 16:50:48.599573 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:48.599549    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2"
Sep 08 16:50:48.713957 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:48.713921    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/184a597d-589a-491b-af17-acb4764ec15d-maas-api-service-ca\") pod \"184a597d-589a-491b-af17-acb4764ec15d\" (UID: \"184a597d-589a-491b-af17-acb4764ec15d\") "
Sep 08 16:50:48.714327 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:48.714305    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/184a597d-589a-491b-af17-acb4764ec15d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "184a597d-589a-491b-af17-acb4764ec15d" (UID: "184a597d-589a-491b-af17-acb4764ec15d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:50:48.814854 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:48.814767    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/184a597d-589a-491b-af17-acb4764ec15d-maas-api-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:49.479510 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:49.479484    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2"
Sep 08 16:50:49.479705 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:49.479528    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2" event={"ID":"184a597d-589a-491b-af17-acb4764ec15d","Type":"ContainerDied","Data":"44247008fb02e70faa9b83393d78ea749624d5c22d888917f2acc236c47abc87"}
Sep 08 16:50:49.479705 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:49.479577    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44247008fb02e70faa9b83393d78ea749624d5c22d888917f2acc236c47abc87"
Sep 08 16:50:50.443591 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.443570    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:50:50.486276 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.486212    2562 generic.go:356] "Generic (PLEG): container finished" podID="bc154a47-8734-462f-844d-0a5e5679dc76" containerID="b0ed1f39fc191f642f61e65a11151ec6c28b205376ec54773dc95c92d735a3bb" exitCode=0
Sep 08 16:50:50.486276 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.486257    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"
Sep 08 16:50:50.486425 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.486306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8" event={"ID":"bc154a47-8734-462f-844d-0a5e5679dc76","Type":"ContainerDied","Data":"b0ed1f39fc191f642f61e65a11151ec6c28b205376ec54773dc95c92d735a3bb"}
Sep 08 16:50:50.486425 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.486365    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8" event={"ID":"bc154a47-8734-462f-844d-0a5e5679dc76","Type":"ContainerDied","Data":"a0319d14e944d3991f76927fe57f22077704ad1cdc76ce20d9b52386224fb814"}
Sep 08 16:50:50.486425 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.486398    2562 scope.go:117] "RemoveContainer" containerID="b0ed1f39fc191f642f61e65a11151ec6c28b205376ec54773dc95c92d735a3bb"
Sep 08 16:50:50.498406 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.498370    2562 scope.go:117] "RemoveContainer" containerID="39b700f2ac2c7c4762ed62835736803d544762f390e6a0170ff736b10be078f7"
Sep 08 16:50:50.506531 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.506514    2562 scope.go:117] "RemoveContainer" containerID="b0ed1f39fc191f642f61e65a11151ec6c28b205376ec54773dc95c92d735a3bb"
Sep 08 16:50:50.506793 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:50:50.506777    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0ed1f39fc191f642f61e65a11151ec6c28b205376ec54773dc95c92d735a3bb\": container with ID starting with b0ed1f39fc191f642f61e65a11151ec6c28b205376ec54773dc95c92d735a3bb not found: ID does not exist" containerID="b0ed1f39fc191f642f61e65a11151ec6c28b205376ec54773dc95c92d735a3bb"
Sep 08 16:50:50.506837 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.506800    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0ed1f39fc191f642f61e65a11151ec6c28b205376ec54773dc95c92d735a3bb"} err="failed to get container status \"b0ed1f39fc191f642f61e65a11151ec6c28b205376ec54773dc95c92d735a3bb\": rpc error: code = NotFound desc = could not find container \"b0ed1f39fc191f642f61e65a11151ec6c28b205376ec54773dc95c92d735a3bb\": container with ID starting with b0ed1f39fc191f642f61e65a11151ec6c28b205376ec54773dc95c92d735a3bb not found: ID does not exist"
Sep 08 16:50:50.506837 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.506814    2562 scope.go:117] "RemoveContainer" containerID="39b700f2ac2c7c4762ed62835736803d544762f390e6a0170ff736b10be078f7"
Sep 08 16:50:50.507067 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:50:50.507050    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39b700f2ac2c7c4762ed62835736803d544762f390e6a0170ff736b10be078f7\": container with ID starting with 39b700f2ac2c7c4762ed62835736803d544762f390e6a0170ff736b10be078f7 not found: ID does not exist" containerID="39b700f2ac2c7c4762ed62835736803d544762f390e6a0170ff736b10be078f7"
Sep 08 16:50:50.507103 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.507080    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39b700f2ac2c7c4762ed62835736803d544762f390e6a0170ff736b10be078f7"} err="failed to get container status \"39b700f2ac2c7c4762ed62835736803d544762f390e6a0170ff736b10be078f7\": rpc error: code = NotFound desc = could not find container \"39b700f2ac2c7c4762ed62835736803d544762f390e6a0170ff736b10be078f7\": container with ID starting with 39b700f2ac2c7c4762ed62835736803d544762f390e6a0170ff736b10be078f7 not found: ID does not exist"
Sep 08 16:50:50.530357 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.530339    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grplg\" (UniqueName: \"kubernetes.io/projected/bc154a47-8734-462f-844d-0a5e5679dc76-kube-api-access-grplg\") pod \"bc154a47-8734-462f-844d-0a5e5679dc76\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") "
Sep 08 16:50:50.530424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.530366    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc154a47-8734-462f-844d-0a5e5679dc76-istio-podinfo\") pod \"bc154a47-8734-462f-844d-0a5e5679dc76\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") "
Sep 08 16:50:50.530424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.530385    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-workload-certs\") pod \"bc154a47-8734-462f-844d-0a5e5679dc76\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") "
Sep 08 16:50:50.530424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.530406    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc154a47-8734-462f-844d-0a5e5679dc76-istio-token\") pod \"bc154a47-8734-462f-844d-0a5e5679dc76\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") "
Sep 08 16:50:50.530548 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.530466    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-credential-socket\") pod \"bc154a47-8734-462f-844d-0a5e5679dc76\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") "
Sep 08 16:50:50.530548 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.530487    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc154a47-8734-462f-844d-0a5e5679dc76-istiod-ca-cert\") pod \"bc154a47-8734-462f-844d-0a5e5679dc76\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") "
Sep 08 16:50:50.530548 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.530519    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-workload-socket\") pod \"bc154a47-8734-462f-844d-0a5e5679dc76\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") "
Sep 08 16:50:50.530548 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.530540    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-istio-envoy\") pod \"bc154a47-8734-462f-844d-0a5e5679dc76\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") "
Sep 08 16:50:50.530773 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.530630    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc154a47-8734-462f-844d-0a5e5679dc76" (UID: "bc154a47-8734-462f-844d-0a5e5679dc76"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:50:50.530773 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.530678    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-istio-data\") pod \"bc154a47-8734-462f-844d-0a5e5679dc76\" (UID: \"bc154a47-8734-462f-844d-0a5e5679dc76\") "
Sep 08 16:50:50.530881 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.530799    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc154a47-8734-462f-844d-0a5e5679dc76" (UID: "bc154a47-8734-462f-844d-0a5e5679dc76"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:50:50.531058 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.531035    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc154a47-8734-462f-844d-0a5e5679dc76" (UID: "bc154a47-8734-462f-844d-0a5e5679dc76"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:50:50.531152 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.531061    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:50.531152 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.531082    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:50.531152 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.531133    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc154a47-8734-462f-844d-0a5e5679dc76-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc154a47-8734-462f-844d-0a5e5679dc76" (UID: "bc154a47-8734-462f-844d-0a5e5679dc76"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:50:50.531304 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.530984    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc154a47-8734-462f-844d-0a5e5679dc76" (UID: "bc154a47-8734-462f-844d-0a5e5679dc76"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:50:50.532472 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.532450    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc154a47-8734-462f-844d-0a5e5679dc76-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc154a47-8734-462f-844d-0a5e5679dc76" (UID: "bc154a47-8734-462f-844d-0a5e5679dc76"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:50:50.532579 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.532544    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc154a47-8734-462f-844d-0a5e5679dc76" (UID: "bc154a47-8734-462f-844d-0a5e5679dc76"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:50:50.532666 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.532589    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc154a47-8734-462f-844d-0a5e5679dc76-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc154a47-8734-462f-844d-0a5e5679dc76" (UID: "bc154a47-8734-462f-844d-0a5e5679dc76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:50:50.532774 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.532754    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc154a47-8734-462f-844d-0a5e5679dc76-kube-api-access-grplg" (OuterVolumeSpecName: "kube-api-access-grplg") pod "bc154a47-8734-462f-844d-0a5e5679dc76" (UID: "bc154a47-8734-462f-844d-0a5e5679dc76"). InnerVolumeSpecName "kube-api-access-grplg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:50:50.631479 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.631452    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:50.631479 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.631477    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:50.631598 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.631486    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc154a47-8734-462f-844d-0a5e5679dc76-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:50.631598 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.631494    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grplg\" (UniqueName: \"kubernetes.io/projected/bc154a47-8734-462f-844d-0a5e5679dc76-kube-api-access-grplg\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:50.631598 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.631503    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc154a47-8734-462f-844d-0a5e5679dc76-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:50.631598 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.631510    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc154a47-8734-462f-844d-0a5e5679dc76-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:50.631598 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.631517    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc154a47-8734-462f-844d-0a5e5679dc76-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:50:50.809446 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.809420    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"]
Sep 08 16:50:50.815421 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:50.815399    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8"]
Sep 08 16:50:52.006310 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:52.006280    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc154a47-8734-462f-844d-0a5e5679dc76" path="/var/lib/kubelet/pods/bc154a47-8734-462f-844d-0a5e5679dc76/volumes"
Sep 08 16:50:56.465578 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:56.465543    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:56.550244 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:56.550207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:56.668875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:56.668839    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:56.754809 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:56.754722    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2"]
Sep 08 16:50:56.761210 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:56.761174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:56.762392 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:56.762371    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e30975-6vfm2"]
Sep 08 16:50:56.891467 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:56.891432    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:57.150594 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:57.150502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:58.005893 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:58.005859    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="184a597d-589a-491b-af17-acb4764ec15d" path="/var/lib/kubelet/pods/184a597d-589a-491b-af17-acb4764ec15d/volumes"
Sep 08 16:50:59.966422 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:50:59.966391    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:51:03.170668 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.170630    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:03.338991 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.338958    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"]
Sep 08 16:51:03.339224 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.339195    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz" podUID="041d9586-6e2a-4099-ab67-06e7d2344cd6" containerName="istio-proxy" containerID="cri-o://e3804590ef1cc6bd65ba436e755ecbd8e92844938835f7c3e0e50fd53ab6d11e" gracePeriod=30
Sep 08 16:51:03.477323 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.477285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:03.577673 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.577639    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:03.707957 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.707928    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q"]
Sep 08 16:51:03.708269 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.708257    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="184a597d-589a-491b-af17-acb4764ec15d" containerName="revoke-keys"
Sep 08 16:51:03.708269 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.708270    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="184a597d-589a-491b-af17-acb4764ec15d" containerName="revoke-keys"
Sep 08 16:51:03.708385 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.708287    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc154a47-8734-462f-844d-0a5e5679dc76" containerName="istio-proxy"
Sep 08 16:51:03.708385 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.708293    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc154a47-8734-462f-844d-0a5e5679dc76" containerName="istio-proxy"
Sep 08 16:51:03.708385 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.708301    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc154a47-8734-462f-844d-0a5e5679dc76" containerName="istio-proxy"
Sep 08 16:51:03.708385 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.708307    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc154a47-8734-462f-844d-0a5e5679dc76" containerName="istio-proxy"
Sep 08 16:51:03.708385 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.708384    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="184a597d-589a-491b-af17-acb4764ec15d" containerName="revoke-keys"
Sep 08 16:51:03.708553 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.708394    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc154a47-8734-462f-844d-0a5e5679dc76" containerName="istio-proxy"
Sep 08 16:51:03.712770 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.712754    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q"
Sep 08 16:51:03.715547 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.715528    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:51:03.715680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.715536    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzslb\""
Sep 08 16:51:03.720043 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.720021    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q"]
Sep 08 16:51:03.840541 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.840468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90e09a2a-2c9b-4dbd-bfcf-a614938db019-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q\" (UID: \"90e09a2a-2c9b-4dbd-bfcf-a614938db019\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q"
Sep 08 16:51:03.850243 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.850219    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:03.941130 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.941094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90e09a2a-2c9b-4dbd-bfcf-a614938db019-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q\" (UID: \"90e09a2a-2c9b-4dbd-bfcf-a614938db019\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q"
Sep 08 16:51:03.941736 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:03.941719    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90e09a2a-2c9b-4dbd-bfcf-a614938db019-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q\" (UID: \"90e09a2a-2c9b-4dbd-bfcf-a614938db019\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q"
Sep 08 16:51:04.025140 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:04.025109    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q"
Sep 08 16:51:04.305121 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:04.305098    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q"]
Sep 08 16:51:04.307110 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:51:04.307083    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e09a2a_2c9b_4dbd_bfcf_a614938db019.slice/crio-f1130ca18b8f2c5cd7017caef709ea3c6884a0cba9b1d7f2ee32ad1084e5624e WatchSource:0}: Error finding container f1130ca18b8f2c5cd7017caef709ea3c6884a0cba9b1d7f2ee32ad1084e5624e: Status 404 returned error can't find the container with id f1130ca18b8f2c5cd7017caef709ea3c6884a0cba9b1d7f2ee32ad1084e5624e
Sep 08 16:51:04.570823 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:04.570759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q" event={"ID":"90e09a2a-2c9b-4dbd-bfcf-a614938db019","Type":"ContainerStarted","Data":"93ef4d1c82346efed24a8951c580565e6a73571b6d0f88ea4a7a54c4c05904a0"}
Sep 08 16:51:04.570823 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:04.570819    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q" event={"ID":"90e09a2a-2c9b-4dbd-bfcf-a614938db019","Type":"ContainerStarted","Data":"f1130ca18b8f2c5cd7017caef709ea3c6884a0cba9b1d7f2ee32ad1084e5624e"}
Sep 08 16:51:04.595876 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:04.595836    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q" podStartSLOduration=1.59582041 podStartE2EDuration="1.59582041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:51:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:51:04.59442251 +0000 UTC m=+1707.178984127" watchObservedRunningTime="2026-09-08 16:51:04.59582041 +0000 UTC m=+1707.180382027"
Sep 08 16:51:05.577831 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:05.577798    2562 generic.go:356] "Generic (PLEG): container finished" podID="90e09a2a-2c9b-4dbd-bfcf-a614938db019" containerID="93ef4d1c82346efed24a8951c580565e6a73571b6d0f88ea4a7a54c4c05904a0" exitCode=0
Sep 08 16:51:05.578170 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:05.577886    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q" event={"ID":"90e09a2a-2c9b-4dbd-bfcf-a614938db019","Type":"ContainerDied","Data":"93ef4d1c82346efed24a8951c580565e6a73571b6d0f88ea4a7a54c4c05904a0"}
Sep 08 16:51:06.702823 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:06.702801    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q"
Sep 08 16:51:06.768331 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:06.768287    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90e09a2a-2c9b-4dbd-bfcf-a614938db019-maas-api-service-ca\") pod \"90e09a2a-2c9b-4dbd-bfcf-a614938db019\" (UID: \"90e09a2a-2c9b-4dbd-bfcf-a614938db019\") "
Sep 08 16:51:06.768662 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:06.768639    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90e09a2a-2c9b-4dbd-bfcf-a614938db019-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "90e09a2a-2c9b-4dbd-bfcf-a614938db019" (UID: "90e09a2a-2c9b-4dbd-bfcf-a614938db019"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:51:06.869958 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:06.869894    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90e09a2a-2c9b-4dbd-bfcf-a614938db019-maas-api-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:07.589880 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:07.589845    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q"
Sep 08 16:51:07.589880 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:07.589875    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q" event={"ID":"90e09a2a-2c9b-4dbd-bfcf-a614938db019","Type":"ContainerDied","Data":"f1130ca18b8f2c5cd7017caef709ea3c6884a0cba9b1d7f2ee32ad1084e5624e"}
Sep 08 16:51:07.590100 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:07.589919    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1130ca18b8f2c5cd7017caef709ea3c6884a0cba9b1d7f2ee32ad1084e5624e"
Sep 08 16:51:08.586687 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.586662    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:51:08.596083 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.596062    2562 generic.go:356] "Generic (PLEG): container finished" podID="041d9586-6e2a-4099-ab67-06e7d2344cd6" containerID="e3804590ef1cc6bd65ba436e755ecbd8e92844938835f7c3e0e50fd53ab6d11e" exitCode=0
Sep 08 16:51:08.596187 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.596099    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"
Sep 08 16:51:08.596187 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.596137    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz" event={"ID":"041d9586-6e2a-4099-ab67-06e7d2344cd6","Type":"ContainerDied","Data":"e3804590ef1cc6bd65ba436e755ecbd8e92844938835f7c3e0e50fd53ab6d11e"}
Sep 08 16:51:08.596265 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.596188    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz" event={"ID":"041d9586-6e2a-4099-ab67-06e7d2344cd6","Type":"ContainerDied","Data":"1eceb059992fe6d1f363d2df52b24ef329b4b84e366dc47783cfb80397487c49"}
Sep 08 16:51:08.596265 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.596216    2562 scope.go:117] "RemoveContainer" containerID="e3804590ef1cc6bd65ba436e755ecbd8e92844938835f7c3e0e50fd53ab6d11e"
Sep 08 16:51:08.604972 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.604947    2562 scope.go:117] "RemoveContainer" containerID="b108674fa4ecd7220efd30116b2d7d2fc02f615ee5225e738763de7725cf8b7c"
Sep 08 16:51:08.615267 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.615250    2562 scope.go:117] "RemoveContainer" containerID="e3804590ef1cc6bd65ba436e755ecbd8e92844938835f7c3e0e50fd53ab6d11e"
Sep 08 16:51:08.615540 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:51:08.615522    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3804590ef1cc6bd65ba436e755ecbd8e92844938835f7c3e0e50fd53ab6d11e\": container with ID starting with e3804590ef1cc6bd65ba436e755ecbd8e92844938835f7c3e0e50fd53ab6d11e not found: ID does not exist" containerID="e3804590ef1cc6bd65ba436e755ecbd8e92844938835f7c3e0e50fd53ab6d11e"
Sep 08 16:51:08.615583 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.615548    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3804590ef1cc6bd65ba436e755ecbd8e92844938835f7c3e0e50fd53ab6d11e"} err="failed to get container status \"e3804590ef1cc6bd65ba436e755ecbd8e92844938835f7c3e0e50fd53ab6d11e\": rpc error: code = NotFound desc = could not find container \"e3804590ef1cc6bd65ba436e755ecbd8e92844938835f7c3e0e50fd53ab6d11e\": container with ID starting with e3804590ef1cc6bd65ba436e755ecbd8e92844938835f7c3e0e50fd53ab6d11e not found: ID does not exist"
Sep 08 16:51:08.615583 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.615565    2562 scope.go:117] "RemoveContainer" containerID="b108674fa4ecd7220efd30116b2d7d2fc02f615ee5225e738763de7725cf8b7c"
Sep 08 16:51:08.615825 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:51:08.615807    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b108674fa4ecd7220efd30116b2d7d2fc02f615ee5225e738763de7725cf8b7c\": container with ID starting with b108674fa4ecd7220efd30116b2d7d2fc02f615ee5225e738763de7725cf8b7c not found: ID does not exist" containerID="b108674fa4ecd7220efd30116b2d7d2fc02f615ee5225e738763de7725cf8b7c"
Sep 08 16:51:08.615883 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.615835    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b108674fa4ecd7220efd30116b2d7d2fc02f615ee5225e738763de7725cf8b7c"} err="failed to get container status \"b108674fa4ecd7220efd30116b2d7d2fc02f615ee5225e738763de7725cf8b7c\": rpc error: code = NotFound desc = could not find container \"b108674fa4ecd7220efd30116b2d7d2fc02f615ee5225e738763de7725cf8b7c\": container with ID starting with b108674fa4ecd7220efd30116b2d7d2fc02f615ee5225e738763de7725cf8b7c not found: ID does not exist"
Sep 08 16:51:08.682355 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.682336    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-token\") pod \"041d9586-6e2a-4099-ab67-06e7d2344cd6\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") "
Sep 08 16:51:08.682452 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.682363    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-podinfo\") pod \"041d9586-6e2a-4099-ab67-06e7d2344cd6\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") "
Sep 08 16:51:08.682452 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.682402    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-workload-certs\") pod \"041d9586-6e2a-4099-ab67-06e7d2344cd6\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") "
Sep 08 16:51:08.682452 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.682441    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-credential-socket\") pod \"041d9586-6e2a-4099-ab67-06e7d2344cd6\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") "
Sep 08 16:51:08.682599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.682474    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg4xh\" (UniqueName: \"kubernetes.io/projected/041d9586-6e2a-4099-ab67-06e7d2344cd6-kube-api-access-wg4xh\") pod \"041d9586-6e2a-4099-ab67-06e7d2344cd6\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") "
Sep 08 16:51:08.682599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.682505    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/041d9586-6e2a-4099-ab67-06e7d2344cd6-istiod-ca-cert\") pod \"041d9586-6e2a-4099-ab67-06e7d2344cd6\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") "
Sep 08 16:51:08.682599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.682561    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-data\") pod \"041d9586-6e2a-4099-ab67-06e7d2344cd6\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") "
Sep 08 16:51:08.682599 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.682581    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-envoy\") pod \"041d9586-6e2a-4099-ab67-06e7d2344cd6\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") "
Sep 08 16:51:08.682821 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.682639    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-workload-socket\") pod \"041d9586-6e2a-4099-ab67-06e7d2344cd6\" (UID: \"041d9586-6e2a-4099-ab67-06e7d2344cd6\") "
Sep 08 16:51:08.682821 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.682724    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "041d9586-6e2a-4099-ab67-06e7d2344cd6" (UID: "041d9586-6e2a-4099-ab67-06e7d2344cd6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:51:08.682821 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.682743    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "041d9586-6e2a-4099-ab67-06e7d2344cd6" (UID: "041d9586-6e2a-4099-ab67-06e7d2344cd6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:51:08.682989 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.682903    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "041d9586-6e2a-4099-ab67-06e7d2344cd6" (UID: "041d9586-6e2a-4099-ab67-06e7d2344cd6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:51:08.682989 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.682950    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-data" (OuterVolumeSpecName: "istio-data") pod "041d9586-6e2a-4099-ab67-06e7d2344cd6" (UID: "041d9586-6e2a-4099-ab67-06e7d2344cd6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:51:08.683091 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.683069    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:08.683091 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.683087    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:08.683197 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.683091    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/041d9586-6e2a-4099-ab67-06e7d2344cd6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "041d9586-6e2a-4099-ab67-06e7d2344cd6" (UID: "041d9586-6e2a-4099-ab67-06e7d2344cd6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:51:08.683197 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.683101    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:08.683197 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.683131    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:08.684494 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.684473    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-token" (OuterVolumeSpecName: "istio-token") pod "041d9586-6e2a-4099-ab67-06e7d2344cd6" (UID: "041d9586-6e2a-4099-ab67-06e7d2344cd6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:51:08.684640 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.684535    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/041d9586-6e2a-4099-ab67-06e7d2344cd6-kube-api-access-wg4xh" (OuterVolumeSpecName: "kube-api-access-wg4xh") pod "041d9586-6e2a-4099-ab67-06e7d2344cd6" (UID: "041d9586-6e2a-4099-ab67-06e7d2344cd6"). InnerVolumeSpecName "kube-api-access-wg4xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:51:08.684881 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.684859    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "041d9586-6e2a-4099-ab67-06e7d2344cd6" (UID: "041d9586-6e2a-4099-ab67-06e7d2344cd6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:51:08.684947 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.684913    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "041d9586-6e2a-4099-ab67-06e7d2344cd6" (UID: "041d9586-6e2a-4099-ab67-06e7d2344cd6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:51:08.784478 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.784443    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg4xh\" (UniqueName: \"kubernetes.io/projected/041d9586-6e2a-4099-ab67-06e7d2344cd6-kube-api-access-wg4xh\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:08.784478 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.784478    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/041d9586-6e2a-4099-ab67-06e7d2344cd6-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:08.784478 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.784488    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:08.784670 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.784496    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:08.784670 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.784504    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/041d9586-6e2a-4099-ab67-06e7d2344cd6-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:08.920421 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.920390    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"]
Sep 08 16:51:08.922550 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:08.922530    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz"]
Sep 08 16:51:10.005788 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:10.005755    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="041d9586-6e2a-4099-ab67-06e7d2344cd6" path="/var/lib/kubelet/pods/041d9586-6e2a-4099-ab67-06e7d2344cd6/volumes"
Sep 08 16:51:14.194738 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:14.194700    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8"]
Sep 08 16:51:14.199039 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:14.199014    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a4942b-29814765-jq2k8"]
Sep 08 16:51:14.391394 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:14.391359    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q"]
Sep 08 16:51:14.394501 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:14.394476    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a4942b-wh97q"]
Sep 08 16:51:14.610527 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:14.610434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:14.668187 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:14.668154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:14.773447 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:14.773411    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:16.005096 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:16.005061    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="449c6606-a6f5-40e0-91d3-755c73675904" path="/var/lib/kubelet/pods/449c6606-a6f5-40e0-91d3-755c73675904/volumes"
Sep 08 16:51:16.005545 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:16.005354    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90e09a2a-2c9b-4dbd-bfcf-a614938db019" path="/var/lib/kubelet/pods/90e09a2a-2c9b-4dbd-bfcf-a614938db019/volumes"
Sep 08 16:51:16.052928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:16.052893    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:51:20.895552 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:20.895510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:20.974847 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:20.974812    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:21.261301 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.261268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:21.538403 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.538312    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888"]
Sep 08 16:51:21.538778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.538760    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="041d9586-6e2a-4099-ab67-06e7d2344cd6" containerName="istio-proxy"
Sep 08 16:51:21.538778 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.538780    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="041d9586-6e2a-4099-ab67-06e7d2344cd6" containerName="istio-proxy"
Sep 08 16:51:21.538954 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.538821    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e09a2a-2c9b-4dbd-bfcf-a614938db019" containerName="revoke-keys"
Sep 08 16:51:21.538954 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.538830    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e09a2a-2c9b-4dbd-bfcf-a614938db019" containerName="revoke-keys"
Sep 08 16:51:21.538954 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.538919    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="041d9586-6e2a-4099-ab67-06e7d2344cd6" containerName="istio-proxy"
Sep 08 16:51:21.538954 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.538933    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="041d9586-6e2a-4099-ab67-06e7d2344cd6" containerName="istio-proxy"
Sep 08 16:51:21.538954 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.538944    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="90e09a2a-2c9b-4dbd-bfcf-a614938db019" containerName="revoke-keys"
Sep 08 16:51:21.538954 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.538954    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc154a47-8734-462f-844d-0a5e5679dc76" containerName="istio-proxy"
Sep 08 16:51:21.543256 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.543237    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888"
Sep 08 16:51:21.545769 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.545742    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:51:21.545856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.545771    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzslb\""
Sep 08 16:51:21.551361 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.551341    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888"]
Sep 08 16:51:21.637680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.637650    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:21.693652 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.693590    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/884bc727-aa95-42c4-8763-ed2d1cd23f46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888\" (UID: \"884bc727-aa95-42c4-8763-ed2d1cd23f46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888"
Sep 08 16:51:21.794372 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.794294    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/884bc727-aa95-42c4-8763-ed2d1cd23f46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888\" (UID: \"884bc727-aa95-42c4-8763-ed2d1cd23f46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888"
Sep 08 16:51:21.794923 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.794905    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/884bc727-aa95-42c4-8763-ed2d1cd23f46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888\" (UID: \"884bc727-aa95-42c4-8763-ed2d1cd23f46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888"
Sep 08 16:51:21.854907 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:21.854876    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888"
Sep 08 16:51:22.124141 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:22.124114    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888"]
Sep 08 16:51:22.126033 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:51:22.126008    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884bc727_aa95_42c4_8763_ed2d1cd23f46.slice/crio-61729cd62df9c97555b1735f5ed306c0ae4de3a8b6e2ac9554d58ed70a230dfc WatchSource:0}: Error finding container 61729cd62df9c97555b1735f5ed306c0ae4de3a8b6e2ac9554d58ed70a230dfc: Status 404 returned error can't find the container with id 61729cd62df9c97555b1735f5ed306c0ae4de3a8b6e2ac9554d58ed70a230dfc
Sep 08 16:51:22.679729 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:22.679686    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888" event={"ID":"884bc727-aa95-42c4-8763-ed2d1cd23f46","Type":"ContainerStarted","Data":"7d6c9326d248820e42d2c584a4a50a94622e9b0716254195bb0449b88d1eb920"}
Sep 08 16:51:22.679903 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:22.679741    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888" event={"ID":"884bc727-aa95-42c4-8763-ed2d1cd23f46","Type":"ContainerStarted","Data":"61729cd62df9c97555b1735f5ed306c0ae4de3a8b6e2ac9554d58ed70a230dfc"}
Sep 08 16:51:22.695808 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:22.695764    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888" podStartSLOduration=1.695751193 podStartE2EDuration="1.695751193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:51:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:51:22.694070799 +0000 UTC m=+1725.278632428" watchObservedRunningTime="2026-09-08 16:51:22.695751193 +0000 UTC m=+1725.280312810"
Sep 08 16:51:23.686960 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:23.686926    2562 generic.go:356] "Generic (PLEG): container finished" podID="884bc727-aa95-42c4-8763-ed2d1cd23f46" containerID="7d6c9326d248820e42d2c584a4a50a94622e9b0716254195bb0449b88d1eb920" exitCode=0
Sep 08 16:51:23.687351 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:23.686976    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888" event={"ID":"884bc727-aa95-42c4-8763-ed2d1cd23f46","Type":"ContainerDied","Data":"7d6c9326d248820e42d2c584a4a50a94622e9b0716254195bb0449b88d1eb920"}
Sep 08 16:51:24.820285 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:24.820254    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888"
Sep 08 16:51:24.917500 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:24.917472    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/884bc727-aa95-42c4-8763-ed2d1cd23f46-maas-api-service-ca\") pod \"884bc727-aa95-42c4-8763-ed2d1cd23f46\" (UID: \"884bc727-aa95-42c4-8763-ed2d1cd23f46\") "
Sep 08 16:51:24.917866 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:24.917845    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/884bc727-aa95-42c4-8763-ed2d1cd23f46-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "884bc727-aa95-42c4-8763-ed2d1cd23f46" (UID: "884bc727-aa95-42c4-8763-ed2d1cd23f46"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:51:25.018187 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:25.018123    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/884bc727-aa95-42c4-8763-ed2d1cd23f46-maas-api-service-ca\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:25.699971 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:25.699944    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888"
Sep 08 16:51:25.700139 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:25.699988    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888" event={"ID":"884bc727-aa95-42c4-8763-ed2d1cd23f46","Type":"ContainerDied","Data":"61729cd62df9c97555b1735f5ed306c0ae4de3a8b6e2ac9554d58ed70a230dfc"}
Sep 08 16:51:25.700139 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:25.700034    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61729cd62df9c97555b1735f5ed306c0ae4de3a8b6e2ac9554d58ed70a230dfc"
Sep 08 16:51:31.550845 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:31.550803    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:32.042373 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:32.042341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:32.123017 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:32.122975    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:32.267605 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:32.267564    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888"]
Sep 08 16:51:32.270292 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:32.270262    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-823397-bl888"]
Sep 08 16:51:32.676001 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:32.675958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:32.734398 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:32.734363    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:34.006315 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:34.006280    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="884bc727-aa95-42c4-8763-ed2d1cd23f46" path="/var/lib/kubelet/pods/884bc727-aa95-42c4-8763-ed2d1cd23f46/volumes"
Sep 08 16:51:34.663791 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:34.663755    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:51:38.247681 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:38.247645    2562 scope.go:117] "RemoveContainer" containerID="80720d16b825a314e2c6e57a8d354f50fa91449d2ac487d74b874bec8ae074f0"
Sep 08 16:51:38.256697 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:38.256677    2562 scope.go:117] "RemoveContainer" containerID="dae5ff3e596262e500d2e389503f3b72806b4a0c7736f17e58a540ab7fdbf3c5"
Sep 08 16:51:38.264444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:38.264429    2562 scope.go:117] "RemoveContainer" containerID="cfef1d116b02845d9524065f4870f853ad3f185d3d966037ef6252a962c8d2cb"
Sep 08 16:51:38.271923 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:38.271901    2562 scope.go:117] "RemoveContainer" containerID="abbec772a5e2dbab6b4375f621ed1930629f1078a2f82ad3abeebb311171ba6d"
Sep 08 16:51:38.813598 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:38.813565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:38.880787 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:38.880695    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:39.069451 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:39.069370    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"]
Sep 08 16:51:39.069692 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:39.069645    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" podUID="34239daa-57e1-47d2-b785-6919adfac141" containerName="istio-proxy" containerID="cri-o://494209fa44c28c8e2baa61f9393957fe4e6482c35df802c365ce4c941e5d970d" gracePeriod=30
Sep 08 16:51:39.101698 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:39.101647    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:39.449656 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:39.449600    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 16:51:39.450010 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:39.449677    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" podUID="34239daa-57e1-47d2-b785-6919adfac141" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 16:51:43.459325 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:43.459286    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:51:44.317785 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.317756    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:51:44.374593 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.374516    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-workload-certs\") pod \"34239daa-57e1-47d2-b785-6919adfac141\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") "
Sep 08 16:51:44.374593 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.374557    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34239daa-57e1-47d2-b785-6919adfac141-istio-podinfo\") pod \"34239daa-57e1-47d2-b785-6919adfac141\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") "
Sep 08 16:51:44.374822 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.374596    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34239daa-57e1-47d2-b785-6919adfac141-istiod-ca-cert\") pod \"34239daa-57e1-47d2-b785-6919adfac141\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") "
Sep 08 16:51:44.374822 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.374671    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34239daa-57e1-47d2-b785-6919adfac141-istio-token\") pod \"34239daa-57e1-47d2-b785-6919adfac141\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") "
Sep 08 16:51:44.374822 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.374696    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-credential-socket\") pod \"34239daa-57e1-47d2-b785-6919adfac141\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") "
Sep 08 16:51:44.374822 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.374747    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-workload-socket\") pod \"34239daa-57e1-47d2-b785-6919adfac141\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") "
Sep 08 16:51:44.374822 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.374772    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-istio-envoy\") pod \"34239daa-57e1-47d2-b785-6919adfac141\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") "
Sep 08 16:51:44.374822 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.374798    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd64f\" (UniqueName: \"kubernetes.io/projected/34239daa-57e1-47d2-b785-6919adfac141-kube-api-access-jd64f\") pod \"34239daa-57e1-47d2-b785-6919adfac141\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") "
Sep 08 16:51:44.375133 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.374823    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-istio-data\") pod \"34239daa-57e1-47d2-b785-6919adfac141\" (UID: \"34239daa-57e1-47d2-b785-6919adfac141\") "
Sep 08 16:51:44.375133 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.374823    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "34239daa-57e1-47d2-b785-6919adfac141" (UID: "34239daa-57e1-47d2-b785-6919adfac141"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:51:44.375133 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.375081    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "34239daa-57e1-47d2-b785-6919adfac141" (UID: "34239daa-57e1-47d2-b785-6919adfac141"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:51:44.375133 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.375094    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "34239daa-57e1-47d2-b785-6919adfac141" (UID: "34239daa-57e1-47d2-b785-6919adfac141"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:51:44.375133 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.375093    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34239daa-57e1-47d2-b785-6919adfac141-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "34239daa-57e1-47d2-b785-6919adfac141" (UID: "34239daa-57e1-47d2-b785-6919adfac141"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:51:44.375319 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.375135    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-workload-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:44.375319 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.375274    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-istio-data" (OuterVolumeSpecName: "istio-data") pod "34239daa-57e1-47d2-b785-6919adfac141" (UID: "34239daa-57e1-47d2-b785-6919adfac141"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:51:44.376998 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.376975    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34239daa-57e1-47d2-b785-6919adfac141-kube-api-access-jd64f" (OuterVolumeSpecName: "kube-api-access-jd64f") pod "34239daa-57e1-47d2-b785-6919adfac141" (UID: "34239daa-57e1-47d2-b785-6919adfac141"). InnerVolumeSpecName "kube-api-access-jd64f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:51:44.377143 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.377125    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/34239daa-57e1-47d2-b785-6919adfac141-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "34239daa-57e1-47d2-b785-6919adfac141" (UID: "34239daa-57e1-47d2-b785-6919adfac141"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:51:44.377415 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.377381    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34239daa-57e1-47d2-b785-6919adfac141-istio-token" (OuterVolumeSpecName: "istio-token") pod "34239daa-57e1-47d2-b785-6919adfac141" (UID: "34239daa-57e1-47d2-b785-6919adfac141"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:51:44.377415 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.377408    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "34239daa-57e1-47d2-b785-6919adfac141" (UID: "34239daa-57e1-47d2-b785-6919adfac141"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:51:44.476500 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.476465    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34239daa-57e1-47d2-b785-6919adfac141-istio-token\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:44.476858 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.476505    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-credential-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:44.476858 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.476521    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-workload-socket\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:44.476858 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.476535    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-istio-envoy\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:44.476858 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.476549    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd64f\" (UniqueName: \"kubernetes.io/projected/34239daa-57e1-47d2-b785-6919adfac141-kube-api-access-jd64f\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:44.476858 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.476563    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34239daa-57e1-47d2-b785-6919adfac141-istio-data\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:44.476858 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.476576    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34239daa-57e1-47d2-b785-6919adfac141-istio-podinfo\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:44.476858 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.476588    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34239daa-57e1-47d2-b785-6919adfac141-istiod-ca-cert\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:51:44.817103 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.817070    2562 generic.go:356] "Generic (PLEG): container finished" podID="34239daa-57e1-47d2-b785-6919adfac141" containerID="494209fa44c28c8e2baa61f9393957fe4e6482c35df802c365ce4c941e5d970d" exitCode=0
Sep 08 16:51:44.817284 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.817129    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"
Sep 08 16:51:44.817284 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.817143    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" event={"ID":"34239daa-57e1-47d2-b785-6919adfac141","Type":"ContainerDied","Data":"494209fa44c28c8e2baa61f9393957fe4e6482c35df802c365ce4c941e5d970d"}
Sep 08 16:51:44.817284 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.817205    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z" event={"ID":"34239daa-57e1-47d2-b785-6919adfac141","Type":"ContainerDied","Data":"1e5941bcdb81da7afba469a0f71b0c343ab15f70ef0b5050ce712b1d4308b260"}
Sep 08 16:51:44.817284 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.817226    2562 scope.go:117] "RemoveContainer" containerID="494209fa44c28c8e2baa61f9393957fe4e6482c35df802c365ce4c941e5d970d"
Sep 08 16:51:44.827475 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.827457    2562 scope.go:117] "RemoveContainer" containerID="976131cb050272b9db4f88c0ce9dee1355348a6863668c69dee92f29a33a1d0d"
Sep 08 16:51:44.835680 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.835662    2562 scope.go:117] "RemoveContainer" containerID="494209fa44c28c8e2baa61f9393957fe4e6482c35df802c365ce4c941e5d970d"
Sep 08 16:51:44.835934 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:51:44.835914    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"494209fa44c28c8e2baa61f9393957fe4e6482c35df802c365ce4c941e5d970d\": container with ID starting with 494209fa44c28c8e2baa61f9393957fe4e6482c35df802c365ce4c941e5d970d not found: ID does not exist" containerID="494209fa44c28c8e2baa61f9393957fe4e6482c35df802c365ce4c941e5d970d"
Sep 08 16:51:44.835981 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.835942    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"494209fa44c28c8e2baa61f9393957fe4e6482c35df802c365ce4c941e5d970d"} err="failed to get container status \"494209fa44c28c8e2baa61f9393957fe4e6482c35df802c365ce4c941e5d970d\": rpc error: code = NotFound desc = could not find container \"494209fa44c28c8e2baa61f9393957fe4e6482c35df802c365ce4c941e5d970d\": container with ID starting with 494209fa44c28c8e2baa61f9393957fe4e6482c35df802c365ce4c941e5d970d not found: ID does not exist"
Sep 08 16:51:44.835981 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.835959    2562 scope.go:117] "RemoveContainer" containerID="976131cb050272b9db4f88c0ce9dee1355348a6863668c69dee92f29a33a1d0d"
Sep 08 16:51:44.836205 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:51:44.836186    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"976131cb050272b9db4f88c0ce9dee1355348a6863668c69dee92f29a33a1d0d\": container with ID starting with 976131cb050272b9db4f88c0ce9dee1355348a6863668c69dee92f29a33a1d0d not found: ID does not exist" containerID="976131cb050272b9db4f88c0ce9dee1355348a6863668c69dee92f29a33a1d0d"
Sep 08 16:51:44.836256 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.836209    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"976131cb050272b9db4f88c0ce9dee1355348a6863668c69dee92f29a33a1d0d"} err="failed to get container status \"976131cb050272b9db4f88c0ce9dee1355348a6863668c69dee92f29a33a1d0d\": rpc error: code = NotFound desc = could not find container \"976131cb050272b9db4f88c0ce9dee1355348a6863668c69dee92f29a33a1d0d\": container with ID starting with 976131cb050272b9db4f88c0ce9dee1355348a6863668c69dee92f29a33a1d0d not found: ID does not exist"
Sep 08 16:51:44.840752 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.840730    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"]
Sep 08 16:51:44.844163 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:44.844144    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z"]
Sep 08 16:51:46.005552 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:51:46.005520    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34239daa-57e1-47d2-b785-6919adfac141" path="/var/lib/kubelet/pods/34239daa-57e1-47d2-b785-6919adfac141/volumes"
Sep 08 16:52:08.843075 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:52:08.843038    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:32.902886 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:52:32.902852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:38.311570 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:52:38.311537    2562 scope.go:117] "RemoveContainer" containerID="62d0e2b5ab52a45a8b5369469ccdd296072392c5f06a5056c9b094eda24834a9"
Sep 08 16:52:38.319913 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:52:38.319896    2562 scope.go:117] "RemoveContainer" containerID="3de3f2d41412a0c09599a7162aa6667ef09a313671ea6d166582da52c69a9f95"
Sep 08 16:53:02.892162 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:53:02.892115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:03.849238 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:53:03.849199    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:53:04.998826 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:53:04.998789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:06.561113 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:53:06.561071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:11.674384 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:53:11.674342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:30.668746 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:53:30.668711    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:53:38.348389 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:53:38.348358    2562 scope.go:117] "RemoveContainer" containerID="c598b332eaaf159ea5bc24e8a7f744086db1c12c61661ff03cc0545bdf9ab7e3"
Sep 08 16:53:38.355792 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:53:38.355764    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:53:38.357566 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:53:38.357547    2562 scope.go:117] "RemoveContainer" containerID="3b8d718bebeb53266fe96a77b4230812e55d9d356e06dd8e838ed742ac612251"
Sep 08 16:53:45.363337 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:53:45.363293    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:53:53.052380 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:53:53.052345    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:54:05.358587 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:54:05.358512    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:54:15.257912 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:54:15.257876    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:54:44.231112 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:54:44.231076    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:38.389031 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:55:38.388999    2562 scope.go:117] "RemoveContainer" containerID="5bef15cb6350e03f6eeebb6e735030715d59804d54588260230269117bf4e05f"
Sep 08 16:55:46.063042 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:55:46.063009    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:55:52.653218 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:55:52.653168    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:56:00.071408 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:00.071367    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:56:01.173016 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.172986    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"]
Sep 08 16:56:01.173594 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.173460    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34239daa-57e1-47d2-b785-6919adfac141" containerName="istio-proxy"
Sep 08 16:56:01.173594 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.173479    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="34239daa-57e1-47d2-b785-6919adfac141" containerName="istio-proxy"
Sep 08 16:56:01.173594 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.173513    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884bc727-aa95-42c4-8763-ed2d1cd23f46" containerName="revoke-keys"
Sep 08 16:56:01.173594 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.173521    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="884bc727-aa95-42c4-8763-ed2d1cd23f46" containerName="revoke-keys"
Sep 08 16:56:01.173594 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.173530    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="041d9586-6e2a-4099-ab67-06e7d2344cd6" containerName="istio-proxy"
Sep 08 16:56:01.173594 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.173538    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="041d9586-6e2a-4099-ab67-06e7d2344cd6" containerName="istio-proxy"
Sep 08 16:56:01.173957 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.173630    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="34239daa-57e1-47d2-b785-6919adfac141" containerName="istio-proxy"
Sep 08 16:56:01.173957 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.173643    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="34239daa-57e1-47d2-b785-6919adfac141" containerName="istio-proxy"
Sep 08 16:56:01.173957 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.173653    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="884bc727-aa95-42c4-8763-ed2d1cd23f46" containerName="revoke-keys"
Sep 08 16:56:01.176927 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.176908    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.184928 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.184909    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-b79180d9-kserve-self-signed-certs\""
Sep 08 16:56:01.192847 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.192826    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"]
Sep 08 16:56:01.235271 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.235247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:01.284810 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.284775    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-home\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.284934 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.284813    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f291725-7b54-4b79-a406-2642612a11d9-tls-certs\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.284934 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.284902    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-model-cache\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.285028 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.284959    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-dshm\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.285028 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.284989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-tmp-dir\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.285028 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.285017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgdwx\" (UniqueName: \"kubernetes.io/projected/1f291725-7b54-4b79-a406-2642612a11d9-kube-api-access-wgdwx\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.386396 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.386366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-dshm\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.386577 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.386414    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-tmp-dir\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.386577 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.386543    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgdwx\" (UniqueName: \"kubernetes.io/projected/1f291725-7b54-4b79-a406-2642612a11d9-kube-api-access-wgdwx\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.386734 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.386639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-home\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.386734 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.386666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f291725-7b54-4b79-a406-2642612a11d9-tls-certs\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.386734 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.386726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-model-cache\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.386909 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.386874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-tmp-dir\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.386977 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.386958    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-home\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.387056 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.387036    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-model-cache\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.388647 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.388621    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-dshm\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.389034 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.389017    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f291725-7b54-4b79-a406-2642612a11d9-tls-certs\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.395700 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.395680    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgdwx\" (UniqueName: \"kubernetes.io/projected/1f291725-7b54-4b79-a406-2642612a11d9-kube-api-access-wgdwx\") pod \"e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") " pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.486761 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.486739    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:01.760396 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:01.760357    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"]
Sep 08 16:56:01.762603 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:56:01.762575    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f291725_7b54_4b79_a406_2642612a11d9.slice/crio-dd459a9adf09ae7e6798be17be8f363b7daae0323e6935048c77d38190ab2aed WatchSource:0}: Error finding container dd459a9adf09ae7e6798be17be8f363b7daae0323e6935048c77d38190ab2aed: Status 404 returned error can't find the container with id dd459a9adf09ae7e6798be17be8f363b7daae0323e6935048c77d38190ab2aed
Sep 08 16:56:02.177076 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:02.176989    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6" event={"ID":"1f291725-7b54-4b79-a406-2642612a11d9","Type":"ContainerStarted","Data":"92b88f04a67e49786e9ec4c8be60ad6b083885f02f6389eef09b82b9cb4edad5"}
Sep 08 16:56:02.177076 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:02.177035    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6" event={"ID":"1f291725-7b54-4b79-a406-2642612a11d9","Type":"ContainerStarted","Data":"dd459a9adf09ae7e6798be17be8f363b7daae0323e6935048c77d38190ab2aed"}
Sep 08 16:56:02.198958 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:02.198909    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6" podStartSLOduration=1.198893808 podStartE2EDuration="1.198893808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:56:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:56:02.196318052 +0000 UTC m=+2004.780879671" watchObservedRunningTime="2026-09-08 16:56:02.198893808 +0000 UTC m=+2004.783455427"
Sep 08 16:56:07.778751 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:07.778713    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:56:11.486944 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:11.486904    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:11.487427 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:11.486964    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:11.499259 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:11.499229    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:12.236739 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:12.236706    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:22.007943 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.007912    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"]
Sep 08 16:56:22.008353 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.008218    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34239daa-57e1-47d2-b785-6919adfac141" containerName="istio-proxy"
Sep 08 16:56:22.008353 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.008230    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="34239daa-57e1-47d2-b785-6919adfac141" containerName="istio-proxy"
Sep 08 16:56:22.011392 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.011374    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.015385 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.015367    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-b79180d9-kserve-self-signed-certs\""
Sep 08 16:56:22.037957 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.037930    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"]
Sep 08 16:56:22.045890 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.045860    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:22.159412 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.159382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-model-cache\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.159583 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.159432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-tmp-dir\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.159583 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.159533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-dshm\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.159697 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.159589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-home\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.159697 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.159659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98ddg\" (UniqueName: \"kubernetes.io/projected/33315cf0-6076-4465-9045-93607790fa94-kube-api-access-98ddg\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.159697 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.159692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33315cf0-6076-4465-9045-93607790fa94-tls-certs\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.260549 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.260475    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-dshm\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.260549 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.260503    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-home\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.260549 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.260525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98ddg\" (UniqueName: \"kubernetes.io/projected/33315cf0-6076-4465-9045-93607790fa94-kube-api-access-98ddg\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.260549 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.260541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33315cf0-6076-4465-9045-93607790fa94-tls-certs\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.260875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.260567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-model-cache\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.260875 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.260628    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-tmp-dir\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.261019 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.261001    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-home\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.261076 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.261036    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-tmp-dir\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.261119 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.261099    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-model-cache\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.262786 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.262756    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-dshm\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.262941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.262925    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33315cf0-6076-4465-9045-93607790fa94-tls-certs\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.269687 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.269665    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98ddg\" (UniqueName: \"kubernetes.io/projected/33315cf0-6076-4465-9045-93607790fa94-kube-api-access-98ddg\") pod \"e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") " pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.320487 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.320464    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:22.594409 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:22.594381    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"]
Sep 08 16:56:22.596139 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:56:22.596112    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33315cf0_6076_4465_9045_93607790fa94.slice/crio-2c292191bbaf6c8bc6f6802308c80d499c8b3828066f9c460874b5690980aa90 WatchSource:0}: Error finding container 2c292191bbaf6c8bc6f6802308c80d499c8b3828066f9c460874b5690980aa90: Status 404 returned error can't find the container with id 2c292191bbaf6c8bc6f6802308c80d499c8b3828066f9c460874b5690980aa90
Sep 08 16:56:23.292825 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:23.292789    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t" event={"ID":"33315cf0-6076-4465-9045-93607790fa94","Type":"ContainerStarted","Data":"33f9e5aba6bedad88f2ed7d88ada75be318cbd659d1703ebd8c35cb6b6ed9ded"}
Sep 08 16:56:23.293255 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:23.292834    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t" event={"ID":"33315cf0-6076-4465-9045-93607790fa94","Type":"ContainerStarted","Data":"2c292191bbaf6c8bc6f6802308c80d499c8b3828066f9c460874b5690980aa90"}
Sep 08 16:56:23.315420 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:23.315373    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t" podStartSLOduration=2.315357838 podStartE2EDuration="2.315357838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:56:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:56:23.314005044 +0000 UTC m=+2025.898566664" watchObservedRunningTime="2026-09-08 16:56:23.315357838 +0000 UTC m=+2025.899919470"
Sep 08 16:56:25.065376 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:25.065343    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:56:32.321277 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:32.321238    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:32.321798 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:32.321312    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:32.333674 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:32.333648    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:32.352296 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:32.352274    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:38.162297 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:38.162260    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"]
Sep 08 16:56:38.189869 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:38.189844    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:40.162125 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:40.162093    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:56:40.344677 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:40.344647    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"]
Sep 08 16:56:40.393104 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:40.393075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:48.171742 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:48.171708    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:56:53.181182 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.181140    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6" podUID="1f291725-7b54-4b79-a406-2642612a11d9" containerName="main" containerID="cri-o://92b88f04a67e49786e9ec4c8be60ad6b083885f02f6389eef09b82b9cb4edad5" gracePeriod=45
Sep 08 16:56:53.430088 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.430062    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:53.456040 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.456004    2562 generic.go:356] "Generic (PLEG): container finished" podID="1f291725-7b54-4b79-a406-2642612a11d9" containerID="92b88f04a67e49786e9ec4c8be60ad6b083885f02f6389eef09b82b9cb4edad5" exitCode=0
Sep 08 16:56:53.456040 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.456048    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"
Sep 08 16:56:53.456283 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.456092    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6" event={"ID":"1f291725-7b54-4b79-a406-2642612a11d9","Type":"ContainerDied","Data":"92b88f04a67e49786e9ec4c8be60ad6b083885f02f6389eef09b82b9cb4edad5"}
Sep 08 16:56:53.456283 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.456149    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6" event={"ID":"1f291725-7b54-4b79-a406-2642612a11d9","Type":"ContainerDied","Data":"dd459a9adf09ae7e6798be17be8f363b7daae0323e6935048c77d38190ab2aed"}
Sep 08 16:56:53.456283 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.456167    2562 scope.go:117] "RemoveContainer" containerID="92b88f04a67e49786e9ec4c8be60ad6b083885f02f6389eef09b82b9cb4edad5"
Sep 08 16:56:53.465742 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.465722    2562 scope.go:117] "RemoveContainer" containerID="92b88f04a67e49786e9ec4c8be60ad6b083885f02f6389eef09b82b9cb4edad5"
Sep 08 16:56:53.466029 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:56:53.466007    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92b88f04a67e49786e9ec4c8be60ad6b083885f02f6389eef09b82b9cb4edad5\": container with ID starting with 92b88f04a67e49786e9ec4c8be60ad6b083885f02f6389eef09b82b9cb4edad5 not found: ID does not exist" containerID="92b88f04a67e49786e9ec4c8be60ad6b083885f02f6389eef09b82b9cb4edad5"
Sep 08 16:56:53.466113 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.466036    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92b88f04a67e49786e9ec4c8be60ad6b083885f02f6389eef09b82b9cb4edad5"} err="failed to get container status \"92b88f04a67e49786e9ec4c8be60ad6b083885f02f6389eef09b82b9cb4edad5\": rpc error: code = NotFound desc = could not find container \"92b88f04a67e49786e9ec4c8be60ad6b083885f02f6389eef09b82b9cb4edad5\": container with ID starting with 92b88f04a67e49786e9ec4c8be60ad6b083885f02f6389eef09b82b9cb4edad5 not found: ID does not exist"
Sep 08 16:56:53.534526 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.534482    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-dshm\") pod \"1f291725-7b54-4b79-a406-2642612a11d9\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") "
Sep 08 16:56:53.534747 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.534550    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-home\") pod \"1f291725-7b54-4b79-a406-2642612a11d9\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") "
Sep 08 16:56:53.534747 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.534570    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgdwx\" (UniqueName: \"kubernetes.io/projected/1f291725-7b54-4b79-a406-2642612a11d9-kube-api-access-wgdwx\") pod \"1f291725-7b54-4b79-a406-2642612a11d9\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") "
Sep 08 16:56:53.534747 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.534642    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-model-cache\") pod \"1f291725-7b54-4b79-a406-2642612a11d9\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") "
Sep 08 16:56:53.534747 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.534661    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-tmp-dir\") pod \"1f291725-7b54-4b79-a406-2642612a11d9\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") "
Sep 08 16:56:53.534747 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.534699    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f291725-7b54-4b79-a406-2642612a11d9-tls-certs\") pod \"1f291725-7b54-4b79-a406-2642612a11d9\" (UID: \"1f291725-7b54-4b79-a406-2642612a11d9\") "
Sep 08 16:56:53.535022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.534877    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-home" (OuterVolumeSpecName: "home") pod "1f291725-7b54-4b79-a406-2642612a11d9" (UID: "1f291725-7b54-4b79-a406-2642612a11d9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:56:53.535022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.534871    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-model-cache" (OuterVolumeSpecName: "model-cache") pod "1f291725-7b54-4b79-a406-2642612a11d9" (UID: "1f291725-7b54-4b79-a406-2642612a11d9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:56:53.535022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.534972    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1f291725-7b54-4b79-a406-2642612a11d9" (UID: "1f291725-7b54-4b79-a406-2642612a11d9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:56:53.536714 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.536691    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-dshm" (OuterVolumeSpecName: "dshm") pod "1f291725-7b54-4b79-a406-2642612a11d9" (UID: "1f291725-7b54-4b79-a406-2642612a11d9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:56:53.536812 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.536732    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f291725-7b54-4b79-a406-2642612a11d9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1f291725-7b54-4b79-a406-2642612a11d9" (UID: "1f291725-7b54-4b79-a406-2642612a11d9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:56:53.536866 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.536830    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f291725-7b54-4b79-a406-2642612a11d9-kube-api-access-wgdwx" (OuterVolumeSpecName: "kube-api-access-wgdwx") pod "1f291725-7b54-4b79-a406-2642612a11d9" (UID: "1f291725-7b54-4b79-a406-2642612a11d9"). InnerVolumeSpecName "kube-api-access-wgdwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:56:53.635484 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.635444    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:56:53.635484 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.635477    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgdwx\" (UniqueName: \"kubernetes.io/projected/1f291725-7b54-4b79-a406-2642612a11d9-kube-api-access-wgdwx\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:56:53.635484 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.635487    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:56:53.635789 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.635515    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:56:53.635789 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.635523    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f291725-7b54-4b79-a406-2642612a11d9-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:56:53.635789 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.635531    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f291725-7b54-4b79-a406-2642612a11d9-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:56:53.783554 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.783522    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"]
Sep 08 16:56:53.788908 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.788884    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-b79180d9-kserve-55484f7d5f-87zw6"]
Sep 08 16:56:53.955190 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:53.955157    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:56:54.005733 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:54.005699    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f291725-7b54-4b79-a406-2642612a11d9" path="/var/lib/kubelet/pods/1f291725-7b54-4b79-a406-2642612a11d9/volumes"
Sep 08 16:56:55.363675 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.363626    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t" podUID="33315cf0-6076-4465-9045-93607790fa94" containerName="main" containerID="cri-o://33f9e5aba6bedad88f2ed7d88ada75be318cbd659d1703ebd8c35cb6b6ed9ded" gracePeriod=45
Sep 08 16:56:55.620247 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.620189    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:55.653158 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.653124    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-model-cache\") pod \"33315cf0-6076-4465-9045-93607790fa94\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") "
Sep 08 16:56:55.653343 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.653169    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-home\") pod \"33315cf0-6076-4465-9045-93607790fa94\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") "
Sep 08 16:56:55.653343 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.653216    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33315cf0-6076-4465-9045-93607790fa94-tls-certs\") pod \"33315cf0-6076-4465-9045-93607790fa94\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") "
Sep 08 16:56:55.653343 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.653266    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98ddg\" (UniqueName: \"kubernetes.io/projected/33315cf0-6076-4465-9045-93607790fa94-kube-api-access-98ddg\") pod \"33315cf0-6076-4465-9045-93607790fa94\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") "
Sep 08 16:56:55.653343 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.653302    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-dshm\") pod \"33315cf0-6076-4465-9045-93607790fa94\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") "
Sep 08 16:56:55.653559 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.653359    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-tmp-dir\") pod \"33315cf0-6076-4465-9045-93607790fa94\" (UID: \"33315cf0-6076-4465-9045-93607790fa94\") "
Sep 08 16:56:55.653559 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.653464    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-model-cache" (OuterVolumeSpecName: "model-cache") pod "33315cf0-6076-4465-9045-93607790fa94" (UID: "33315cf0-6076-4465-9045-93607790fa94"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:56:55.653559 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.653519    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-home" (OuterVolumeSpecName: "home") pod "33315cf0-6076-4465-9045-93607790fa94" (UID: "33315cf0-6076-4465-9045-93607790fa94"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:56:55.653750 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.653689    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-home\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:56:55.653750 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.653697    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "33315cf0-6076-4465-9045-93607790fa94" (UID: "33315cf0-6076-4465-9045-93607790fa94"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:56:55.653750 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.653707    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-model-cache\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:56:55.655527 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.655501    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33315cf0-6076-4465-9045-93607790fa94-kube-api-access-98ddg" (OuterVolumeSpecName: "kube-api-access-98ddg") pod "33315cf0-6076-4465-9045-93607790fa94" (UID: "33315cf0-6076-4465-9045-93607790fa94"). InnerVolumeSpecName "kube-api-access-98ddg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:56:55.655686 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.655542    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-dshm" (OuterVolumeSpecName: "dshm") pod "33315cf0-6076-4465-9045-93607790fa94" (UID: "33315cf0-6076-4465-9045-93607790fa94"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:56:55.655686 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.655586    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33315cf0-6076-4465-9045-93607790fa94-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "33315cf0-6076-4465-9045-93607790fa94" (UID: "33315cf0-6076-4465-9045-93607790fa94"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:56:55.754179 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.754137    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98ddg\" (UniqueName: \"kubernetes.io/projected/33315cf0-6076-4465-9045-93607790fa94-kube-api-access-98ddg\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:56:55.754179 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.754170    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-dshm\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:56:55.754179 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.754179    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33315cf0-6076-4465-9045-93607790fa94-tmp-dir\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:56:55.754179 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:55.754187    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33315cf0-6076-4465-9045-93607790fa94-tls-certs\") on node \"ip-10-0-139-55.ec2.internal\" DevicePath \"\""
Sep 08 16:56:56.474590 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:56.474558    2562 generic.go:356] "Generic (PLEG): container finished" podID="33315cf0-6076-4465-9045-93607790fa94" containerID="33f9e5aba6bedad88f2ed7d88ada75be318cbd659d1703ebd8c35cb6b6ed9ded" exitCode=0
Sep 08 16:56:56.475024 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:56.474600    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"
Sep 08 16:56:56.475024 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:56.474638    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t" event={"ID":"33315cf0-6076-4465-9045-93607790fa94","Type":"ContainerDied","Data":"33f9e5aba6bedad88f2ed7d88ada75be318cbd659d1703ebd8c35cb6b6ed9ded"}
Sep 08 16:56:56.475024 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:56.474681    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t" event={"ID":"33315cf0-6076-4465-9045-93607790fa94","Type":"ContainerDied","Data":"2c292191bbaf6c8bc6f6802308c80d499c8b3828066f9c460874b5690980aa90"}
Sep 08 16:56:56.475024 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:56.474702    2562 scope.go:117] "RemoveContainer" containerID="33f9e5aba6bedad88f2ed7d88ada75be318cbd659d1703ebd8c35cb6b6ed9ded"
Sep 08 16:56:56.483340 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:56.483317    2562 scope.go:117] "RemoveContainer" containerID="33f9e5aba6bedad88f2ed7d88ada75be318cbd659d1703ebd8c35cb6b6ed9ded"
Sep 08 16:56:56.483655 ip-10-0-139-55 kubenswrapper[2562]: E0908 16:56:56.483634    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33f9e5aba6bedad88f2ed7d88ada75be318cbd659d1703ebd8c35cb6b6ed9ded\": container with ID starting with 33f9e5aba6bedad88f2ed7d88ada75be318cbd659d1703ebd8c35cb6b6ed9ded not found: ID does not exist" containerID="33f9e5aba6bedad88f2ed7d88ada75be318cbd659d1703ebd8c35cb6b6ed9ded"
Sep 08 16:56:56.483717 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:56.483664    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f9e5aba6bedad88f2ed7d88ada75be318cbd659d1703ebd8c35cb6b6ed9ded"} err="failed to get container status \"33f9e5aba6bedad88f2ed7d88ada75be318cbd659d1703ebd8c35cb6b6ed9ded\": rpc error: code = NotFound desc = could not find container \"33f9e5aba6bedad88f2ed7d88ada75be318cbd659d1703ebd8c35cb6b6ed9ded\": container with ID starting with 33f9e5aba6bedad88f2ed7d88ada75be318cbd659d1703ebd8c35cb6b6ed9ded not found: ID does not exist"
Sep 08 16:56:56.493392 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:56.493359    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"]
Sep 08 16:56:56.496901 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:56.496875    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-b79180d9-kserve-9785dc95-99s7t"]
Sep 08 16:56:58.005294 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:58.005251    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33315cf0-6076-4465-9045-93607790fa94" path="/var/lib/kubelet/pods/33315cf0-6076-4465-9045-93607790fa94/volumes"
Sep 08 16:56:58.365180 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:58.365092    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:56:58.985180 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:56:58.985137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:05.770064 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:05.769980    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:57:06.091838 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.091743    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"]
Sep 08 16:57:06.092163 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.092145    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f291725-7b54-4b79-a406-2642612a11d9" containerName="main"
Sep 08 16:57:06.092253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.092166    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f291725-7b54-4b79-a406-2642612a11d9" containerName="main"
Sep 08 16:57:06.092253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.092177    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33315cf0-6076-4465-9045-93607790fa94" containerName="main"
Sep 08 16:57:06.092253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.092185    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="33315cf0-6076-4465-9045-93607790fa94" containerName="main"
Sep 08 16:57:06.092424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.092314    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="33315cf0-6076-4465-9045-93607790fa94" containerName="main"
Sep 08 16:57:06.092424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.092329    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f291725-7b54-4b79-a406-2642612a11d9" containerName="main"
Sep 08 16:57:06.096663 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.096640    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.099364 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.099345    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:57:06.100253 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.100232    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 16:57:06.100354 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.100259    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 16:57:06.100418 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.100390    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-65b2g\""
Sep 08 16:57:06.100531 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.100508    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 16:57:06.119714 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.119689    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"]
Sep 08 16:57:06.145329 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.145301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5509e8f5-8d5b-4a38-b08f-b725e50471b4-maas-api-tls\") pod \"maas-api-b4455d767-lwz4j\" (UID: \"5509e8f5-8d5b-4a38-b08f-b725e50471b4\") " pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.145432 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.145338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml579\" (UniqueName: \"kubernetes.io/projected/5509e8f5-8d5b-4a38-b08f-b725e50471b4-kube-api-access-ml579\") pod \"maas-api-b4455d767-lwz4j\" (UID: \"5509e8f5-8d5b-4a38-b08f-b725e50471b4\") " pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.145432 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.145366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5509e8f5-8d5b-4a38-b08f-b725e50471b4-metrics-certs\") pod \"maas-api-b4455d767-lwz4j\" (UID: \"5509e8f5-8d5b-4a38-b08f-b725e50471b4\") " pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.145572 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.145477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5509e8f5-8d5b-4a38-b08f-b725e50471b4-openshift-service-ca\") pod \"maas-api-b4455d767-lwz4j\" (UID: \"5509e8f5-8d5b-4a38-b08f-b725e50471b4\") " pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.245930 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.245901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5509e8f5-8d5b-4a38-b08f-b725e50471b4-metrics-certs\") pod \"maas-api-b4455d767-lwz4j\" (UID: \"5509e8f5-8d5b-4a38-b08f-b725e50471b4\") " pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.246079 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.245950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5509e8f5-8d5b-4a38-b08f-b725e50471b4-openshift-service-ca\") pod \"maas-api-b4455d767-lwz4j\" (UID: \"5509e8f5-8d5b-4a38-b08f-b725e50471b4\") " pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.246079 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.245985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5509e8f5-8d5b-4a38-b08f-b725e50471b4-maas-api-tls\") pod \"maas-api-b4455d767-lwz4j\" (UID: \"5509e8f5-8d5b-4a38-b08f-b725e50471b4\") " pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.246079 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.246009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml579\" (UniqueName: \"kubernetes.io/projected/5509e8f5-8d5b-4a38-b08f-b725e50471b4-kube-api-access-ml579\") pod \"maas-api-b4455d767-lwz4j\" (UID: \"5509e8f5-8d5b-4a38-b08f-b725e50471b4\") " pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.246667 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.246645    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5509e8f5-8d5b-4a38-b08f-b725e50471b4-openshift-service-ca\") pod \"maas-api-b4455d767-lwz4j\" (UID: \"5509e8f5-8d5b-4a38-b08f-b725e50471b4\") " pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.248370 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.248350    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5509e8f5-8d5b-4a38-b08f-b725e50471b4-maas-api-tls\") pod \"maas-api-b4455d767-lwz4j\" (UID: \"5509e8f5-8d5b-4a38-b08f-b725e50471b4\") " pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.248436 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.248376    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5509e8f5-8d5b-4a38-b08f-b725e50471b4-metrics-certs\") pod \"maas-api-b4455d767-lwz4j\" (UID: \"5509e8f5-8d5b-4a38-b08f-b725e50471b4\") " pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.255524 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.255506    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml579\" (UniqueName: \"kubernetes.io/projected/5509e8f5-8d5b-4a38-b08f-b725e50471b4-kube-api-access-ml579\") pod \"maas-api-b4455d767-lwz4j\" (UID: \"5509e8f5-8d5b-4a38-b08f-b725e50471b4\") " pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.407362 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.407274    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:06.692133 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.692104    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"]
Sep 08 16:57:06.695382 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:57:06.695356    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5509e8f5_8d5b_4a38_b08f_b725e50471b4.slice/crio-4ffbde9e41ba2b5d76d1d674f125a6d7e9998f6ef9b6a636d49a02fdd7cb2f19 WatchSource:0}: Error finding container 4ffbde9e41ba2b5d76d1d674f125a6d7e9998f6ef9b6a636d49a02fdd7cb2f19: Status 404 returned error can't find the container with id 4ffbde9e41ba2b5d76d1d674f125a6d7e9998f6ef9b6a636d49a02fdd7cb2f19
Sep 08 16:57:06.696754 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:06.696734    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:57:07.546407 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:07.546368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j" event={"ID":"5509e8f5-8d5b-4a38-b08f-b725e50471b4","Type":"ContainerStarted","Data":"4ffbde9e41ba2b5d76d1d674f125a6d7e9998f6ef9b6a636d49a02fdd7cb2f19"}
Sep 08 16:57:08.552793 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:08.552755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j" event={"ID":"5509e8f5-8d5b-4a38-b08f-b725e50471b4","Type":"ContainerStarted","Data":"e64482eb16d333bccb09daa3125f2e64c87b1d02a1b6f7cb8e396f0cd3459e2a"}
Sep 08 16:57:08.553174 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:08.552830    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:08.578682 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:08.575804    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j" podStartSLOduration=1.226366014 podStartE2EDuration="2.575785759s" totalImagesPullingTime="1.349419745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:57:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:57:08.572736616 +0000 UTC m=+2071.157298260" watchObservedRunningTime="2026-09-08 16:57:08.575785759 +0000 UTC m=+2071.160347380"
Sep 08 16:57:12.782242 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:12.782191    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:57:14.563440 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:14.563411    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b4455d767-lwz4j"
Sep 08 16:57:18.676856 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:18.676813    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:57:25.664363 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:25.664321    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-9lqx5"]
Sep 08 16:57:34.354773 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:34.354739    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qwgbj_c26109ce-727a-4b30-bb5d-0cd035426db9/server/0.log"
Sep 08 16:57:34.474306 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:34.474277    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6bkt2_eec2efee-b97f-43db-9172-11c873e190b2/manager/0.log"
Sep 08 16:57:34.725076 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:34.725050    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fcf9b86-b9qnp_cade7f97-90d6-49f5-9247-1b107cf5061d/copy-manifests/0.log"
Sep 08 16:57:34.734866 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:34.734846    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fcf9b86-b9qnp_cade7f97-90d6-49f5-9247-1b107cf5061d/manager/0.log"
Sep 08 16:57:35.314837 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:35.314810    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-b4455d767-lwz4j_5509e8f5-8d5b-4a38-b08f-b725e50471b4/maas-api/0.log"
Sep 08 16:57:35.426963 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:35.426931    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29814765-76npc_e1259cfa-a80d-4392-80dd-45c270ad54ae/cleanup/0.log"
Sep 08 16:57:36.684528 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:36.684500    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6whl8_d2f005c9-fd38-4c15-a432-7d464d0a9b12/kuadrant-console-plugin/0.log"
Sep 08 16:57:36.932068 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:36.932042    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-9lqx5_846955b8-cf57-4801-921e-fd2293d0fbbb/limitador/0.log"
Sep 08 16:57:37.048094 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:37.048063    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-jdxfs_49be2251-9462-4023-86f7-c2589169a265/manager/0.log"
Sep 08 16:57:37.413969 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:37.413893    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf_041f90c4-50b0-4ce8-bfff-1f3ba3486e19/istio-proxy/0.log"
Sep 08 16:57:37.908558 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:37.908504    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mrfvn_5e3350f7-f053-4982-bf8c-bd822f1c77ec/istio-proxy/1.log"
Sep 08 16:57:38.419145 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:38.419112    2562 scope.go:117] "RemoveContainer" containerID="93ef4d1c82346efed24a8951c580565e6a73571b6d0f88ea4a7a54c4c05904a0"
Sep 08 16:57:38.429405 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:38.429384    2562 scope.go:117] "RemoveContainer" containerID="7d6c9326d248820e42d2c584a4a50a94622e9b0716254195bb0449b88d1eb920"
Sep 08 16:57:38.437217 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:38.437188    2562 scope.go:117] "RemoveContainer" containerID="84d8208e35e67a4133e9db3cf0450413ea2aad469b2763949e2a73f144b9e770"
Sep 08 16:57:38.955878 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:38.955853    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-xxgkp_48cefef3-5912-42d1-af7f-4912e3f6dd24/main/0.log"
Sep 08 16:57:39.181766 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:39.181738    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zqn5k_2715c1c1-df46-461a-bc06-84ee4cad89c3/main/0.log"
Sep 08 16:57:45.032588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.032546    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t96w8/must-gather-vndd8"]
Sep 08 16:57:45.036090 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.036074    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t96w8/must-gather-vndd8"
Sep 08 16:57:45.040458 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.040431    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t96w8\"/\"default-dockercfg-52jnx\""
Sep 08 16:57:45.040458 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.040458    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t96w8\"/\"openshift-service-ca.crt\""
Sep 08 16:57:45.040667 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.040486    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t96w8\"/\"kube-root-ca.crt\""
Sep 08 16:57:45.052435 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.052409    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t96w8/must-gather-vndd8"]
Sep 08 16:57:45.057147 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.057126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:45.099321 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.099291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/14fd8517-65e5-4c65-917d-7706714d6e3d-must-gather-output\") pod \"must-gather-vndd8\" (UID: \"14fd8517-65e5-4c65-917d-7706714d6e3d\") " pod="openshift-must-gather-t96w8/must-gather-vndd8"
Sep 08 16:57:45.099472 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.099347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qkfq\" (UniqueName: \"kubernetes.io/projected/14fd8517-65e5-4c65-917d-7706714d6e3d-kube-api-access-6qkfq\") pod \"must-gather-vndd8\" (UID: \"14fd8517-65e5-4c65-917d-7706714d6e3d\") " pod="openshift-must-gather-t96w8/must-gather-vndd8"
Sep 08 16:57:45.151289 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.151263    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:45.200785 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.200750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/14fd8517-65e5-4c65-917d-7706714d6e3d-must-gather-output\") pod \"must-gather-vndd8\" (UID: \"14fd8517-65e5-4c65-917d-7706714d6e3d\") " pod="openshift-must-gather-t96w8/must-gather-vndd8"
Sep 08 16:57:45.200941 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.200812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qkfq\" (UniqueName: \"kubernetes.io/projected/14fd8517-65e5-4c65-917d-7706714d6e3d-kube-api-access-6qkfq\") pod \"must-gather-vndd8\" (UID: \"14fd8517-65e5-4c65-917d-7706714d6e3d\") " pod="openshift-must-gather-t96w8/must-gather-vndd8"
Sep 08 16:57:45.201074 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.201055    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/14fd8517-65e5-4c65-917d-7706714d6e3d-must-gather-output\") pod \"must-gather-vndd8\" (UID: \"14fd8517-65e5-4c65-917d-7706714d6e3d\") " pod="openshift-must-gather-t96w8/must-gather-vndd8"
Sep 08 16:57:45.210234 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.210202    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qkfq\" (UniqueName: \"kubernetes.io/projected/14fd8517-65e5-4c65-917d-7706714d6e3d-kube-api-access-6qkfq\") pod \"must-gather-vndd8\" (UID: \"14fd8517-65e5-4c65-917d-7706714d6e3d\") " pod="openshift-must-gather-t96w8/must-gather-vndd8"
Sep 08 16:57:45.345116 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.345021    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t96w8/must-gather-vndd8"
Sep 08 16:57:45.627588 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.627556    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t96w8/must-gather-vndd8"]
Sep 08 16:57:45.630242 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:57:45.630217    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14fd8517_65e5_4c65_917d_7706714d6e3d.slice/crio-9091729c12a653584e7cd000ab889af9659191474aa7688974b2e55b35e16e7c WatchSource:0}: Error finding container 9091729c12a653584e7cd000ab889af9659191474aa7688974b2e55b35e16e7c: Status 404 returned error can't find the container with id 9091729c12a653584e7cd000ab889af9659191474aa7688974b2e55b35e16e7c
Sep 08 16:57:45.753214 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:45.753181    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t96w8/must-gather-vndd8" event={"ID":"14fd8517-65e5-4c65-917d-7706714d6e3d","Type":"ContainerStarted","Data":"9091729c12a653584e7cd000ab889af9659191474aa7688974b2e55b35e16e7c"}
Sep 08 16:57:47.769460 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:47.769420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t96w8/must-gather-vndd8" event={"ID":"14fd8517-65e5-4c65-917d-7706714d6e3d","Type":"ContainerStarted","Data":"39018f36230637456a9d17923d7c91f0fc3863b730b9f73dedd5e0f8c1869b88"}
Sep 08 16:57:47.770022 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:47.769997    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t96w8/must-gather-vndd8" event={"ID":"14fd8517-65e5-4c65-917d-7706714d6e3d","Type":"ContainerStarted","Data":"c552a98e68c9e6d412fa7fd45665b4a409dc2a7fb82553ce542894fab5c540c1"}
Sep 08 16:57:47.796698 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:47.796643    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t96w8/must-gather-vndd8" podStartSLOduration=1.695540751 podStartE2EDuration="2.796627282s" totalImagesPullingTime="1.101086531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:57:47.795356867 +0000 UTC m=+2110.379918487" watchObservedRunningTime="2026-09-08 16:57:47.796627282 +0000 UTC m=+2110.381188891"
Sep 08 16:57:48.431397 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:48.431358    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vff9d_77b89410-d802-4589-9a49-f590c6f13099/global-pull-secret-syncer/0.log"
Sep 08 16:57:48.531807 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:48.531764    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bfdd5_be110726-9f24-4c17-83ef-400240a0ad4a/konnectivity-agent/0.log"
Sep 08 16:57:48.682548 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:48.682476    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-55.ec2.internal_eb1873c0b5061ed129a3ea1791cda518/haproxy/0.log"
Sep 08 16:57:53.726574 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:53.726543    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6whl8_d2f005c9-fd38-4c15-a432-7d464d0a9b12/kuadrant-console-plugin/0.log"
Sep 08 16:57:53.819415 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:53.819373    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-9lqx5_846955b8-cf57-4801-921e-fd2293d0fbbb/limitador/0.log"
Sep 08 16:57:53.900329 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:53.900261    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-jdxfs_49be2251-9462-4023-86f7-c2589169a265/manager/0.log"
Sep 08 16:57:56.026794 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:56.026765    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vj2d_c65b5292-6d36-4eab-ac48-4598e1bf9ee1/node-exporter/0.log"
Sep 08 16:57:56.050781 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:56.050726    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vj2d_c65b5292-6d36-4eab-ac48-4598e1bf9ee1/kube-rbac-proxy/0.log"
Sep 08 16:57:56.076562 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:56.076524    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vj2d_c65b5292-6d36-4eab-ac48-4598e1bf9ee1/init-textfile/0.log"
Sep 08 16:57:56.670835 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:56.670806    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-v8dj8_9f897b44-64f0-4a80-a0b6-8c11022c0ed0/prometheus-operator-admission-webhook/0.log"
Sep 08 16:57:58.687843 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.687808    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"]
Sep 08 16:57:58.694267 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.694234    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.730444 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.730409    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"]
Sep 08 16:57:58.870428 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.870385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33010f7b-9497-4e96-969d-0a91403edb53-lib-modules\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.870621 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.870446    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf2ln\" (UniqueName: \"kubernetes.io/projected/33010f7b-9497-4e96-969d-0a91403edb53-kube-api-access-jf2ln\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.870621 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.870538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33010f7b-9497-4e96-969d-0a91403edb53-podres\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.870621 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.870565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33010f7b-9497-4e96-969d-0a91403edb53-sys\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.870768 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.870664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33010f7b-9497-4e96-969d-0a91403edb53-proc\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.971228 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.971183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33010f7b-9497-4e96-969d-0a91403edb53-proc\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.971424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.971313    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33010f7b-9497-4e96-969d-0a91403edb53-proc\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.971424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.971345    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33010f7b-9497-4e96-969d-0a91403edb53-lib-modules\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.971424 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.971395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf2ln\" (UniqueName: \"kubernetes.io/projected/33010f7b-9497-4e96-969d-0a91403edb53-kube-api-access-jf2ln\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.971601 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.971475    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33010f7b-9497-4e96-969d-0a91403edb53-podres\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.971601 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.971519    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33010f7b-9497-4e96-969d-0a91403edb53-sys\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.971601 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.971528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33010f7b-9497-4e96-969d-0a91403edb53-lib-modules\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.971749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.971686    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33010f7b-9497-4e96-969d-0a91403edb53-sys\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.971749 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.971705    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33010f7b-9497-4e96-969d-0a91403edb53-podres\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:58.983939 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:58.983913    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf2ln\" (UniqueName: \"kubernetes.io/projected/33010f7b-9497-4e96-969d-0a91403edb53-kube-api-access-jf2ln\") pod \"perf-node-gather-daemonset-bq9tn\" (UID: \"33010f7b-9497-4e96-969d-0a91403edb53\") " pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:59.008692 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:59.008666    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:59.329676 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:59.329247    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"]
Sep 08 16:57:59.335721 ip-10-0-139-55 kubenswrapper[2562]: W0908 16:57:59.335693    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod33010f7b_9497_4e96_969d_0a91403edb53.slice/crio-2c18c4f8f73053fa104b559b981ea85d8ef6023f90f0a03fa2da7c55c061ee6e WatchSource:0}: Error finding container 2c18c4f8f73053fa104b559b981ea85d8ef6023f90f0a03fa2da7c55c061ee6e: Status 404 returned error can't find the container with id 2c18c4f8f73053fa104b559b981ea85d8ef6023f90f0a03fa2da7c55c061ee6e
Sep 08 16:57:59.875643 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:59.875586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn" event={"ID":"33010f7b-9497-4e96-969d-0a91403edb53","Type":"ContainerStarted","Data":"d283e420eac209543543143ed32b214375b7baf17d76c646037513551739d312"}
Sep 08 16:57:59.876115 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:59.875670    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn" event={"ID":"33010f7b-9497-4e96-969d-0a91403edb53","Type":"ContainerStarted","Data":"2c18c4f8f73053fa104b559b981ea85d8ef6023f90f0a03fa2da7c55c061ee6e"}
Sep 08 16:57:59.876115 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:59.875874    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:57:59.901851 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:59.901794    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn" podStartSLOduration=1.901777594 podStartE2EDuration="1.901777594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:57:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:57:59.898020032 +0000 UTC m=+2122.482581650" watchObservedRunningTime="2026-09-08 16:57:59.901777594 +0000 UTC m=+2122.486339212"
Sep 08 16:57:59.934438 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:57:59.934396    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7fd4d5b5ff-vbhbd_2888e97a-7209-4449-9af7-3bb12c20fe61/console/0.log"
Sep 08 16:58:01.868291 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:01.868252    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-87bwf_958b9f92-be92-477b-864a-a110e557012d/dns/0.log"
Sep 08 16:58:01.962617 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:01.962571    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-87bwf_958b9f92-be92-477b-864a-a110e557012d/kube-rbac-proxy/0.log"
Sep 08 16:58:02.313764 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:02.313736    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pddhd_b6329a43-ae93-4025-a44d-c8ac03d2f98d/dns-node-resolver/0.log"
Sep 08 16:58:02.945917 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:02.945886    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-85c8dfddd-2zb9s_ec6d58ed-1fb5-479a-aa31-327be47f48f3/registry/0.log"
Sep 08 16:58:02.986697 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:02.986668    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2svs7_f973e0f6-5b4e-4cb8-bbc5-2822d47fc567/node-ca/0.log"
Sep 08 16:58:04.122028 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:04.121997    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf_041f90c4-50b0-4ce8-bfff-1f3ba3486e19/istio-proxy/0.log"
Sep 08 16:58:04.456926 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:04.456879    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mrfvn_5e3350f7-f053-4982-bf8c-bd822f1c77ec/istio-proxy/0.log"
Sep 08 16:58:04.466957 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:04.466927    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mrfvn_5e3350f7-f053-4982-bf8c-bd822f1c77ec/istio-proxy/1.log"
Sep 08 16:58:05.569761 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:05.569734    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghw5g_a06ce30b-c168-43a7-85f9-df2ac83553dd/serve-healthcheck-canary/0.log"
Sep 08 16:58:05.894884 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:05.894795    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t96w8/perf-node-gather-daemonset-bq9tn"
Sep 08 16:58:06.416681 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:06.416639    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jbqd8_8a4d362b-aedd-4fb1-aa25-946674ca2075/kube-rbac-proxy/0.log"
Sep 08 16:58:06.450258 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:06.450227    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jbqd8_8a4d362b-aedd-4fb1-aa25-946674ca2075/exporter/0.log"
Sep 08 16:58:06.489930 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:06.489898    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jbqd8_8a4d362b-aedd-4fb1-aa25-946674ca2075/extractor/0.log"
Sep 08 16:58:08.763573 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:08.763547    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf_041f90c4-50b0-4ce8-bfff-1f3ba3486e19/istio-proxy/0.log"
Sep 08 16:58:09.033675 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:09.033638    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mrfvn_5e3350f7-f053-4982-bf8c-bd822f1c77ec/istio-proxy/0.log"
Sep 08 16:58:09.043126 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:09.043080    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mrfvn_5e3350f7-f053-4982-bf8c-bd822f1c77ec/istio-proxy/1.log"
Sep 08 16:58:09.309136 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:09.309054    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qwgbj_c26109ce-727a-4b30-bb5d-0cd035426db9/server/0.log"
Sep 08 16:58:09.410543 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:09.410495    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6bkt2_eec2efee-b97f-43db-9172-11c873e190b2/manager/0.log"
Sep 08 16:58:09.660309 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:09.660198    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fcf9b86-b9qnp_cade7f97-90d6-49f5-9247-1b107cf5061d/manager/0.log"
Sep 08 16:58:09.747933 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:09.747904    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fcf9b86-b9qnp_cade7f97-90d6-49f5-9247-1b107cf5061d/copy-manifests/0.log"
Sep 08 16:58:10.576894 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:10.576847    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf_041f90c4-50b0-4ce8-bfff-1f3ba3486e19/istio-proxy/0.log"
Sep 08 16:58:10.855815 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:10.855737    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mrfvn_5e3350f7-f053-4982-bf8c-bd822f1c77ec/istio-proxy/0.log"
Sep 08 16:58:10.863499 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:10.863475    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mrfvn_5e3350f7-f053-4982-bf8c-bd822f1c77ec/istio-proxy/1.log"
Sep 08 16:58:11.147743 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:11.147673    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5ddb9f5cb8-rm45r_214d8793-55a5-467f-8583-4543780e4e7f/manager/0.log"
Sep 08 16:58:11.182413 ip-10-0-139-55 kubenswrapper[2562]: I0908 16:58:11.182385    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-s8cdd_393e0d65-209f-4f4f-806a-3f72006b0b15/openshift-lws-operator/0.log"